2023-11-18T18:49:40.068 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-18T18:49:40.068 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} --archive /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631 -- /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/orig.config.yaml 2023-11-18T18:49:40.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-18T18:49:40.197 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631 branch: main description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} email: yweinste@redhat.com first_in_suite: false job_id: '7461631' kclient-workload: sequential: - kclient: - client.1 - workunit: clients: client.1: - kernel_untar_build.sh kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1491 sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxi6IfQxZmhIEmrciFlkJVcoI5Kuihsb/cws3xBpSC7NRmfCuG4ikrHEfr35KkPEihQCfq77SiOu0/Mz8NfKpc= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2Ybx6HbM45x/yzfJPFo+xiWmdEeDbtUwg16eOlEqGX6FCgudCR/BGrHBGbFi5r1vqgKjXLYxFwP4gjPnBVyFg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - parallel: - user-workload - kclient-workload teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-18_13:51:50 tube: smithi user: yuriw user-workload: sequential: - ceph-fuse: - client.0 - workunit: clients: client.0: - suites/blogbench.sh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-18T18:49:40.197 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa; will attempt to use it 2023-11-18T18:49:40.198 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks 2023-11-18T18:49:40.198 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-18T18:49:40.199 INFO:teuthology.task.internal:Checking packages... 2023-11-18T18:49:40.224 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe' 2023-11-18T18:49:40.224 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-18T18:49:40.224 INFO:teuthology.packaging:ref: None 2023-11-18T18:49:40.224 INFO:teuthology.packaging:tag: None 2023-11-18T18:49:40.224 INFO:teuthology.packaging:branch: main 2023-11-18T18:49:40.224 INFO:teuthology.packaging:sha1: b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T18:49:40.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-18T18:49:40.574 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7424.g6adc03ac 2023-11-18T18:49:40.574 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-18T18:49:40.580 INFO:teuthology.task.internal:no buildpackages task found 2023-11-18T18:49:40.580 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-18T18:49:40.592 INFO:teuthology.task.internal:Saving configuration 2023-11-18T18:49:40.608 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-18T18:49:40.613 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T18:49:40.639 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 18:44:35.579756', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxi6IfQxZmhIEmrciFlkJVcoI5Kuihsb/cws3xBpSC7NRmfCuG4ikrHEfr35KkPEihQCfq77SiOu0/Mz8NfKpc='} 2023-11-18T18:49:40.660 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 18:44:35.581138', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2Ybx6HbM45x/yzfJPFo+xiWmdEeDbtUwg16eOlEqGX6FCgudCR/BGrHBGbFi5r1vqgKjXLYxFwP4gjPnBVyFg='} 2023-11-18T18:49:40.660 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-18T18:49:40.665 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-18T18:49:40.665 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-11-18T18:49:40.666 INFO:teuthology.run_tasks:Running task console_log... 2023-11-18T18:49:40.731 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7dbaba7040>, signals=[15]) 2023-11-18T18:49:40.731 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-18T18:49:40.736 INFO:teuthology.task.internal:Opening connections... 2023-11-18T18:49:40.737 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T18:49:40.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T18:49:40.836 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T18:49:40.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T18:49:40.918 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-18T18:49:40.924 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-11-18T18:49:40.941 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-11-18T18:49:40.941 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-11-18T18:49:40.997 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-11-18T18:49:40.997 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2023-11-18T18:49:40.997 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-11-18T18:49:40.997 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-11-18T18:49:40.997 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-18T18:49:40.998 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-18T18:49:40.999 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-11-18T18:49:41.021 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-11-18T18:49:41.038 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-11-18T18:49:41.039 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-11-18T18:49:41.095 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-11-18T18:49:41.095 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2023-11-18T18:49:41.095 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-18T18:49:41.096 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-18T18:49:41.096 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-11-18T18:49:41.113 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-18T18:49:41.121 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-18T18:49:41.127 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-18T18:49:41.127 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-11-18T18:49:41.130 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-11-18T18:49:41.151 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-18T18:49:41.156 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-18T18:49:41.157 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-11-18T18:49:41.185 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-11-18T18:49:41.219 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-18T18:49:41.269 INFO:teuthology.run_tasks:Running task kernel... 2023-11-18T18:49:41.282 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-18T18:49:41.282 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-11-18T18:49:41.282 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-18T18:49:41.283 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T18:49:41.283 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-18T18:49:41.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T18:49:41.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-18T18:49:41.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T18:49:41.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-18T18:49:41.459 DEBUG:teuthology.task.kernel:sha1 for client.0 is ab677fe869e84af753f648236d6083528a81a405 2023-11-18T18:49:41.459 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "ab677fe869e84af753f648236d6083528a81a405"... 2023-11-18T18:49:41.460 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-11-18T18:49:41.462 DEBUG:teuthology.task.kernel:sha1 for client.1 is ab677fe869e84af753f648236d6083528a81a405 2023-11-18T18:49:41.462 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "ab677fe869e84af753f648236d6083528a81a405"... 2023-11-18T18:49:41.462 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-11-18T18:49:41.478 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-361.el9.x86_64 2023-11-18T18:49:41.478 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs ab677fe869e84af753f648236d6083528a81a405 2023-11-18T18:49:41.479 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-18T18:49:41.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum upgrade -y linux-firmware 2023-11-18T18:49:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-361.el9.x86_64 2023-11-18T18:49:41.480 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs ab677fe869e84af753f648236d6083528a81a405 2023-11-18T18:49:41.480 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-18T18:49:41.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum upgrade -y linux-firmware 2023-11-18T18:49:43.485 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-11-18T18:49:43.602 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-11-18T18:49:44.903 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2023-11-18T18:49:44.977 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-11-18T18:49:46.535 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 7.9 MB 00:01 2023-11-18T18:49:46.802 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 7.9 MB 00:01 2023-11-18T18:49:48.719 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 17 MB/s | 18 MB 00:01 2023-11-18T18:49:50.445 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 18 MB 00:02 2023-11-18T18:49:52.686 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.8 MB 00:00 2023-11-18T18:49:55.021 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 5.8 MB 00:01 2023-11-18T18:49:55.120 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2023-11-18T18:49:56.205 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2023-11-18T18:49:56.546 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 15 kB 00:00 2023-11-18T18:49:58.301 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-11-18T18:50:01.155 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2023-11-18T18:50:02.965 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-11-18T18:50:03.699 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-11-18T18:50:03.710 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 1 Package 2023-11-18T18:50:03.711 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T18:50:03.711 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 328 M 2023-11-18T18:50:03.711 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-11-18T18:50:05.390 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-11-18T18:50:05.400 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 1 Package 2023-11-18T18:50:05.401 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T18:50:05.401 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 328 M 2023-11-18T18:50:05.401 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-11-18T18:50:07.514 INFO:teuthology.orchestra.run.smithi045.stdout:linux-firmware-20231030-141.el9.noarch.rpm 86 MB/s | 328 MB 00:03 2023-11-18T18:50:07.515 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-11-18T18:50:07.515 INFO:teuthology.orchestra.run.smithi045.stdout:Total 86 MB/s | 328 MB 00:03 2023-11-18T18:50:07.516 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-11-18T18:50:07.626 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-11-18T18:50:07.626 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-11-18T18:50:09.225 INFO:teuthology.orchestra.run.smithi135.stdout:linux-firmware-20231030-141.el9.noarch.rpm 86 MB/s | 328 MB 00:03 2023-11-18T18:50:09.226 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-11-18T18:50:09.227 INFO:teuthology.orchestra.run.smithi135.stdout:Total 86 MB/s | 328 MB 00:03 2023-11-18T18:50:09.227 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-11-18T18:50:09.325 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-11-18T18:50:09.325 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-11-18T18:50:09.848 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-11-18T18:50:09.848 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-11-18T18:50:11.433 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-11-18T18:50:11.433 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-11-18T18:50:15.670 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-11-18T18:50:15.969 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T18:50:16.065 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T18:50:17.218 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T18:50:17.218 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T18:50:17.367 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-11-18T18:50:17.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T18:50:17.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T18:50:17.636 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-11-18T18:50:17.637 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-18T18:50:17.637 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T18:50:17.637 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-11-18T18:50:17.929 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T18:50:17.930 INFO:teuthology.task.kernel:Downloading kernel ab677fe869e84af753f648236d6083528a81a405 on client.0... 2023-11-18T18:50:17.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ab677fe869e84af753f648236d6083528a81a405 2023-11-18T18:50:18.018 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T18:50:18.075 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ 2023-11-18T18:50:18.075 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gab677fe869e8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-18T18:50:18.078 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-11-18T18:50:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T18:50:19.061 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-18T18:50:19.422 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-18T18:50:19.422 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T18:50:19.422 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-11-18T18:50:19.423 INFO:teuthology.orchestra.run.smithi135.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-18T18:50:19.423 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T18:50:19.423 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-11-18T18:50:19.736 INFO:teuthology.task.kernel:Downloading kernel ab677fe869e84af753f648236d6083528a81a405 on client.1... 2023-11-18T18:50:19.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ab677fe869e84af753f648236d6083528a81a405 2023-11-18T18:50:19.954 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ 2023-11-18T18:50:19.955 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gab677fe869e8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-18T18:50:19.957 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi135.front.sepia.ceph.com to complete... 2023-11-18T18:50:32.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18 18:50:32 URL:https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/kernel-6.6.0_gab677fe869e8-1.x86_64.rpm [320491466/320491466] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-18T18:50:32.587 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-11-18 18:50:32-- 2023-11-18T18:50:32.588 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 14s 2023-11-18T18:50:32.588 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 306M in 14s (21.7 MB/s) 2023-11-18T18:50:32.589 INFO:teuthology.task.kernel:Installing kernel ab677fe869e84af753f648236d6083528a81a405 on client.0... 2023-11-18T18:50:32.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-18T18:50:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying... ######################################## 2023-11-18T18:50:34.576 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing... ######################################## 2023-11-18T18:50:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:Updating / installing... 2023-11-18T18:50:40.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18 18:50:40 URL:https://2.chacra.ceph.com/r/kernel/testing/ab677fe869e84af753f648236d6083528a81a405/centos/9/flavors/default/x86_64/kernel-6.6.0_gab677fe869e8-1.x86_64.rpm [320491466/320491466] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-18T18:50:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:FINISHED --2023-11-18 18:50:40-- 2023-11-18T18:50:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:Total wall clock time: 21s 2023-11-18T18:50:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:Downloaded: 1 files, 306M in 20s (15.2 MB/s) 2023-11-18T18:50:40.920 INFO:teuthology.task.kernel:Installing kernel ab677fe869e84af753f648236d6083528a81a405 on client.1... 2023-11-18T18:50:40.920 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-18T18:50:42.018 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-6.6.0_gab677fe869e8-1 ######################################## 2023-11-18T18:50:42.758 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying... ######################################## 2023-11-18T18:50:42.837 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing... ######################################## 2023-11-18T18:50:42.917 INFO:teuthology.orchestra.run.smithi135.stdout:Updating / installing... 2023-11-18T18:50:50.001 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-6.6.0_gab677fe869e8-1 ######################################## 2023-11-18T18:50:57.321 INFO:teuthology.orchestra.run.smithi045.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-18T18:51:05.793 INFO:teuthology.orchestra.run.smithi135.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-18T18:51:19.205 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-18T18:51:19.205 DEBUG:teuthology.orchestra.run.smithi045:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-18T18:51:19.272 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/System.map-6.6.0-gab677fe869e8 2023-11-18T18:51:19.272 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/config-6.6.0-gab677fe869e8 2023-11-18T18:51:19.272 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/vmlinuz-6.6.0-gab677fe869e8 2023-11-18T18:51:19.272 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8 2023-11-18T18:51:19.272 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-18T18:51:19.273 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-18T18:51:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm.ko 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ansi_cprng.ko 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/anubis.ko 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/arc4.ko 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx 2023-11-18T18:51:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_memcpy.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_pq.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_tx.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_xor.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/raid6test.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authenc.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authencesn.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blake2b_generic.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_common.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_generic.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/camellia_generic.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast5_generic.ko 2023-11-18T18:51:19.276 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast6_generic.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast_common.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ccm.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cmac.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crc32_generic.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_engine.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_user.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cts.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/des_generic.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/dh_generic.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/echainiv.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/essiv.ko 2023-11-18T18:51:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/fcrypt.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/khazad.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4hc.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/md4.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/michael_mic.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcbc.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcrypt.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/rmd160.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/seed.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/serpent_generic.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tcrypt.ko 2023-11-18T18:51:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tea.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_common.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_generic.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/vmac.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/wp512.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xcbc.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xor.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xxhash_generic.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_pad.ko 2023-11-18T18:51:19.279 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/custom_method.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/ec_sys.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/platform_profile.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbs.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbshc.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/video.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/acard-ahci.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ahci_platform.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ata_generic.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/libahci_platform.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_acpi.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ali.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_amd.ko 2023-11-18T18:51:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_artop.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atiixp.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atp867x.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd640.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd64x.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cypress.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_efar.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt366.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt37x.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it8213.ko 2023-11-18T18:51:19.281 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it821x.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_jmicron.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_marvell.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_mpiix.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_netcell.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ninja32.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87410.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87415.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_oldpiix.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_opti.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_optidma.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pcmcia.ko 2023-11-18T18:51:19.282 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_piccolo.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_rdc.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sch.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_serverworks.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sil680.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sis.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sl82c105.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_triflex.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_via.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pdc_adma.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_inic162x.ko 2023-11-18T18:51:19.283 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_mv.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_nv.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_promise.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_qstor.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil24.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sis.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_svw.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sx4.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_uli.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_via.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_vsc.ko 2023-11-18T18:51:19.284 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay/ks0108.ko 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma/bcma.ko 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe/aoe.ko 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/brd.ko 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd 2023-11-18T18:51:19.285 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd/drbd.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/floppy.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/loop.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/nbd.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk/null_blk.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/pktcdvd.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/rbd.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/virtio_blk.ko 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback 2023-11-18T18:51:19.286 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkfront.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram/zram.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hangcheck-timer.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/via-rng.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi 2023-11-18T18:51:19.287 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/lp.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave/mwave.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ppdev.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tlclk.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm.ko 2023-11-18T18:51:19.288 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/uv_mmtimer.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/virtio_console.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-18T18:51:19.289 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp.ko 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-aes.ko 2023-11-18T18:51:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-sha.ko 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca/dca.ko 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-18T18:51:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/amd64_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/e752x_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/edac_mce_amd.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3000_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3200_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5100_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5400_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7300_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7core_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i82975x_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/ie31200_edac.ko 2023-11-18T18:51:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/sb_edac.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/x38_edac.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/edd.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-ich.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-appleir.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-aureal.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-axff.ko 2023-11-18T18:51:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-dr.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elecom.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elo.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-emsff.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gaff.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gt683r.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gyration.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtekff.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-hyperv.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-icade.ko 2023-11-18T18:51:19.294 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-keytouch.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-kye.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lcpower.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-led.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lenovo.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-multitouch.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-ortek.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-penmount.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-petalynx.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-picolcd.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-pl.ko 2023-11-18T18:51:19.295 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-plantronics.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-primax.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-rmi.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-common.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-18T18:51:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-saitek.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-samsung.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sjoy.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sony.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-speedlink.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-steelseries.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sunplus.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tivo.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tmff.ko 2023-11-18T18:51:19.297 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-topseed.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-twinhan.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-uclogic.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-waltop.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-wiimote.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-xinmo.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zpff.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zydacron.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/uhid.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/wacom.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_balloon.ko 2023-11-18T18:51:19.298 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_utils.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_vmbus.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru3.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7414.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7418.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adc128d818.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1025.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1026.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1029.ko 2023-11-18T18:51:19.299 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1031.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm9240.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ads7828.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7410.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7411.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7462.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7470.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7475.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7x10.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/amc6821.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/applesmc.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asb100.ko 2023-11-18T18:51:19.300 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asc7621.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/atxp1.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/coretemp.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dme1737.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds1621.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds620.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc1403.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc6w201.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71805f.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71882fg.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f75375s.ko 2023-11-18T18:51:19.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fam15h_power.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fschmd.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g760a.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g762.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl518sm.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl520sm.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5500_temp.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5k_amb.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmaem.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmpex.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina209.ko 2023-11-18T18:51:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina2xx.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/it87.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k10temp.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k8temp.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lineage-pem.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm63.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm73.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm75.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm77.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm78.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm80.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm83.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm85.ko 2023-11-18T18:51:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm87.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm90.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm92.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm93.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95234.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95241.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95245.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc2945.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4151.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4215.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4222.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4245.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4260.ko 2023-11-18T18:51:19.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4261.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max16065.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1619.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1668.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max197.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6639.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6650.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6697.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/mcp3021.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6683.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775-core.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775.ko 2023-11-18T18:51:19.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct7802.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87360.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87427.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pcf8591.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-18T18:51:19.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/powr1220.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5627.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5636.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht15.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht21.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/shtc1.ko 2023-11-18T18:51:19.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sis5595.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47b397.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m1.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m192.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/thmc50.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp102.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp103.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp401.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp421.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via-cputemp.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via686a.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt1211.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt8231.ko 2023-11-18T18:51:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627ehf.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627hf.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83781d.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83791d.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83792d.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83793.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83795.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l785ts.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l786ng.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-18T18:51:19.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-18T18:51:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-dev.ko 2023-11-18T18:51:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-mux.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-smbus.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-stub.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_core.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-18T18:51:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib 2023-11-18T18:51:19.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-18T18:51:19.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/gameport.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/joydev.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/appletouch.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/bcm5974.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/cyapatp.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/sermouse.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-18T18:51:19.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/altera_ps2.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/arc_ps2.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/serio_raw.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/sparse-keymap.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds 2023-11-18T18:51:19.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-blinkm.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lm3530.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lp3944.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-ss4200.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-18T18:51:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache/bcache.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-bio-prison.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache-smq.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-crypt.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-delay.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-flakey.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-log-userspace.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-multipath.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-queue-length.ko 2023-11-18T18:51:19.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-raid.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-round-robin.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-service-time.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-switch.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-thin-pool.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-verity.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/faulty.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/linear.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/multipath.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid0.ko 2023-11-18T18:51:19.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid1.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid10.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid456.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptbase.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptctl.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptfc.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptlan.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptsas.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptscsih.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptspi.ko 2023-11-18T18:51:19.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_ich.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_sch.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/mfd-core.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/sm501.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/viperboard.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/vx855.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/wl1273-core.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds9802als.ko 2023-11-18T18:51:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds990x.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/bh1770glc.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710/cb710.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/at24.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/max6875.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/enclosure.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/hpilo.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29003.ko 2023-11-18T18:51:19.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29020.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-me.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-txe.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-18T18:51:19.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_7xx1.ko 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_core.ko 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tsl2550.ko 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_balloon.ko 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding/bonding.ko 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53 2023-11-18T18:51:19.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dummy.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/eql.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-18T18:51:19.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-18T18:51:19.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx 2023-11-18T18:51:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade 2023-11-18T18:51:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-18T18:51:19.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink 2023-11-18T18:51:19.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dnet.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ethoc.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/fealnx.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-18T18:51:19.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-18T18:51:19.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/jme.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-18T18:51:19.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-18T18:51:19.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc 2023-11-18T18:51:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis 2023-11-18T18:51:19.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun 2023-11-18T18:51:19.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-18T18:51:19.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/geneve.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ifb.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvlan.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvtap.ko 2023-11-18T18:51:19.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mii.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/net_failover.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/netconsole.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/nlmon.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-18T18:51:19.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/amd.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm87xx.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/broadcom.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/cicada.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/davicom.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/dp83640.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/et1011c.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/icplus.ko 2023-11-18T18:51:19.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/lxt.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/marvell.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/micrel.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/national.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/phylink.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/qsemi.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/realtek.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/smsc.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/ste10Xp.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/vitesse.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-18T18:51:19.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_async.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppoe.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppox.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pptp.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slhc.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slip.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/sungem_phy.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tap.ko 2023-11-18T18:51:19.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_random.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tun.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/veth.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/virtio_net.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-18T18:51:19.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan/vxlan.ko 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netfront.ko 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb/ntb.ko 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme-core.ko 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme.ko 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport.ko 2023-11-18T18:51:19.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_cs.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_pc.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_serial.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/xen-pcifront.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/i82092.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/pd6729.ko 2023-11-18T18:51:19.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acerhdf.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-18T18:51:19.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/hdaps.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel_ips.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-18T18:51:19.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-18T18:51:19.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps_parport.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/pps_core.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp_kvm.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-18T18:51:19.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-em3027.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-max6900.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-18T18:51:19.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-x1205.ko 2023-11-18T18:51:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-9xxx.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-sas.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-xxxx.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/BusLogic.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/a100u2w.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/advansys.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/am53c974.ko 2023-11-18T18:51:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/atp870u.ko 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa/bfa.ko 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ch.ko 2023-11-18T18:51:19.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dc395x.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-18T18:51:19.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dmx3191d.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esp_scsi.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic/fnic.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hpsa.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hptiop.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hv_storvsc.ko 2023-11-18T18:51:19.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/initio.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ipr.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ips.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci/isci.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc/libfc.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas/libsas.ko 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc 2023-11-18T18:51:19.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvumi.ko 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001 2023-11-18T18:51:19.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pmcraid.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla1280.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/raid_class.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_debug.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-18T18:51:19.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ses.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/st.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/stex.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/virtio_scsi.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/wd719x.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb/ssb.ko 2023-11-18T18:51:19.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_file.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_iblock.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_mod.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_pscsi.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_user.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-18T18:51:19.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-18T18:51:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_gsm.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_hdlc.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/nozomi.ko 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250 2023-11-18T18:51:19.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/arc_uart.ko 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio.ko 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_aec.ko 2023-11-18T18:51:19.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_cif.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_pci_generic.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_sercos3.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-acm.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usblp.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usbtmc.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/mdc800.ko 2023-11-18T18:51:19.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/microtek.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/adutux.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/appledisplay.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi26.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi62.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ezusb.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/idmouse.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/iowarrior.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ldusb.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/legousbtower.ko 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga 2023-11-18T18:51:19.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usb3503.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usblcd.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/uss720.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/yurex.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy/phy-generic.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/aircable.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ark3116.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-18T18:51:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ch341.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cp210x.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cyberjack.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/empeg.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_ti.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipaq.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipw.ko 2023-11-18T18:51:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ir-usb.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mct_u232.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7720.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7840.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/navman.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/omninet.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/opticon.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/option.ko 2023-11-18T18:51:19.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/oti6858.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/pl2303.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcaux.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcserial.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/quatech2.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/safe_serial.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/sierra.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ssu100.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/symbolserial.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-18T18:51:19.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_debug.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/visor.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/whiteheat.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/uas.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-18T18:51:19.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-karma.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/usb-storage.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio 2023-11-18T18:51:19.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_net.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_scsi.ko 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight 2023-11-18T18:51:19.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/apple_bl.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/lcd.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_balloon.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_mmio.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_ring.ko 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters 2023-11-18T18:51:19.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2482.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2490.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-18T18:51:19.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/wire.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/hpwdt.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/i6300esb.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ib700wdt.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ibmasr.ko 2023-11-18T18:51:19.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it87_wdt.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/machzwd.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/nv_tco.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/softdog.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/via_wdt.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-18T18:51:19.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/wdt_pci.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/xen_wdt.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-evtchn.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntalloc.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntdev.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-privcmd.ko 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs 2023-11-18T18:51:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p/9p.ko 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs/affs.ko 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs/befs.ko 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/binfmt_misc.ko 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs 2023-11-18T18:51:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs/btrfs.ko 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles/cachefiles.ko 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph/ceph.ko 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda/coda.ko 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs/cramfs.ko 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm/dlm.ko 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs 2023-11-18T18:51:19.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs/f2fs.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/fat.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/msdos.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/vfat.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache/fscache.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/cuse.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/fuse.ko 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2 2023-11-18T18:51:19.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2/gfs2.ko 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs/hfs.ko 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus/hfsplus.ko 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs/isofs.ko 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs/jfs.ko 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd/lockd.ko 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix/minix.ko 2023-11-18T18:51:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs/netfs.ko 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfs.ko 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv3.ko 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv4.ko 2023-11-18T18:51:19.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/grace.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/nfs_acl.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd/nfsd.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2/nilfs2.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-celtic.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-centeuro.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-croatian.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-cyrillic.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-gaelic.ko 2023-11-18T18:51:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-greek.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-iceland.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-inuit.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-roman.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-romanian.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-turkish.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1250.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1251.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1255.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp737.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp775.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp850.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp852.ko 2023-11-18T18:51:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp855.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp857.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp860.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp861.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp862.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp863.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp864.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp865.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp866.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp869.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp874.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp932.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp936.ko 2023-11-18T18:51:19.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp949.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp950.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_euc-jp.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-1.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-13.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-14.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-15.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-2.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-3.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-4.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-5.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-6.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-7.ko 2023-11-18T18:51:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-9.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-r.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-ru.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-u.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_utf8.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs 2023-11-18T18:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs/overlay.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore/ramoops.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs/reiserfs.ko 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs 2023-11-18T18:51:19.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs/romfs.ko 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client/cifs.ko 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_arc4.ko 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_md4.ko 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs/squashfs.ko 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv/sysv.ko 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf/udf.ko 2023-11-18T18:51:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs/ufs.ko 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs/xfs.ko 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu/rcutorture.ko 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/torture.ko 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/asn1_encoder.ko 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc-itu-t.ko 2023-11-18T18:51:19.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc8.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libarc4.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libdes.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/libcrc32c.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lru_cache.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4_compress.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4hc_compress.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math/cordic.ko 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6 2023-11-18T18:51:19.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6/raid6_pq.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_bm.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_fsm.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_kmp.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd/zstd_compress.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm/hwpoison-inject.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/6lowpan.ko 2023-11-18T18:51:19.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_dest.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_fragment.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_hop.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_mobility.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_routing.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_udp.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/garp.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/mrp.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/p8022.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/psnap.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/stp.ko 2023-11-18T18:51:19.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q/8021q.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_fd.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_rdma.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_virtio.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv/batman-adv.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/br_netfilter.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/bridge.ko 2023-11-18T18:51:19.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-18T18:51:19.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtables.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph 2023-11-18T18:51:19.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph/libceph.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/failover.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/pktgen.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_diag.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv4.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv6.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver/dns_resolver.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/dsa_core.ko 2023-11-18T18:51:19.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_brcm.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_dsa.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_none.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_trailer.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ah4.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/esp4.ko 2023-11-18T18:51:19.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/fou.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/gre.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/inet_diag.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_gre.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_tunnel.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_vti.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipcomp.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipip.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-18T18:51:19.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-18T18:51:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_bic.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_dctcp.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_diag.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_highspeed.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_htcp.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_hybla.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_illinois.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_lp.ko 2023-11-18T18:51:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_scalable.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_vegas.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_veno.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_westwood.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_yeah.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tunnel4.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_diag.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_tunnel.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ah6.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/esp6.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/fou6.ko 2023-11-18T18:51:19.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_tunnel.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_vti.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ipcomp6.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-18T18:51:19.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-18T18:51:19.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/sit.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/tunnel6.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key/af_key.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_core.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-18T18:51:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_eth.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip6.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_netlink.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ppp.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc/llc.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154/mac802154.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls/mpls_gso.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set.ko 2023-11-18T18:51:19.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-18T18:51:19.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-18T18:51:19.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conncount.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-18T18:51:19.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_log_syslog.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-18T18:51:19.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_irc.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_sip.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_tables.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_log.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_chain_nat.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_compat.ko 2023-11-18T18:51:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_ct.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fib.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_hash.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_limit.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_log.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_masq.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_nat.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_numgen.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_queue.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_quota.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_redir.ko 2023-11-18T18:51:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject_inet.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_socket.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_tunnel.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_AUDIT.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CT.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_DSCP.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HL.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HMARK.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-18T18:51:19.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LED.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LOG.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NETMAP.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFLOG.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_RATEEST.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_SECMARK.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TEE.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TPROXY.ko 2023-11-18T18:51:19.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TRACE.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_addrtype.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_bpf.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cgroup.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cluster.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_comment.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connbytes.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlabel.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlimit.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connmark.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_conntrack.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cpu.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dccp.ko 2023-11-18T18:51:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_devgroup.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dscp.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ecn.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_esp.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hashlimit.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_helper.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hl.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipcomp.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_iprange.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipvs.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_l2tp.ko 2023-11-18T18:51:19.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_length.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_limit.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mac.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mark.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_multiport.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nat.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nfacct.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_osf.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_owner.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_physdev.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_pkttype.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_policy.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_quota.ko 2023-11-18T18:51:19.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_rateest.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_realm.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_recent.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_sctp.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_set.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_socket.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_state.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_statistic.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_string.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_tcpmss.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_time.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_u32.ko 2023-11-18T18:51:19.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink/netlink_diag.ko 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh/nsh.ko 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/openvswitch.ko 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-geneve.ko 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-gre.ko 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-vxlan.ko 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet/af_packet_diag.ko 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds 2023-11-18T18:51:19.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_rdma.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_tcp.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_csum.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_gact.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_ipt.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_mirred.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_nat.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_pedit.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_police.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_simple.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_skbedit.ko 2023-11-18T18:51:19.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_vlan.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_basic.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_bpf.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_flow.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_fw.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_route.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_u32.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_cmp.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_ipset.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_meta.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_nbyte.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_text.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_u32.ko 2023-11-18T18:51:19.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_choke.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_codel.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_drr.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_fq.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_gred.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hfsc.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hhf.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_htb.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_ingress.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio_lib.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_multiq.ko 2023-11-18T18:51:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_netem.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_pie.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_plug.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_prio.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_qfq.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_red.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfb.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfq.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_tbf.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_teql.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp.ko 2023-11-18T18:51:19.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp_diag.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/sunrpc.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/diag.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/tipc.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix/unix_diag.ko 2023-11-18T18:51:19.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock.ko 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys 2023-11-18T18:51:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys/trusted.ko 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib/irqbypass.ko 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias.bin 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.alias.bin 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.bin 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.modinfo 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep.bin 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.devname 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.order 2023-11-18T18:51:19.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.softdep 2023-11-18T18:51:19.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols 2023-11-18T18:51:19.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols.bin 2023-11-18T18:51:19.430 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gab677fe869e8 2023-11-18T18:51:19.430 DEBUG:teuthology.orchestra.run.smithi045:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-18T18:51:19.453 INFO:teuthology.orchestra.run.smithi045.stdout:postinstall scriptlet (using /bin/sh): 2023-11-18T18:51:19.453 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gab677fe869e8 -a -r /boot/System.map-6.6.0-gab677fe869e8 ]; then 2023-11-18T18:51:19.453 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:19.453 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/System.map-6.6.0-gab677fe869e8 /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:19.453 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/System.map-6.6.0-gab677fe869e8 2023-11-18T18:51:19.453 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/installkernel 6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:new-kernel-pkg --remove 6.6.0-gab677fe869e8 --rminitrd --initrdfile=/boot/initramfs-6.6.0-gab677fe869e8.img 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-install remove 6.6.0-gab677fe869e8 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/update-bootloader --remove 6.6.0-gab677fe869e8 2023-11-18T18:51:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-11-18T18:51:19.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2023-11-18T18:51:19.543 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2023-11-18T18:51:19.543 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2023-11-18T18:51:19.543 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.06 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 68.el9 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Group : Unspecified 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 8264254 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : builder@centos.org 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2023-11-18T18:51:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T18:51:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2023-11-18T18:51:19.546 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-18T18:51:19.546 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 6.6.0-gab677fe869e8 2023-11-18T18:51:19.546 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-18T18:51:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-11-18T18:51:21.576 INFO:teuthology.orchestra.run.smithi045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-18T18:51:21.612 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-11-18T18:51:21.615 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-11-18T18:51:21.671 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.v8GUCorwvV 2023-11-18T18:51:21.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.v8GUCorwvV 2023-11-18T18:51:21.746 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.v8GUCorwvV 2023-11-18T18:51:21.896 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.v8GUCorwvV is 6KB 2023-11-18T18:51:21.918 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.v8GUCorwvV 2023-11-18T18:51:21.935 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2023-11-18T18:51:22.008 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-18T18:51:22.008 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-18T18:51:22.008 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-18T18:51:22.008 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8.conf 2023-11-18T18:51:22.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8 2023-11-18T18:51:22.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2023-11-18T18:51:27.140 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-18T18:51:27.140 DEBUG:teuthology.orchestra.run.smithi135:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-18T18:51:27.214 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/System.map-6.6.0-gab677fe869e8 2023-11-18T18:51:27.214 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/config-6.6.0-gab677fe869e8 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/vmlinuz-6.6.0-gab677fe869e8 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-18T18:51:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-18T18:51:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/arch/x86/kvm/kvm.ko 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ansi_cprng.ko 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/anubis.ko 2023-11-18T18:51:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/arc4.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_memcpy.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_pq.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_tx.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/async_xor.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/async_tx/raid6test.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authenc.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/authencesn.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blake2b_generic.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_common.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/blowfish_generic.ko 2023-11-18T18:51:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/camellia_generic.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast5_generic.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast6_generic.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cast_common.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/ccm.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cmac.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crc32_generic.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_engine.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/crypto_user.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/cts.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/des_generic.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/dh_generic.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/echainiv.ko 2023-11-18T18:51:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/essiv.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/fcrypt.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/khazad.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/lz4hc.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/md4.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/michael_mic.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcbc.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/pcrypt.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/rmd160.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/seed.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/serpent_generic.ko 2023-11-18T18:51:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tcrypt.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/tea.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_common.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/twofish_generic.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/vmac.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/wp512.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xcbc.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xor.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/crypto/xxhash_generic.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/acpi_pad.ko 2023-11-18T18:51:27.221 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/custom_method.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/ec_sys.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/platform_profile.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbs.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/sbshc.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/acpi/video.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/acard-ahci.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ahci_platform.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/ata_generic.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/libahci_platform.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_acpi.ko 2023-11-18T18:51:27.222 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ali.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_amd.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_artop.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atiixp.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_atp867x.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd640.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cmd64x.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_cypress.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_efar.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt366.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt37x.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-18T18:51:27.223 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it8213.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_it821x.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_jmicron.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_marvell.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_mpiix.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_netcell.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ninja32.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87410.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_ns87415.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_oldpiix.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_opti.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_optidma.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pcmcia.ko 2023-11-18T18:51:27.224 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_piccolo.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_rdc.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sch.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_serverworks.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sil680.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sis.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_sl82c105.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_triflex.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pata_via.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/pdc_adma.ko 2023-11-18T18:51:27.225 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_inic162x.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_mv.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_nv.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_promise.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_qstor.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sil24.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sis.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_svw.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_sx4.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_uli.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_via.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ata/sata_vsc.ko 2023-11-18T18:51:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/auxdisplay/ks0108.ko 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/bcma/bcma.ko 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/aoe/aoe.ko 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/brd.ko 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd 2023-11-18T18:51:27.227 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/drbd/drbd.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/floppy.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/loop.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/nbd.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/null_blk/null_blk.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/pktcdvd.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/rbd.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/virtio_blk.ko 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback 2023-11-18T18:51:27.228 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/xen-blkfront.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/block/zram/zram.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hangcheck-timer.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/via-rng.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi 2023-11-18T18:51:27.229 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/lp.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/mwave/mwave.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/ppdev.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tlclk.ko 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm 2023-11-18T18:51:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/uv_mmtimer.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/char/virtio_console.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-18T18:51:27.231 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/ccp/ccp.ko 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-aes.ko 2023-11-18T18:51:27.232 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/padlock-sha.ko 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dca/dca.ko 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac 2023-11-18T18:51:27.233 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/amd64_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/e752x_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/edac_mce_amd.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3000_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i3200_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5100_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i5400_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7300_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i7core_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/i82975x_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/ie31200_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/sb_edac.ko 2023-11-18T18:51:27.234 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/edac/x38_edac.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/edd.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-ich.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-appleir.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-aureal.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-axff.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-dr.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elecom.ko 2023-11-18T18:51:27.235 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-elo.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-emsff.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gaff.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gt683r.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-gyration.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-holtekff.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-hyperv.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-icade.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-keytouch.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-kye.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lcpower.ko 2023-11-18T18:51:27.236 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-led.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-lenovo.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-multitouch.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-ortek.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-penmount.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-petalynx.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-picolcd.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-pl.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-plantronics.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-primax.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-rmi.ko 2023-11-18T18:51:27.237 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-common.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-roccat.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-saitek.ko 2023-11-18T18:51:27.238 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-samsung.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sjoy.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sony.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-speedlink.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-steelseries.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-sunplus.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tivo.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-tmff.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-topseed.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-twinhan.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-uclogic.ko 2023-11-18T18:51:27.239 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-waltop.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-wiimote.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-xinmo.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zpff.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/hid-zydacron.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/uhid.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hid/wacom.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_balloon.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_utils.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hv/hv_vmbus.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru.ko 2023-11-18T18:51:27.240 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/abituguru3.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7414.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ad7418.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adc128d818.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1025.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1026.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1029.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm1031.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adm9240.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ads7828.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7410.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7411.ko 2023-11-18T18:51:27.241 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7462.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7470.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7475.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/adt7x10.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/amc6821.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/applesmc.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asb100.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asc7621.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/atxp1.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/coretemp.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/dme1737.ko 2023-11-18T18:51:27.242 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds1621.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ds620.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc1403.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/emc6w201.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71805f.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f71882fg.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/f75375s.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fam15h_power.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/fschmd.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g760a.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/g762.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl518sm.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/gl520sm.ko 2023-11-18T18:51:27.243 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5500_temp.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/i5k_amb.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmaem.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ibmpex.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina209.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ina2xx.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/it87.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k10temp.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/k8temp.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lineage-pem.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm63.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm73.ko 2023-11-18T18:51:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm75.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm77.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm78.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm80.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm83.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm85.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm87.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm90.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm92.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm93.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95234.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95241.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/lm95245.ko 2023-11-18T18:51:27.245 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc2945.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4151.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4215.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4222.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4245.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4260.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/ltc4261.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max16065.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1619.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max1668.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max197.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6639.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6650.ko 2023-11-18T18:51:27.246 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/max6697.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/mcp3021.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6683.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775-core.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct6775.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/nct7802.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87360.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pc87427.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pcf8591.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-18T18:51:27.247 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/powr1220.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5627.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch5636.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-18T18:51:27.248 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht15.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sht21.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/shtc1.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/sis5595.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47b397.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m1.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/smsc47m192.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/thmc50.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp102.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp103.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp401.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/tmp421.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via-cputemp.ko 2023-11-18T18:51:27.249 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/via686a.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt1211.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/vt8231.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627ehf.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83627hf.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83781d.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83791d.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83792d.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83793.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83795.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l785ts.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/hwmon/w83l786ng.ko 2023-11-18T18:51:27.250 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-18T18:51:27.251 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-18T18:51:27.252 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-dev.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-mux.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-smbus.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/i2c/i2c-stub.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_core.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-18T18:51:27.253 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp 2023-11-18T18:51:27.254 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-18T18:51:27.255 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/gameport/gameport.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/joydev.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/appletouch.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/bcm5974.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/cyapatp.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/sermouse.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-18T18:51:27.256 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/altera_ps2.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/arc_ps2.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/serio/serio_raw.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/input/sparse-keymap.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds 2023-11-18T18:51:27.257 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-blinkm.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lm3530.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-lp3944.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/leds-ss4200.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-18T18:51:27.258 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/bcache/bcache.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-bio-prison.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache-smq.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-cache.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-crypt.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-delay.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-flakey.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-log-userspace.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-multipath.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-queue-length.ko 2023-11-18T18:51:27.259 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-raid.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-round-robin.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-service-time.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-switch.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-thin-pool.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/dm-verity.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/faulty.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/linear.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/multipath.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid0.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid1.ko 2023-11-18T18:51:27.260 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid10.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/md/raid456.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptbase.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptctl.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptfc.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptlan.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptsas.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptscsih.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/message/fusion/mptspi.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_ich.ko 2023-11-18T18:51:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/lpc_sch.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/mfd-core.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/sm501.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/viperboard.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/vx855.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/mfd/wl1273-core.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds9802als.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/apds990x.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/bh1770glc.ko 2023-11-18T18:51:27.262 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/cb710/cb710.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/at24.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/eeprom/max6875.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/enclosure.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/hpilo.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29003.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/isl29020.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-18T18:51:27.263 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-me.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei-txe.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/mei/mei.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_7xx1.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tifm_core.ko 2023-11-18T18:51:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/tsl2550.ko 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_balloon.ko 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/bonding/bonding.ko 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx 2023-11-18T18:51:27.265 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/dummy.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/eql.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-18T18:51:27.266 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-18T18:51:27.267 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-18T18:51:27.268 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-18T18:51:27.269 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec 2023-11-18T18:51:27.270 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/dnet.ko 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex 2023-11-18T18:51:27.271 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ethoc.ko 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/fealnx.ko 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e 2023-11-18T18:51:27.272 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/jme.ko 2023-11-18T18:51:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel 2023-11-18T18:51:27.274 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines 2023-11-18T18:51:27.275 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-18T18:51:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-18T18:51:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-18T18:51:27.278 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom 2023-11-18T18:51:27.279 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/geneve.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ifb.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvlan.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/macvtap.ko 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio 2023-11-18T18:51:27.280 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/mii.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/net_failover.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/netconsole.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/nlmon.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy 2023-11-18T18:51:27.281 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/amd.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/bcm87xx.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/broadcom.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/cicada.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/davicom.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/dp83640.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/et1011c.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/icplus.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/lxt.ko 2023-11-18T18:51:27.282 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/marvell.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/micrel.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/national.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/phylink.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/qsemi.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/realtek.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/smsc.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/ste10Xp.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/phy/vitesse.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_async.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-18T18:51:27.283 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppoe.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pppox.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/ppp/pptp.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slhc.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/slip/slip.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/sungem_phy.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tap.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team.ko 2023-11-18T18:51:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_random.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/tun.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/veth.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/virtio_net.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/vxlan/vxlan.ko 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback 2023-11-18T18:51:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/net/xen-netfront.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ntb/ntb.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme-core.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/nvme/host/nvme.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_cs.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_pc.ko 2023-11-18T18:51:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/parport/parport_serial.ko 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pci/xen-pcifront.ko 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/i82092.ko 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/pd6729.ko 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel 2023-11-18T18:51:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/acerhdf.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-18T18:51:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/hdaps.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/intel_ips.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-18T18:51:27.289 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/platform/x86/wmi.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/clients/pps_parport.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/pps/pps_core.ko 2023-11-18T18:51:27.290 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ptp/ptp_kvm.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-18T18:51:27.291 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-em3027.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-max6900.ko 2023-11-18T18:51:27.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/rtc/rtc-x1205.ko 2023-11-18T18:51:27.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-9xxx.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-sas.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/3w-xxxx.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/BusLogic.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/a100u2w.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/advansys.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-18T18:51:27.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/am53c974.ko 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/atp870u.ko 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bfa/bfa.ko 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i 2023-11-18T18:51:27.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ch.ko 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dc395x.ko 2023-11-18T18:51:27.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/dmx3191d.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/esp_scsi.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-18T18:51:27.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/fnic/fnic.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hpsa.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hptiop.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/hv_storvsc.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/initio.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ipr.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ips.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/isci/isci.ko 2023-11-18T18:51:27.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libfc/libfc.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/libsas/libsas.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid.ko 2023-11-18T18:51:27.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/mvumi.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/pmcraid.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla1280.ko 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx 2023-11-18T18:51:27.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/raid_class.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_debug.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/ses.ko 2023-11-18T18:51:27.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/st.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/stex.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/virtio_scsi.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/scsi/wd719x.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ssb/ssb.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-18T18:51:27.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_file.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_iblock.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_mod.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_pscsi.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/target_core_user.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-18T18:51:27.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-18T18:51:27.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_gsm.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/n_hdlc.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/nozomi.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/arc_uart.ko 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm 2023-11-18T18:51:27.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_aec.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_cif.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_pci_generic.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/uio/uio_sercos3.ko 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb 2023-11-18T18:51:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-acm.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usblp.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/class/usbtmc.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/mdc800.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/image/microtek.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/adutux.ko 2023-11-18T18:51:27.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/appledisplay.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi26.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/emi62.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ezusb.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/idmouse.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/iowarrior.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/ldusb.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/legousbtower.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usb3503.ko 2023-11-18T18:51:27.308 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usblcd.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/uss720.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/misc/yurex.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/phy/phy-generic.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/aircable.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ark3116.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ch341.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cp210x.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cyberjack.ko 2023-11-18T18:51:27.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/empeg.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/io_ti.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipaq.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ipw.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ir-usb.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-18T18:51:27.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mct_u232.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7720.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/mos7840.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/navman.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/omninet.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/opticon.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/option.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/oti6858.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/pl2303.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcaux.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/qcserial.ko 2023-11-18T18:51:27.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/quatech2.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/safe_serial.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/sierra.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ssu100.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/symbolserial.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_debug.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/visor.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/whiteheat.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-18T18:51:27.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/uas.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-karma.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-18T18:51:27.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/storage/usb-storage.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-18T18:51:27.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_net.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/vhost/vhost_scsi.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/apple_bl.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/lcd.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-18T18:51:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_balloon.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_mmio.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/virtio/virtio_ring.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2482.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/masters/ds2490.ko 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves 2023-11-18T18:51:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/w1/wire.ko 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog 2023-11-18T18:51:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/hpwdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/i6300esb.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ib700wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ibmasr.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/it87_wdt.ko 2023-11-18T18:51:27.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/machzwd.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/nv_tco.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/softdog.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/via_wdt.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/wdt_pci.ko 2023-11-18T18:51:27.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/watchdog/xen_wdt.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-evtchn.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntalloc.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-gntdev.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xen-privcmd.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p 2023-11-18T18:51:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/9p/9p.ko 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/affs/affs.ko 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/befs/befs.ko 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/binfmt_misc.ko 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/btrfs/btrfs.ko 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cachefiles/cachefiles.ko 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ceph/ceph.ko 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda 2023-11-18T18:51:27.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/coda/coda.ko 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/cramfs/cramfs.ko 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/dlm/dlm.ko 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/f2fs/f2fs.ko 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/fat.ko 2023-11-18T18:51:27.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/msdos.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fat/vfat.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fscache/fscache.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/cuse.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/fuse/fuse.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/gfs2/gfs2.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfs/hfs.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/hfsplus/hfsplus.ko 2023-11-18T18:51:27.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/isofs/isofs.ko 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/jfs/jfs.ko 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/lockd/lockd.ko 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/minix/minix.ko 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/netfs/netfs.ko 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout 2023-11-18T18:51:27.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfs.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv3.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs/nfsv4.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/grace.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfs_common/nfs_acl.ko 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd 2023-11-18T18:51:27.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nfsd/nfsd.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nilfs2/nilfs2.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-celtic.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-centeuro.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-croatian.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-cyrillic.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-gaelic.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-greek.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-iceland.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-inuit.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-roman.ko 2023-11-18T18:51:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-romanian.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/mac-turkish.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1250.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1251.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp1255.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp737.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp775.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp850.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp852.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp855.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp857.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp860.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp861.ko 2023-11-18T18:51:27.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp862.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp863.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp864.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp865.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp866.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp869.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp874.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp932.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp936.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp949.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_cp950.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_euc-jp.ko 2023-11-18T18:51:27.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-1.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-13.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-14.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-15.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-2.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-3.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-4.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-5.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-6.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-7.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_iso8859-9.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-r.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-ru.ko 2023-11-18T18:51:27.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_koi8-u.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/nls/nls_utf8.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-18T18:51:27.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/overlayfs/overlay.ko 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/pstore/ramoops.ko 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/reiserfs/reiserfs.ko 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/romfs/romfs.ko 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/client/cifs.ko 2023-11-18T18:51:27.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_arc4.ko 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/smb/common/cifs_md4.ko 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/squashfs/squashfs.ko 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/sysv/sysv.ko 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/udf/udf.ko 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/ufs/ufs.ko 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs 2023-11-18T18:51:27.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/fs/xfs/xfs.ko 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/rcu/rcutorture.ko 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/torture.ko 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/asn1_encoder.ko 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc-itu-t.ko 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crc8.ko 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto 2023-11-18T18:51:27.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libarc4.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/crypto/libdes.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/libcrc32c.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lru_cache.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4_compress.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/lz4/lz4hc_compress.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/math/cordic.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/raid6/raid6_pq.ko 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon 2023-11-18T18:51:27.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_bm.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_fsm.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/ts_kmp.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/lib/zstd/zstd_compress.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/mm/hwpoison-inject.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/6lowpan.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_dest.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_fragment.ko 2023-11-18T18:51:27.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_hop.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_mobility.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_routing.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/6lowpan/nhc_udp.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/garp.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/mrp.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/p8022.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/psnap.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/802/stp.ko 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q 2023-11-18T18:51:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/8021q/8021q.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_fd.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_rdma.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/9p/9pnet_virtio.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/batman-adv/batman-adv.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/br_netfilter.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/bridge.ko 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter 2023-11-18T18:51:27.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-18T18:51:27.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/ebtables.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph 2023-11-18T18:51:27.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ceph/libceph.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/failover.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/core/pktgen.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_diag.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv4.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dccp/dccp_ipv6.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dns_resolver/dns_resolver.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/dsa_core.ko 2023-11-18T18:51:27.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_brcm.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_dsa.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_none.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/dsa/tag_trailer.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ah4.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/esp4.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/fou.ko 2023-11-18T18:51:27.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/gre.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/inet_diag.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_gre.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_tunnel.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ip_vti.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipcomp.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/ipip.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-18T18:51:27.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-18T18:51:27.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_bic.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_dctcp.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_diag.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_highspeed.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_htcp.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_hybla.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_illinois.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_lp.ko 2023-11-18T18:51:27.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_scalable.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_vegas.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_veno.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_westwood.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tcp_yeah.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/tunnel4.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_diag.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/udp_tunnel.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ah6.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/esp6.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/fou6.ko 2023-11-18T18:51:27.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_tunnel.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ip6_vti.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/ipcomp6.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-18T18:51:27.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-18T18:51:27.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/sit.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/tunnel6.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/key/af_key.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_core.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_eth.ko 2023-11-18T18:51:27.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip.ko 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ip6.ko 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_netlink.ko 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/l2tp/l2tp_ppp.ko 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/llc/llc.ko 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mac802154/mac802154.ko 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/mpls/mpls_gso.ko 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset 2023-11-18T18:51:27.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-18T18:51:27.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-18T18:51:27.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conncount.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-18T18:51:27.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_log_syslog.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat.ko 2023-11-18T18:51:27.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_irc.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_sip.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nf_tables.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_log.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-18T18:51:27.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_chain_nat.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_compat.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_ct.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fib.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_hash.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_limit.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_log.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_masq.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_nat.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_numgen.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_queue.ko 2023-11-18T18:51:27.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_quota.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_redir.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_reject_inet.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_socket.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/nft_tunnel.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_AUDIT.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_CT.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_DSCP.ko 2023-11-18T18:51:27.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HL.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_HMARK.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LED.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_LOG.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NETMAP.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFLOG.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_RATEEST.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_SECMARK.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-18T18:51:27.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TEE.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TPROXY.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_TRACE.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_addrtype.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_bpf.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cgroup.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cluster.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_comment.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connbytes.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlabel.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connlimit.ko 2023-11-18T18:51:27.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_connmark.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_conntrack.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_cpu.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dccp.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_devgroup.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_dscp.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ecn.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_esp.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hashlimit.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_helper.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_hl.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipcomp.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_iprange.ko 2023-11-18T18:51:27.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_ipvs.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_l2tp.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_length.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_limit.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mac.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_mark.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_multiport.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nat.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_nfacct.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_osf.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_owner.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_physdev.ko 2023-11-18T18:51:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_pkttype.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_policy.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_quota.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_rateest.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_realm.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_recent.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_sctp.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_set.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_socket.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_state.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_statistic.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_string.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_tcpmss.ko 2023-11-18T18:51:27.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_time.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netfilter/xt_u32.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/netlink/netlink_diag.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/nsh/nsh.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/openvswitch.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-geneve.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-gre.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/openvswitch/vport-vxlan.ko 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet 2023-11-18T18:51:27.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/packet/af_packet_diag.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_rdma.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/rds/rds_tcp.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_csum.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_gact.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_ipt.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_mirred.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_nat.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_pedit.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_police.ko 2023-11-18T18:51:27.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_simple.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_skbedit.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/act_vlan.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_basic.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_bpf.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_flow.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_fw.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_route.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/cls_u32.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_cmp.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_ipset.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_meta.ko 2023-11-18T18:51:27.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_nbyte.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_text.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/em_u32.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_choke.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_codel.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_drr.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_fq.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_gred.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hfsc.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_hhf.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_htb.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_ingress.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio.ko 2023-11-18T18:51:27.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_mqprio_lib.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_multiq.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_netem.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_pie.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_plug.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_prio.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_qfq.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_red.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfb.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_sfq.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_tbf.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sched/sch_teql.ko 2023-11-18T18:51:27.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sctp/sctp_diag.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/sunrpc.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/diag.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/tipc/tipc.ko 2023-11-18T18:51:27.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/unix/unix_diag.ko 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock.ko 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys 2023-11-18T18:51:27.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/security/keys/trusted-keys/trusted.ko 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/kernel/virt/lib/irqbypass.ko 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.alias.bin 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.alias.bin 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.bin 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.builtin.modinfo 2023-11-18T18:51:27.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep 2023-11-18T18:51:27.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.dep.bin 2023-11-18T18:51:27.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.devname 2023-11-18T18:51:27.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.order 2023-11-18T18:51:27.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.softdep 2023-11-18T18:51:27.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols 2023-11-18T18:51:27.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.6.0-gab677fe869e8/modules.symbols.bin 2023-11-18T18:51:27.370 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gab677fe869e8 2023-11-18T18:51:27.371 DEBUG:teuthology.orchestra.run.smithi135:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:postinstall scriptlet (using /bin/sh): 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gab677fe869e8 -a -r /boot/System.map-6.6.0-gab677fe869e8 ]; then 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/System.map-6.6.0-gab677fe869e8 /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/vmlinuz-6.6.0-gab677fe869e8 /boot/System.map-6.6.0-gab677fe869e8 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/installkernel 6.6.0-gab677fe869e8 /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/.vmlinuz-6.6.0-gab677fe869e8-rpm /boot/.System.map-6.6.0-gab677fe869e8-rpm 2023-11-18T18:51:27.396 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:new-kernel-pkg --remove 6.6.0-gab677fe869e8 --rminitrd --initrdfile=/boot/initramfs-6.6.0-gab677fe869e8.img 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-install remove 6.6.0-gab677fe869e8 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/update-bootloader --remove 6.6.0-gab677fe869e8 2023-11-18T18:51:27.397 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-11-18T18:51:27.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 68.el9 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2023-11-18T18:51:27.489 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8264254 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T18:51:27.490 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-18T18:51:27.491 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-18T18:51:27.491 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-18T18:51:27.491 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2023-11-18T18:51:27.491 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T18:51:27.491 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2023-11-18T18:51:27.492 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-18T18:51:27.492 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 6.6.0-gab677fe869e8 2023-11-18T18:51:27.492 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-18T18:51:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2023-11-18T18:51:29.446 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-18T18:51:29.482 INFO:teuthology.orchestra.run.smithi135.stderr:done 2023-11-18T18:51:29.484 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-11-18T18:51:29.499 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.4a009Xoglx 2023-11-18T18:51:29.499 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4a009Xoglx 2023-11-18T18:51:29.573 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.4a009Xoglx 2023-11-18T18:51:29.710 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.4a009Xoglx is 6KB 2023-11-18T18:51:29.759 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.4a009Xoglx 2023-11-18T18:51:29.773 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2023-11-18T18:51:29.838 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-18T18:51:29.838 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-18T18:51:29.838 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-18T18:51:29.838 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8.conf 2023-11-18T18:51:29.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gab677fe869e8 2023-11-18T18:51:30.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2023-11-18T18:51:52.189 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-18T18:51:52.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-18T18:51:52.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T18:52:00.015 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-18T18:52:00.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-11-18T18:52:00.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T18:52:52.242 DEBUG:teuthology.orchestra.remote:timed out 2023-11-18T18:53:00.022 DEBUG:teuthology.orchestra.remote:timed out 2023-11-18T18:53:01.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-18T18:53:01.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T18:53:01.621 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-11-18T18:53:02.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-18T18:53:02.427 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gab677fe869e8"... 2023-11-18T18:53:02.427 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-11-18T18:53:02.471 INFO:teuthology.orchestra.run.smithi045.stdout:6.6.0-gab677fe869e8 2023-11-18T18:53:02.472 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gab677fe869e8 vs 6.6.0-gab677fe869e8 2023-11-18T18:53:02.472 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T18:53:02.472 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-18T18:53:03.474 DEBUG:teuthology.parallel:result is None 2023-11-18T18:53:09.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-11-18T18:53:09.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T18:53:24.801 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-11-18T18:53:25.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-11-18T18:53:25.413 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gab677fe869e8"... 2023-11-18T18:53:25.413 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-11-18T18:53:25.457 INFO:teuthology.orchestra.run.smithi135.stdout:6.6.0-gab677fe869e8 2023-11-18T18:53:25.458 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gab677fe869e8 vs 6.6.0-gab677fe869e8 2023-11-18T18:53:25.458 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-18T18:53:25.458 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-18T18:53:26.459 DEBUG:teuthology.parallel:result is None 2023-11-18T18:53:26.459 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-18T18:53:26.467 INFO:teuthology.task.internal:Creating test directory... 2023-11-18T18:53:26.467 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T18:53:26.478 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-18T18:53:26.534 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-18T18:53:26.540 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-18T18:53:26.551 INFO:teuthology.task.internal:Creating archive directory... 2023-11-18T18:53:26.551 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T18:53:26.559 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-18T18:53:26.635 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-18T18:53:26.641 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-18T18:53:26.641 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T18:53:26.647 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-18T18:53:26.779 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T18:53:26.817 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T18:53:26.835 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T18:53:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-18T18:53:26.905 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-18T18:53:26.912 INFO:teuthology.task.internal:Configuring sudo... 2023-11-18T18:53:26.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T18:53:26.918 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-18T18:53:27.018 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-18T18:53:27.028 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-18T18:53:27.028 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T18:53:27.034 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-18T18:53:27.087 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T18:53:27.176 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T18:53:27.291 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T18:53:27.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T18:53:27.486 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T18:53:27.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T18:53:27.593 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T18:53:27.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-18T18:53:27.774 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T18:53:27.851 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-18T18:53:27.933 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T18:53:27.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-18T18:53:28.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-11-18T18:53:28.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-11-18T18:53:28.152 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T18:53:28.158 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T18:53:28.614 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-18T18:53:28.622 INFO:teuthology.task.internal:Starting timer... 2023-11-18T18:53:28.622 INFO:teuthology.run_tasks:Running task pcp... 2023-11-18T18:53:28.632 INFO:teuthology.run_tasks:Running task selinux... 2023-11-18T18:53:28.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2023-11-18T18:53:28.776 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2023-11-18T18:53:28.780 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-11-18T18:53:28.886 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2023-11-18T18:53:28.890 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-18T18:53:28.890 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2023-11-18T18:53:28.952 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2023-11-18T18:53:28.952 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-11-18T18:53:29.003 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-11-18T18:53:29.003 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2023-11-18T18:53:29.004 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T18:53:29.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T18:53:29.110 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T18:53:29.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T18:53:29.182 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-18T18:53:29.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2023-11-18T18:53:29.318 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-11-18T18:53:29.398 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-18T18:53:29.409 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-18T18:53:29.414 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-18T18:53:29.535 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-18T18:53:29.549 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-18T18:53:29.550 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-18T19:03:34.931 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2023-11-18T19:03:34.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-18T19:03:34.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T19:03:35.073 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-11-18T19:03:35.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-18T19:03:35.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-11-18T19:03:35.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-18T19:03:35.363 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-11-18T19:03:35.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-11-18T19:03:35.518 INFO:teuthology.run_tasks:Running task clock... 2023-11-18T19:03:35.528 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-18T19:03:35.528 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T19:03:35.529 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T19:03:35.537 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-18T19:03:35.538 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T19:03:35.639 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-18T19:03:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-18T19:03:35.692 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-18T19:03:35.703 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-18T19:03:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-11-18T19:03:35.799 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2023-11-18T19:03:35.822 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-11-18T19:03:35.841 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2023-11-18T19:03:35.875 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-18T19:03:35.891 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-18T19:03:35.927 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-18T19:03:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-18T19:03:36.046 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2023-11-18T19:03:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T19:03:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-11-18T19:03:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.056 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.086 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2023-11-18T19:03:36.096 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T19:03:36.096 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-11-18T19:03:36.096 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.096 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.096 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.096 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:03:36.097 INFO:teuthology.run_tasks:Running task install... 2023-11-18T19:03:36.106 DEBUG:teuthology.task.install:project ceph 2023-11-18T19:03:36.106 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}} 2023-11-18T19:03:36.107 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'} 2023-11-18T19:03:36.107 INFO:teuthology.task.install:Using flavor: default 2023-11-18T19:03:36.112 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-18T19:03:36.112 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-18T19:03:36.113 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-18T19:03:36.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:03:36.114 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'tag': None, 'wait_for_package': False} 2023-11-18T19:03:36.115 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:03:36.262 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-18T19:03:36.262 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-18T19:03:36.275 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/ 2023-11-18T19:03:36.275 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7418.gb0f45a51 2023-11-18T19:03:36.385 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-18T19:03:36.386 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:03:36.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-18T19:03:36.478 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-18T19:03:36.478 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:03:36.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-18T19:03:36.490 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-18T19:03:36.490 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-18T19:03:36.591 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-18T19:03:36.592 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-18T19:03:36.634 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-18T19:03:36.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-18T19:03:36.768 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-18T19:03:36.857 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-11-18T19:03:36.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-11-18T19:03:36.892 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-18T19:03:36.986 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2023-11-18T19:03:36.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2023-11-18T19:03:37.225 INFO:teuthology.orchestra.run.smithi135.stdout:72 files removed 2023-11-18T19:03:37.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-18T19:03:37.371 INFO:teuthology.orchestra.run.smithi045.stdout:72 files removed 2023-11-18T19:03:37.414 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-18T19:03:38.467 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 113 kB/s | 78 kB 00:00 2023-11-18T19:03:38.471 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 147 kB/s | 78 kB 00:00 2023-11-18T19:03:38.934 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-11-18T19:03:39.114 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 17 kB/s | 9.5 kB 00:00 2023-11-18T19:03:39.552 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2023-11-18T19:03:39.698 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2023-11-18T19:03:40.460 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - AppStream 9.3 MB/s | 6.4 MB 00:00 2023-11-18T19:03:40.481 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - AppStream 7.5 MB/s | 6.4 MB 00:00 2023-11-18T19:03:42.223 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2023-11-18T19:03:42.311 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2023-11-18T19:03:43.210 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-11-18T19:03:45.778 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 14 MB/s | 18 MB 00:01 2023-11-18T19:03:46.281 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-11-18T19:03:49.696 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 18 MB 00:02 2023-11-18T19:03:54.036 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 5.8 MB 00:04 2023-11-18T19:03:55.604 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 15 kB 00:00 2023-11-18T19:03:55.941 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 5.8 MB 00:02 2023-11-18T19:03:57.509 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 15 kB 00:00 2023-11-18T19:03:58.027 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 20 MB 00:02 2023-11-18T19:03:59.283 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-11-18T19:04:03.580 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-11-18T19:04:05.099 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-11-18T19:04:06.523 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T19:04:06.525 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T19:04:06.547 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-18T19:04:06.548 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-18T19:04:06.550 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-18T19:04:06.551 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-18T19:04:06.554 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-18T19:04:06.557 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-18T19:04:06.559 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-18T19:04:06.636 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-11-18T19:04:06.661 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2023-11-18T19:04:06.661 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-11-18T19:04:06.661 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2023-11-18T19:04:06.661 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-11-18T19:04:06.661 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-18T19:04:06.661 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-18T19:04:06.662 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 217 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 18 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-18T19:04:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-18T19:04:06.664 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-18T19:04:06.665 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-18T19:04:06.666 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-18T19:04:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-18T19:04:06.668 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-18T19:04:06.669 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-18T19:04:06.670 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-18T19:04:06.671 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-18T19:04:06.672 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:04:06.673 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-11-18T19:04:06.673 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2023-11-18T19:04:06.673 INFO:teuthology.orchestra.run.smithi135.stdout:Install 132 Packages 2023-11-18T19:04:06.673 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 13 Packages 2023-11-18T19:04:06.673 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:04:06.673 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 200 M 2023-11-18T19:04:06.673 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-11-18T19:04:07.732 INFO:teuthology.orchestra.run.smithi135.stdout:(1/145): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 18 kB/s | 6.5 kB 00:00 2023-11-18T19:04:08.172 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T19:04:08.174 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-18T19:04:08.195 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-18T19:04:08.196 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-18T19:04:08.197 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-18T19:04:08.199 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-18T19:04:08.201 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-18T19:04:08.204 INFO:teuthology.orchestra.run.smithi135.stdout:(2/145): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 6.3 MB/s | 5.2 MB 00:00 2023-11-18T19:04:08.205 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-18T19:04:08.206 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-18T19:04:08.276 INFO:teuthology.orchestra.run.smithi135.stdout:(3/145): ceph-immutable-object-cache-18.0.0-741 1.9 MB/s | 141 kB 00:00 2023-11-18T19:04:08.293 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-11-18T19:04:08.312 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================================ 2023-11-18T19:04:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-11-18T19:04:08.313 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================================ 2023-11-18T19:04:08.313 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2023-11-18T19:04:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-18T19:04:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 6.5 k 2023-11-18T19:04:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 5.2 M 2023-11-18T19:04:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 860 k 2023-11-18T19:04:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 141 k 2023-11-18T19:04:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 1.5 M 2023-11-18T19:04:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 133 k 2023-11-18T19:04:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 1.8 M 2023-11-18T19:04:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 7.4 M 2023-11-18T19:04:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 50 k 2023-11-18T19:04:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 8.6 M 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 41 M 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 262 k 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 774 k 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 217 k 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 18 k 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-18T19:04:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 31 k 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 718 k 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 127 k 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-18T19:04:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-18T19:04:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 162 k 2023-11-18T19:04:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 321 k 2023-11-18T19:04:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 299 k 2023-11-18T19:04:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 99 k 2023-11-18T19:04:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 85 k 2023-11-18T19:04:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T19:04:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 170 k 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-18T19:04:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.3 M 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 3.0 M 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-18T19:04:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-18T19:04:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 19 M 2023-11-18T19:04:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 23 k 2023-11-18T19:04:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 2.1 M 2023-11-18T19:04:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 243 k 2023-11-18T19:04:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.4 M 2023-11-18T19:04:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 18 M 2023-11-18T19:04:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7418.gb0f45a51.el9 ceph-noarch 15 k 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 24 k 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-18T19:04:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 163 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 475 k 2023-11-18T19:04:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-18T19:04:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 4.8 M 2023-11-18T19:04:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-18T19:04:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-18T19:04:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-18T19:04:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-18T19:04:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-18T19:04:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 45 k 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:18.0.0-7418.gb0f45a51.el9 ceph 129 k 2023-11-18T19:04:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-18T19:04:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-18T19:04:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-18T19:04:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-18T19:04:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-18T19:04:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-18T19:04:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-18T19:04:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-18T19:04:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-18T19:04:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-18T19:04:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-18T19:04:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================================ 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout:Install 132 Packages 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 13 Packages 2023-11-18T19:04:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:04:08.332 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 200 M 2023-11-18T19:04:08.332 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-11-18T19:04:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:(4/145): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.1 MB/s | 860 kB 00:00 2023-11-18T19:04:08.668 INFO:teuthology.orchestra.run.smithi135.stdout:(5/145): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 5.3 MB/s | 2.1 MB 00:00 2023-11-18T19:04:09.210 INFO:teuthology.orchestra.run.smithi135.stdout:(6/145): ceph-common-18.0.0-7418.gb0f45a51.el9. 10 MB/s | 19 MB 00:01 2023-11-18T19:04:09.226 INFO:teuthology.orchestra.run.smithi045.stdout:(1/145): ceph-18.0.0-7418.gb0f45a51.el9.x86_64. 18 kB/s | 6.5 kB 00:00 2023-11-18T19:04:09.327 INFO:teuthology.orchestra.run.smithi135.stdout:(7/145): ceph-mon-18.0.0-7418.gb0f45a51.el9.x86 6.7 MB/s | 4.4 MB 00:00 2023-11-18T19:04:09.386 INFO:teuthology.orchestra.run.smithi135.stdout:(8/145): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 1.6 MB/s | 1.5 MB 00:00 2023-11-18T19:04:09.511 INFO:teuthology.orchestra.run.smithi135.stdout:(9/145): ceph-selinux-18.0.0-7418.gb0f45a51.el9 194 kB/s | 24 kB 00:00 2023-11-18T19:04:09.818 INFO:teuthology.orchestra.run.smithi045.stdout:(2/145): ceph-base-18.0.0-7418.gb0f45a51.el9.x8 5.4 MB/s | 5.2 MB 00:00 2023-11-18T19:04:09.901 INFO:teuthology.orchestra.run.smithi045.stdout:(3/145): ceph-immutable-object-cache-18.0.0-741 1.7 MB/s | 141 kB 00:00 2023-11-18T19:04:10.268 INFO:teuthology.orchestra.run.smithi045.stdout:(4/145): ceph-mds-18.0.0-7418.gb0f45a51.el9.x86 5.7 MB/s | 2.1 MB 00:00 2023-11-18T19:04:10.310 INFO:teuthology.orchestra.run.smithi045.stdout:(5/145): ceph-fuse-18.0.0-7418.gb0f45a51.el9.x8 794 kB/s | 860 kB 00:01 2023-11-18T19:04:10.362 INFO:teuthology.orchestra.run.smithi135.stdout:(10/145): ceph-radosgw-18.0.0-7418.gb0f45a51.el 8.4 MB/s | 8.6 MB 00:01 2023-11-18T19:04:10.418 INFO:teuthology.orchestra.run.smithi045.stdout:(6/145): ceph-mgr-18.0.0-7418.gb0f45a51.el9.x86 9.8 MB/s | 1.5 MB 00:00 2023-11-18T19:04:10.485 INFO:teuthology.orchestra.run.smithi135.stdout:(11/145): cephfs-mirror-18.0.0-7418.gb0f45a51.e 1.7 MB/s | 217 kB 00:00 2023-11-18T19:04:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:(12/145): libcephfs-devel-18.0.0-7418.gb0f45a51 370 kB/s | 31 kB 00:00 2023-11-18T19:04:10.745 INFO:teuthology.orchestra.run.smithi135.stdout:(13/145): libcephfs2-18.0.0-7418.gb0f45a51.el9. 4.0 MB/s | 718 kB 00:00 2023-11-18T19:04:10.821 INFO:teuthology.orchestra.run.smithi135.stdout:(14/145): libcephsqlite-18.0.0-7418.gb0f45a51.e 2.2 MB/s | 163 kB 00:00 2023-11-18T19:04:10.896 INFO:teuthology.orchestra.run.smithi135.stdout:(15/145): librados-devel-18.0.0-7418.gb0f45a51. 1.7 MB/s | 127 kB 00:00 2023-11-18T19:04:10.996 INFO:teuthology.orchestra.run.smithi135.stdout:(16/145): libradosstriper1-18.0.0-7418.gb0f45a5 4.7 MB/s | 475 kB 00:00 2023-11-18T19:04:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:(17/145): librgw2-18.0.0-7418.gb0f45a51.el9.x86 7.7 MB/s | 4.8 MB 00:00 2023-11-18T19:04:11.722 INFO:teuthology.orchestra.run.smithi135.stdout:(18/145): python3-ceph-argparse-18.0.0-7418.gb0 456 kB/s | 45 kB 00:00 2023-11-18T19:04:11.989 INFO:teuthology.orchestra.run.smithi135.stdout:(19/145): ceph-osd-18.0.0-7418.gb0f45a51.el9.x8 6.4 MB/s | 18 MB 00:02 2023-11-18T19:04:12.022 INFO:teuthology.orchestra.run.smithi135.stdout:(20/145): python3-ceph-common-18.0.0-7418.gb0f4 431 kB/s | 129 kB 00:00 2023-11-18T19:04:12.064 INFO:teuthology.orchestra.run.smithi135.stdout:(21/145): python3-cephfs-18.0.0-7418.gb0f45a51. 2.1 MB/s | 162 kB 00:00 2023-11-18T19:04:12.106 INFO:teuthology.orchestra.run.smithi135.stdout:(22/145): python3-rados-18.0.0-7418.gb0f45a51.e 3.8 MB/s | 321 kB 00:00 2023-11-18T19:04:12.156 INFO:teuthology.orchestra.run.smithi135.stdout:(23/145): python3-rbd-18.0.0-7418.gb0f45a51.el9 3.2 MB/s | 299 kB 00:00 2023-11-18T19:04:12.199 INFO:teuthology.orchestra.run.smithi135.stdout:(24/145): python3-rgw-18.0.0-7418.gb0f45a51.el9 1.1 MB/s | 99 kB 00:00 2023-11-18T19:04:12.241 INFO:teuthology.orchestra.run.smithi135.stdout:(25/145): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 1.0 MB/s | 85 kB 00:00 2023-11-18T19:04:12.341 INFO:teuthology.orchestra.run.smithi135.stdout:(26/145): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 1.7 MB/s | 170 kB 00:00 2023-11-18T19:04:12.441 INFO:teuthology.orchestra.run.smithi135.stdout:(27/145): ceph-grafana-dashboards-18.0.0-7418.g 235 kB/s | 23 kB 00:00 2023-11-18T19:04:12.525 INFO:teuthology.orchestra.run.smithi135.stdout:(28/145): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 1.6 MB/s | 133 kB 00:00 2023-11-18T19:04:12.677 INFO:teuthology.orchestra.run.smithi045.stdout:(7/145): ceph-osd-18.0.0-7418.gb0f45a51.el9.x86 7.8 MB/s | 18 MB 00:02 2023-11-18T19:04:12.748 INFO:teuthology.orchestra.run.smithi135.stdout:(29/145): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 5.5 MB/s | 3.0 MB 00:00 2023-11-18T19:04:12.892 INFO:teuthology.orchestra.run.smithi135.stdout:(30/145): ceph-mgr-dashboard-18.0.0-7418.gb0f45 4.8 MB/s | 1.8 MB 00:00 2023-11-18T19:04:12.992 INFO:teuthology.orchestra.run.smithi135.stdout:(31/145): ceph-mgr-modules-core-18.0.0-7418.gb0 2.4 MB/s | 243 kB 00:00 2023-11-18T19:04:13.084 INFO:teuthology.orchestra.run.smithi135.stdout:(32/145): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 553 kB/s | 50 kB 00:00 2023-11-18T19:04:13.217 INFO:teuthology.orchestra.run.smithi135.stdout:(33/145): ceph-prometheus-alerts-18.0.0-7418.gb 114 kB/s | 15 kB 00:00 2023-11-18T19:04:13.335 INFO:teuthology.orchestra.run.smithi135.stdout:(34/145): ceph-volume-18.0.0-7418.gb0f45a51.el9 2.2 MB/s | 262 kB 00:00 2023-11-18T19:04:13.577 INFO:teuthology.orchestra.run.smithi135.stdout:(35/145): cephadm-18.0.0-7418.gb0f45a51.el9.noa 3.1 MB/s | 774 kB 00:00 2023-11-18T19:04:13.669 INFO:teuthology.orchestra.run.smithi135.stdout:(36/145): cephfs-top-18.0.0-7418.gb0f45a51.el9. 201 kB/s | 18 kB 00:00 2023-11-18T19:04:13.693 INFO:teuthology.orchestra.run.smithi045.stdout:(8/145): ceph-common-18.0.0-7418.gb0f45a51.el9. 3.9 MB/s | 19 MB 00:04 2023-11-18T19:04:13.769 INFO:teuthology.orchestra.run.smithi045.stdout:(9/145): ceph-selinux-18.0.0-7418.gb0f45a51.el9 325 kB/s | 24 kB 00:00 2023-11-18T19:04:13.844 INFO:teuthology.orchestra.run.smithi135.stdout:(37/145): ceph-mgr-diskprediction-local-18.0.0- 6.8 MB/s | 7.4 MB 00:01 2023-11-18T19:04:13.936 INFO:teuthology.orchestra.run.smithi135.stdout:(38/145): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2023-11-18T19:04:13.952 INFO:teuthology.orchestra.run.smithi045.stdout:(10/145): ceph-radosgw-18.0.0-7418.gb0f45a51.el 6.8 MB/s | 8.6 MB 00:01 2023-11-18T19:04:13.986 INFO:teuthology.orchestra.run.smithi135.stdout:(39/145): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 920 kB 00:00 2023-11-18T19:04:14.011 INFO:teuthology.orchestra.run.smithi045.stdout:(11/145): cephfs-mirror-18.0.0-7418.gb0f45a51.e 3.7 MB/s | 217 kB 00:00 2023-11-18T19:04:14.012 INFO:teuthology.orchestra.run.smithi135.stdout:(40/145): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2023-11-18T19:04:14.054 INFO:teuthology.orchestra.run.smithi135.stdout:(41/145): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2023-11-18T19:04:14.070 INFO:teuthology.orchestra.run.smithi045.stdout:(12/145): libcephfs-devel-18.0.0-7418.gb0f45a51 541 kB/s | 31 kB 00:00 2023-11-18T19:04:14.121 INFO:teuthology.orchestra.run.smithi135.stdout:(42/145): flexiblas-3.0.4-8.el9.x86_64.rpm 479 kB/s | 32 kB 00:00 2023-11-18T19:04:14.179 INFO:teuthology.orchestra.run.smithi045.stdout:(13/145): libcephfs2-18.0.0-7418.gb0f45a51.el9. 6.5 MB/s | 718 kB 00:00 2023-11-18T19:04:14.187 INFO:teuthology.orchestra.run.smithi135.stdout:(43/145): elfutils-libelf-devel-0.190-1.el9.x86 108 kB/s | 21 kB 00:00 2023-11-18T19:04:14.254 INFO:teuthology.orchestra.run.smithi045.stdout:(14/145): libcephsqlite-18.0.0-7418.gb0f45a51.e 2.2 MB/s | 163 kB 00:00 2023-11-18T19:04:14.304 INFO:teuthology.orchestra.run.smithi135.stdout:(44/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2023-11-18T19:04:14.330 INFO:teuthology.orchestra.run.smithi135.stdout:(45/145): flexiblas-openblas-openmp-3.0.4-8.el9 134 kB/s | 17 kB 00:00 2023-11-18T19:04:14.337 INFO:teuthology.orchestra.run.smithi045.stdout:(15/145): librados-devel-18.0.0-7418.gb0f45a51. 1.5 MB/s | 127 kB 00:00 2023-11-18T19:04:14.363 INFO:teuthology.orchestra.run.smithi135.stdout:(46/145): libaio-devel-0.3.111-13.el9.x86_64.rp 315 kB/s | 10 kB 00:00 2023-11-18T19:04:14.397 INFO:teuthology.orchestra.run.smithi135.stdout:(47/145): jq-1.6-16.el9.x86_64.rpm 2.8 MB/s | 186 kB 00:00 2023-11-18T19:04:14.422 INFO:teuthology.orchestra.run.smithi135.stdout:(48/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 159 kB 00:00 2023-11-18T19:04:14.447 INFO:teuthology.orchestra.run.smithi135.stdout:(49/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 916 kB/s | 44 kB 00:00 2023-11-18T19:04:14.463 INFO:teuthology.orchestra.run.smithi045.stdout:(16/145): ceph-mon-18.0.0-7418.gb0f45a51.el9.x8 1.1 MB/s | 4.4 MB 00:04 2023-11-18T19:04:14.498 INFO:teuthology.orchestra.run.smithi135.stdout:(50/145): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2023-11-18T19:04:14.564 INFO:teuthology.orchestra.run.smithi135.stdout:(51/145): libtool-2.4.6-45.el9.x86_64.rpm 5.1 MB/s | 578 kB 00:00 2023-11-18T19:04:14.598 INFO:teuthology.orchestra.run.smithi135.stdout:(52/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 257 kB/s | 24 kB 00:00 2023-11-18T19:04:14.605 INFO:teuthology.orchestra.run.smithi045.stdout:(17/145): libradosstriper1-18.0.0-7418.gb0f45a5 1.7 MB/s | 475 kB 00:00 2023-11-18T19:04:14.624 INFO:teuthology.orchestra.run.smithi135.stdout:(53/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 790 kB/s | 46 kB 00:00 2023-11-18T19:04:14.657 INFO:teuthology.orchestra.run.smithi135.stdout:(54/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-11-18T19:04:14.688 INFO:teuthology.orchestra.run.smithi045.stdout:(18/145): python3-ceph-argparse-18.0.0-7418.gb0 548 kB/s | 45 kB 00:00 2023-11-18T19:04:14.691 INFO:teuthology.orchestra.run.smithi135.stdout:(55/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-11-18T19:04:14.716 INFO:teuthology.orchestra.run.smithi135.stdout:(56/145): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 34 kB 00:00 2023-11-18T19:04:14.739 INFO:teuthology.orchestra.run.smithi045.stdout:(19/145): python3-ceph-common-18.0.0-7418.gb0f4 2.6 MB/s | 129 kB 00:00 2023-11-18T19:04:14.797 INFO:teuthology.orchestra.run.smithi045.stdout:(20/145): python3-cephfs-18.0.0-7418.gb0f45a51. 2.8 MB/s | 162 kB 00:00 2023-11-18T19:04:14.856 INFO:teuthology.orchestra.run.smithi045.stdout:(21/145): python3-rados-18.0.0-7418.gb0f45a51.e 5.5 MB/s | 321 kB 00:00 2023-11-18T19:04:14.867 INFO:teuthology.orchestra.run.smithi135.stdout:(57/145): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-11-18T19:04:14.923 INFO:teuthology.orchestra.run.smithi045.stdout:(22/145): python3-rbd-18.0.0-7418.gb0f45a51.el9 4.5 MB/s | 299 kB 00:00 2023-11-18T19:04:14.967 INFO:teuthology.orchestra.run.smithi135.stdout:(58/145): openssl-devel-3.0.7-24.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-11-18T19:04:14.973 INFO:teuthology.orchestra.run.smithi045.stdout:(23/145): python3-rgw-18.0.0-7418.gb0f45a51.el9 2.0 MB/s | 99 kB 00:00 2023-11-18T19:04:15.051 INFO:teuthology.orchestra.run.smithi135.stdout:(59/145): postgresql-13.11-1.el9.x86_64.rpm 8.9 MB/s | 1.5 MB 00:00 2023-11-18T19:04:15.101 INFO:teuthology.orchestra.run.smithi135.stdout:(60/145): postgresql-contrib-13.11-1.el9.x86_64 6.2 MB/s | 811 kB 00:00 2023-11-18T19:04:15.126 INFO:teuthology.orchestra.run.smithi135.stdout:(61/145): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2023-11-18T19:04:15.137 INFO:teuthology.orchestra.run.smithi045.stdout:(24/145): rbd-fuse-18.0.0-7418.gb0f45a51.el9.x8 525 kB/s | 85 kB 00:00 2023-11-18T19:04:15.268 INFO:teuthology.orchestra.run.smithi135.stdout:(62/145): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-11-18T19:04:15.410 INFO:teuthology.orchestra.run.smithi135.stdout:(63/145): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-11-18T19:04:15.424 INFO:teuthology.orchestra.run.smithi045.stdout:(25/145): rbd-mirror-18.0.0-7418.gb0f45a51.el9. 11 MB/s | 3.0 MB 00:00 2023-11-18T19:04:15.435 INFO:teuthology.orchestra.run.smithi135.stdout:(64/145): python3-jinja2-2.11.3-4.el9.noarch.rp 1.5 MB/s | 228 kB 00:00 2023-11-18T19:04:15.474 INFO:teuthology.orchestra.run.smithi045.stdout:(26/145): rbd-nbd-18.0.0-7418.gb0f45a51.el9.x86 3.4 MB/s | 170 kB 00:00 2023-11-18T19:04:15.485 INFO:teuthology.orchestra.run.smithi135.stdout:(65/145): python3-jsonpatch-1.21-16.el9.noarch. 500 kB/s | 24 kB 00:00 2023-11-18T19:04:15.511 INFO:teuthology.orchestra.run.smithi135.stdout:(66/145): python3-jsonpointer-2.0-4.el9.noarch. 245 kB/s | 18 kB 00:00 2023-11-18T19:04:15.532 INFO:teuthology.orchestra.run.smithi045.stdout:(27/145): ceph-grafana-dashboards-18.0.0-7418.g 407 kB/s | 23 kB 00:00 2023-11-18T19:04:15.544 INFO:teuthology.orchestra.run.smithi135.stdout:(67/145): python3-markupsafe-1.1.1-12.el9.x86_6 987 kB/s | 32 kB 00:00 2023-11-18T19:04:15.570 INFO:teuthology.orchestra.run.smithi135.stdout:(68/145): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-11-18T19:04:15.591 INFO:teuthology.orchestra.run.smithi045.stdout:(28/145): ceph-mgr-cephadm-18.0.0-7418.gb0f45a5 2.3 MB/s | 133 kB 00:00 2023-11-18T19:04:15.703 INFO:teuthology.orchestra.run.smithi135.stdout:(69/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-11-18T19:04:15.737 INFO:teuthology.orchestra.run.smithi135.stdout:(70/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-11-18T19:04:15.762 INFO:teuthology.orchestra.run.smithi135.stdout:(71/145): python3-oauthlib-3.1.1-5.el9.noarch.r 3.0 MB/s | 174 kB 00:00 2023-11-18T19:04:15.775 INFO:teuthology.orchestra.run.smithi045.stdout:(29/145): ceph-mgr-dashboard-18.0.0-7418.gb0f45 9.6 MB/s | 1.8 MB 00:00 2023-11-18T19:04:15.787 INFO:teuthology.orchestra.run.smithi135.stdout:(72/145): python3-prettytable-0.7.2-27.el9.noar 859 kB/s | 41 kB 00:00 2023-11-18T19:04:15.813 INFO:teuthology.orchestra.run.smithi135.stdout:(73/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-18T19:04:15.846 INFO:teuthology.orchestra.run.smithi135.stdout:(74/145): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-11-18T19:04:15.871 INFO:teuthology.orchestra.run.smithi135.stdout:(75/145): python3-pytz-2021.1-5.el9.noarch.rpm 847 kB/s | 47 kB 00:00 2023-11-18T19:04:15.930 INFO:teuthology.orchestra.run.smithi135.stdout:(76/145): python3-requests-oauthlib-1.3.0-12.el 520 kB/s | 43 kB 00:00 2023-11-18T19:04:16.231 INFO:teuthology.orchestra.run.smithi135.stdout:(77/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2023-11-18T19:04:16.256 INFO:teuthology.orchestra.run.smithi135.stdout:(78/145): python3-toml-0.10.2-6.el9.noarch.rpm 124 kB/s | 39 kB 00:00 2023-11-18T19:04:16.289 INFO:teuthology.orchestra.run.smithi135.stdout:(79/145): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-11-18T19:04:16.323 INFO:teuthology.orchestra.run.smithi135.stdout:(80/145): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 300 kB 00:00 2023-11-18T19:04:16.376 INFO:teuthology.orchestra.run.smithi135.stdout:(81/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.0 MB/s | 85 kB 00:00 2023-11-18T19:04:16.407 INFO:teuthology.orchestra.run.smithi135.stdout:(82/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 63 kB 00:00 2023-11-18T19:04:16.408 INFO:teuthology.orchestra.run.smithi045.stdout:(30/145): ceph-mgr-diskprediction-local-18.0.0- 12 MB/s | 7.4 MB 00:00 2023-11-18T19:04:16.432 INFO:teuthology.orchestra.run.smithi135.stdout:(83/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 811 kB/s | 44 kB 00:00 2023-11-18T19:04:16.458 INFO:teuthology.orchestra.run.smithi135.stdout:(84/145): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-18T19:04:16.467 INFO:teuthology.orchestra.run.smithi045.stdout:(31/145): ceph-mgr-modules-core-18.0.0-7418.gb0 4.1 MB/s | 243 kB 00:00 2023-11-18T19:04:16.508 INFO:teuthology.orchestra.run.smithi135.stdout:(85/145): libgfortran-11.4.1-2.3.el9.x86_64.rpm 11 MB/s | 803 kB 00:00 2023-11-18T19:04:16.525 INFO:teuthology.orchestra.run.smithi045.stdout:(32/145): ceph-mgr-rook-18.0.0-7418.gb0f45a51.e 878 kB/s | 50 kB 00:00 2023-11-18T19:04:16.541 INFO:teuthology.orchestra.run.smithi135.stdout:(86/145): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-11-18T19:04:16.575 INFO:teuthology.orchestra.run.smithi135.stdout:(87/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-11-18T19:04:16.609 INFO:teuthology.orchestra.run.smithi045.stdout:(33/145): ceph-prometheus-alerts-18.0.0-7418.gb 183 kB/s | 15 kB 00:00 2023-11-18T19:04:16.625 INFO:teuthology.orchestra.run.smithi135.stdout:(88/145): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-11-18T19:04:16.651 INFO:teuthology.orchestra.run.smithi135.stdout:(89/145): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-11-18T19:04:16.667 INFO:teuthology.orchestra.run.smithi045.stdout:(34/145): ceph-volume-18.0.0-7418.gb0f45a51.el9 4.5 MB/s | 262 kB 00:00 2023-11-18T19:04:16.676 INFO:teuthology.orchestra.run.smithi135.stdout:(90/145): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-18T19:04:16.701 INFO:teuthology.orchestra.run.smithi135.stdout:(91/145): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-11-18T19:04:16.734 INFO:teuthology.orchestra.run.smithi135.stdout:(92/145): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-18T19:04:16.759 INFO:teuthology.orchestra.run.smithi045.stdout:(35/145): cephadm-18.0.0-7418.gb0f45a51.el9.noa 8.3 MB/s | 774 kB 00:00 2023-11-18T19:04:16.810 INFO:teuthology.orchestra.run.smithi045.stdout:(36/145): cephfs-top-18.0.0-7418.gb0f45a51.el9. 371 kB/s | 18 kB 00:00 2023-11-18T19:04:17.002 INFO:teuthology.orchestra.run.smithi045.stdout:(37/145): librgw2-18.0.0-7418.gb0f45a51.el9.x86 1.9 MB/s | 4.8 MB 00:02 2023-11-18T19:04:17.102 INFO:teuthology.orchestra.run.smithi045.stdout:(38/145): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 662 kB 00:00 2023-11-18T19:04:17.136 INFO:teuthology.orchestra.run.smithi045.stdout:(39/145): bison-3.7.4-5.el9.x86_64.rpm 7.0 MB/s | 920 kB 00:00 2023-11-18T19:04:17.170 INFO:teuthology.orchestra.run.smithi045.stdout:(40/145): elfutils-libelf-devel-0.190-1.el9.x86 670 kB/s | 21 kB 00:00 2023-11-18T19:04:17.195 INFO:teuthology.orchestra.run.smithi045.stdout:(41/145): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-11-18T19:04:17.229 INFO:teuthology.orchestra.run.smithi045.stdout:(42/145): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2023-11-18T19:04:17.254 INFO:teuthology.orchestra.run.smithi045.stdout:(43/145): flexiblas-3.0.4-8.el9.x86_64.rpm 573 kB/s | 32 kB 00:00 2023-11-18T19:04:17.379 INFO:teuthology.orchestra.run.smithi045.stdout:(44/145): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2023-11-18T19:04:17.400 INFO:teuthology.orchestra.run.smithi045.stdout:(45/145): flexiblas-openblas-openmp-3.0.4-8.el9 133 kB/s | 17 kB 00:00 2023-11-18T19:04:17.418 INFO:teuthology.orchestra.run.smithi135.stdout:(93/145): ceph-test-18.0.0-7418.gb0f45a51.el9.x 5.2 MB/s | 41 MB 00:07 2023-11-18T19:04:17.442 INFO:teuthology.orchestra.run.smithi045.stdout:(46/145): jq-1.6-16.el9.x86_64.rpm 4.5 MB/s | 186 kB 00:00 2023-11-18T19:04:17.452 INFO:teuthology.orchestra.run.smithi135.stdout:(94/145): gperftools-libs-2.9.1-2.el9.x86_64.rp 431 kB/s | 309 kB 00:00 2023-11-18T19:04:17.467 INFO:teuthology.orchestra.run.smithi045.stdout:(47/145): libaio-devel-0.3.111-13.el9.x86_64.rp 154 kB/s | 10 kB 00:00 2023-11-18T19:04:17.501 INFO:teuthology.orchestra.run.smithi045.stdout:(48/145): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-11-18T19:04:17.535 INFO:teuthology.orchestra.run.smithi045.stdout:(49/145): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2023-11-18T19:04:17.569 INFO:teuthology.orchestra.run.smithi135.stdout:(95/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 522 kB/s | 24 kB 00:00 2023-11-18T19:04:17.585 INFO:teuthology.orchestra.run.smithi045.stdout:(50/145): librdkafka-1.6.1-102.el9.x86_64.rpm 7.9 MB/s | 661 kB 00:00 2023-11-18T19:04:17.611 INFO:teuthology.orchestra.run.smithi135.stdout:(96/145): liboath-2.6.7-2.el9.x86_64.rpm 1.3 MB/s | 49 kB 00:00 2023-11-18T19:04:17.627 INFO:teuthology.orchestra.run.smithi045.stdout:(51/145): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2023-11-18T19:04:17.644 INFO:teuthology.orchestra.run.smithi045.stdout:(52/145): libuuid-devel-2.37.4-15.el9.x86_64.rp 465 kB/s | 24 kB 00:00 2023-11-18T19:04:17.653 INFO:teuthology.orchestra.run.smithi135.stdout:(97/145): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2023-11-18T19:04:17.661 INFO:teuthology.orchestra.run.smithi045.stdout:(53/145): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-18T19:04:17.695 INFO:teuthology.orchestra.run.smithi045.stdout:(54/145): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2023-11-18T19:04:17.753 INFO:teuthology.orchestra.run.smithi045.stdout:(55/145): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2023-11-18T19:04:17.779 INFO:teuthology.orchestra.run.smithi045.stdout:(56/145): openblas-0.3.21-2.el9.x86_64.rpm 423 kB/s | 34 kB 00:00 2023-11-18T19:04:17.867 INFO:teuthology.orchestra.run.smithi135.stdout:(98/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.8 MB/s | 837 kB 00:00 2023-11-18T19:04:17.912 INFO:teuthology.orchestra.run.smithi135.stdout:(99/145): python3-devel-3.9.17-2.el9.x86_64.rpm 203 kB/s | 245 kB 00:01 2023-11-18T19:04:17.937 INFO:teuthology.orchestra.run.smithi045.stdout:(57/145): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-11-18T19:04:18.029 INFO:teuthology.orchestra.run.smithi045.stdout:(58/145): openssl-devel-3.0.7-24.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-11-18T19:04:18.056 INFO:teuthology.orchestra.run.smithi135.stdout:(100/145): python3-asyncssh-2.13.2-3.el9.noarch 2.9 MB/s | 548 kB 00:00 2023-11-18T19:04:18.096 INFO:teuthology.orchestra.run.smithi135.stdout:(101/145): python3-cachetools-4.2.4-1.el9.noarc 830 kB/s | 32 kB 00:00 2023-11-18T19:04:18.121 INFO:teuthology.orchestra.run.smithi045.stdout:(59/145): postgresql-13.11-1.el9.x86_64.rpm 9.0 MB/s | 1.5 MB 00:00 2023-11-18T19:04:18.138 INFO:teuthology.orchestra.run.smithi135.stdout:(102/145): python3-certifi-2021.10.8-2.el9.noar 366 kB/s | 15 kB 00:00 2023-11-18T19:04:18.163 INFO:teuthology.orchestra.run.smithi045.stdout:(60/145): postgresql-contrib-13.11-1.el9.x86_64 6.6 MB/s | 811 kB 00:00 2023-11-18T19:04:18.164 INFO:teuthology.orchestra.run.smithi135.stdout:(103/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 174 kB/s | 43 kB 00:00 2023-11-18T19:04:18.188 INFO:teuthology.orchestra.run.smithi045.stdout:(61/145): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-11-18T19:04:18.197 INFO:teuthology.orchestra.run.smithi135.stdout:(104/145): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-11-18T19:04:18.249 INFO:teuthology.orchestra.run.smithi135.stdout:(105/145): python3-google-auth-2.23.4-1.el9.noa 3.9 MB/s | 197 kB 00:00 2023-11-18T19:04:18.331 INFO:teuthology.orchestra.run.smithi045.stdout:(62/145): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-11-18T19:04:18.356 INFO:teuthology.orchestra.run.smithi135.stdout:(106/145): libarrow-9.0.0-9.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2023-11-18T19:04:18.381 INFO:teuthology.orchestra.run.smithi135.stdout:(107/145): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2023-11-18T19:04:18.406 INFO:teuthology.orchestra.run.smithi135.stdout:(108/145): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2023-11-18T19:04:18.441 INFO:teuthology.orchestra.run.smithi135.stdout:(109/145): python3-cherrypy-18.6.1-2.el9.noarch 1.3 MB/s | 358 kB 00:00 2023-11-18T19:04:18.466 INFO:teuthology.orchestra.run.smithi135.stdout:(110/145): python3-jaraco-collections-3.0.0-8.e 279 kB/s | 23 kB 00:00 2023-11-18T19:04:18.489 INFO:teuthology.orchestra.run.smithi045.stdout:(63/145): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-11-18T19:04:18.491 INFO:teuthology.orchestra.run.smithi135.stdout:(111/145): python3-jaraco-functools-3.5.0-2.el9 234 kB/s | 19 kB 00:00 2023-11-18T19:04:18.514 INFO:teuthology.orchestra.run.smithi045.stdout:(64/145): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-11-18T19:04:18.516 INFO:teuthology.orchestra.run.smithi135.stdout:(112/145): python3-jwt+crypto-2.4.0-1.el9.noarc 185 kB/s | 9.0 kB 00:00 2023-11-18T19:04:18.541 INFO:teuthology.orchestra.run.smithi135.stdout:(113/145): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2023-11-18T19:04:18.557 INFO:teuthology.orchestra.run.smithi045.stdout:(65/145): python3-jsonpatch-1.21-16.el9.noarch. 600 kB/s | 24 kB 00:00 2023-11-18T19:04:18.567 INFO:teuthology.orchestra.run.smithi135.stdout:(114/145): python3-jwt-2.4.0-1.el9.noarch.rpm 548 kB/s | 41 kB 00:00 2023-11-18T19:04:18.582 INFO:teuthology.orchestra.run.smithi045.stdout:(66/145): python3-jsonpointer-2.0-4.el9.noarch. 276 kB/s | 18 kB 00:00 2023-11-18T19:04:18.592 INFO:teuthology.orchestra.run.smithi135.stdout:(115/145): python3-logutils-0.3.5-21.el9.noarch 941 kB/s | 46 kB 00:00 2023-11-18T19:04:18.615 INFO:teuthology.orchestra.run.smithi045.stdout:(67/145): python3-mako-1.1.4-6.el9.noarch.rpm 4.4 MB/s | 144 kB 00:00 2023-11-18T19:04:18.632 INFO:teuthology.orchestra.run.smithi045.stdout:(68/145): python3-markupsafe-1.1.1-12.el9.x86_6 646 kB/s | 32 kB 00:00 2023-11-18T19:04:18.642 INFO:teuthology.orchestra.run.smithi135.stdout:(116/145): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2023-11-18T19:04:18.682 INFO:teuthology.orchestra.run.smithi045.stdout:(69/145): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.4 MB/s | 217 kB 00:00 2023-11-18T19:04:18.684 INFO:teuthology.orchestra.run.smithi135.stdout:(117/145): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2023-11-18T19:04:18.709 INFO:teuthology.orchestra.run.smithi135.stdout:(118/145): python3-more-itertools-8.12.0-2.el9. 557 kB/s | 79 kB 00:00 2023-11-18T19:04:18.734 INFO:teuthology.orchestra.run.smithi135.stdout:(119/145): python3-portend-3.1.0-2.el9.noarch.r 333 kB/s | 16 kB 00:00 2023-11-18T19:04:18.793 INFO:teuthology.orchestra.run.smithi135.stdout:(120/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2023-11-18T19:04:18.808 INFO:teuthology.orchestra.run.smithi045.stdout:(70/145): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-11-18T19:04:18.826 INFO:teuthology.orchestra.run.smithi135.stdout:(121/145): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2023-11-18T19:04:18.850 INFO:teuthology.orchestra.run.smithi045.stdout:(71/145): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-11-18T19:04:18.852 INFO:teuthology.orchestra.run.smithi135.stdout:(122/145): python3-repoze-lru-0.7-16.el9.noarch 265 kB/s | 31 kB 00:00 2023-11-18T19:04:18.885 INFO:teuthology.orchestra.run.smithi135.stdout:(123/145): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-11-18T19:04:18.891 INFO:teuthology.orchestra.run.smithi045.stdout:(72/145): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-11-18T19:04:18.908 INFO:teuthology.orchestra.run.smithi045.stdout:(73/145): python3-prettytable-0.7.2-27.el9.noar 718 kB/s | 41 kB 00:00 2023-11-18T19:04:18.911 INFO:teuthology.orchestra.run.smithi135.stdout:(124/145): python3-tempora-5.0.0-2.el9.noarch.r 620 kB/s | 36 kB 00:00 2023-11-18T19:04:18.934 INFO:teuthology.orchestra.run.smithi045.stdout:(74/145): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2023-11-18T19:04:18.936 INFO:teuthology.orchestra.run.smithi135.stdout:(125/145): python3-rsa-4.9-2.el9.noarch.rpm 547 kB/s | 59 kB 00:00 2023-11-18T19:04:18.951 INFO:teuthology.orchestra.run.smithi045.stdout:(75/145): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 47 kB 00:00 2023-11-18T19:04:18.961 INFO:teuthology.orchestra.run.smithi135.stdout:(126/145): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2023-11-18T19:04:18.968 INFO:teuthology.orchestra.run.smithi045.stdout:(76/145): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-11-18T19:04:19.028 INFO:teuthology.orchestra.run.smithi135.stdout:(127/145): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-11-18T19:04:19.070 INFO:teuthology.orchestra.run.smithi135.stdout:(128/145): python3-zc-lockfile-2.0-10.el9.noarc 491 kB/s | 20 kB 00:00 2023-11-18T19:04:19.085 INFO:teuthology.orchestra.run.smithi045.stdout:(77/145): python3-toml-0.10.2-6.el9.noarch.rpm 381 kB/s | 39 kB 00:00 2023-11-18T19:04:19.095 INFO:teuthology.orchestra.run.smithi135.stdout:(129/145): python3-websocket-client-1.2.3-2.el9 566 kB/s | 90 kB 00:00 2023-11-18T19:04:19.129 INFO:teuthology.orchestra.run.smithi135.stdout:(130/145): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-11-18T19:04:19.162 INFO:teuthology.orchestra.run.smithi135.stdout:(131/145): python3-werkzeug-2.0.3-3.el9.1.noarc 2.1 MB/s | 427 kB 00:00 2023-11-18T19:04:19.302 INFO:teuthology.orchestra.run.smithi045.stdout:(78/145): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2023-11-18T19:04:19.335 INFO:teuthology.orchestra.run.smithi045.stdout:(79/145): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-11-18T19:04:19.352 INFO:teuthology.orchestra.run.smithi045.stdout:(80/145): uuid-1.6.2-55.el9.x86_64.rpm 1.2 MB/s | 56 kB 00:00 2023-11-18T19:04:19.386 INFO:teuthology.orchestra.run.smithi045.stdout:(81/145): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-11-18T19:04:19.403 INFO:teuthology.orchestra.run.smithi045.stdout:(82/145): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-11-18T19:04:19.428 INFO:teuthology.orchestra.run.smithi045.stdout:(83/145): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2023-11-18T19:04:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:(84/145): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-18T19:04:19.496 INFO:teuthology.orchestra.run.smithi045.stdout:(85/145): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-18T19:04:19.496 INFO:teuthology.orchestra.run.smithi135.stdout:(132/145): librbd1-18.0.0-7418.gb0f45a51.el9.x8 9.1 MB/s | 3.0 MB 00:00 2023-11-18T19:04:19.529 INFO:teuthology.orchestra.run.smithi045.stdout:(86/145): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-11-18T19:04:19.530 INFO:teuthology.orchestra.run.smithi135.stdout:(133/145): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-18T19:04:19.563 INFO:teuthology.orchestra.run.smithi045.stdout:(87/145): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-11-18T19:04:19.614 INFO:teuthology.orchestra.run.smithi135.stdout:(134/145): NetworkManager-1.45.6-1.el9.x86_64.r 27 MB/s | 2.2 MB 00:00 2023-11-18T19:04:19.688 INFO:teuthology.orchestra.run.smithi045.stdout:(88/145): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.1 MB 00:00 2023-11-18T19:04:19.697 INFO:teuthology.orchestra.run.smithi135.stdout:(135/145): NetworkManager-libnm-1.45.6-1.el9.x8 21 MB/s | 1.8 MB 00:00 2023-11-18T19:04:19.714 INFO:teuthology.orchestra.run.smithi045.stdout:(89/145): python3-ply-3.11-14.el9.noarch.rpm 739 kB/s | 103 kB 00:00 2023-11-18T19:04:19.739 INFO:teuthology.orchestra.run.smithi045.stdout:(90/145): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-18T19:04:19.765 INFO:teuthology.orchestra.run.smithi045.stdout:(91/145): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-11-18T19:04:19.781 INFO:teuthology.orchestra.run.smithi135.stdout:(136/145): librados2-18.0.0-7418.gb0f45a51.el9. 5.1 MB/s | 3.3 MB 00:00 2023-11-18T19:04:19.798 INFO:teuthology.orchestra.run.smithi045.stdout:(92/145): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-18T19:04:19.806 INFO:teuthology.orchestra.run.smithi135.stdout:(137/145): NetworkManager-team-1.45.6-1.el9.x86 390 kB/s | 42 kB 00:00 2023-11-18T19:04:19.839 INFO:teuthology.orchestra.run.smithi135.stdout:(138/145): NetworkManager-tui-1.45.6-1.el9.x86_ 4.2 MB/s | 245 kB 00:00 2023-11-18T19:04:19.865 INFO:teuthology.orchestra.run.smithi135.stdout:(139/145): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-18T19:04:19.890 INFO:teuthology.orchestra.run.smithi135.stdout:(140/145): elfutils-debuginfod-client-0.190-1.e 739 kB/s | 36 kB 00:00 2023-11-18T19:04:19.907 INFO:teuthology.orchestra.run.smithi045.stdout:(93/145): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.8 MB/s | 309 kB 00:00 2023-11-18T19:04:19.924 INFO:teuthology.orchestra.run.smithi135.stdout:(141/145): elfutils-libelf-0.190-1.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2023-11-18T19:04:19.941 INFO:teuthology.orchestra.run.smithi045.stdout:(94/145): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-11-18T19:04:19.958 INFO:teuthology.orchestra.run.smithi135.stdout:(142/145): elfutils-libs-0.190-1.el9.x86_64.rpm 3.9 MB/s | 255 kB 00:00 2023-11-18T19:04:19.983 INFO:teuthology.orchestra.run.smithi135.stdout:(143/145): libacl-2.3.1-4.el9.x86_64.rpm 394 kB/s | 22 kB 00:00 2023-11-18T19:04:19.999 INFO:teuthology.orchestra.run.smithi045.stdout:(95/145): libarrow-doc-9.0.0-9.el9.noarch.rpm 426 kB/s | 24 kB 00:00 2023-11-18T19:04:20.016 INFO:teuthology.orchestra.run.smithi135.stdout:(144/145): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-18T19:04:20.041 INFO:teuthology.orchestra.run.smithi045.stdout:(96/145): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2023-11-18T19:04:20.092 INFO:teuthology.orchestra.run.smithi045.stdout:(97/145): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-11-18T19:04:20.200 INFO:teuthology.orchestra.run.smithi045.stdout:(98/145): libarrow-9.0.0-9.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2023-11-18T19:04:20.267 INFO:teuthology.orchestra.run.smithi045.stdout:(99/145): python3-asyncssh-2.13.2-3.el9.noarch. 8.1 MB/s | 548 kB 00:00 2023-11-18T19:04:20.318 INFO:teuthology.orchestra.run.smithi045.stdout:(100/145): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.6 MB/s | 837 kB 00:00 2023-11-18T19:04:20.368 INFO:teuthology.orchestra.run.smithi045.stdout:(101/145): python3-bcrypt-3.2.2-1.el9.x86_64.rp 436 kB/s | 43 kB 00:00 2023-11-18T19:04:20.385 INFO:teuthology.orchestra.run.smithi045.stdout:(102/145): python3-cachetools-4.2.4-1.el9.noarc 487 kB/s | 32 kB 00:00 2023-11-18T19:04:20.402 INFO:teuthology.orchestra.run.smithi045.stdout:(103/145): python3-certifi-2021.10.8-2.el9.noar 457 kB/s | 15 kB 00:00 2023-11-18T19:04:20.433 INFO:teuthology.orchestra.run.smithi135.stdout:(145/145): thrift-0.15.0-2.el9.x86_64.rpm 1.2 MB/s | 1.6 MB 00:01 2023-11-18T19:04:20.436 INFO:teuthology.orchestra.run.smithi045.stdout:(104/145): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2023-11-18T19:04:20.447 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-11-18T19:04:20.447 INFO:teuthology.orchestra.run.smithi135.stdout:Total 14 MB/s | 200 MB 00:13 2023-11-18T19:04:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:(105/145): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2023-11-18T19:04:20.502 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-11-18T19:04:20.511 INFO:teuthology.orchestra.run.smithi045.stdout:(106/145): python3-google-auth-2.23.4-1.el9.noa 2.6 MB/s | 197 kB 00:00 2023-11-18T19:04:20.528 INFO:teuthology.orchestra.run.smithi045.stdout:(107/145): python3-jaraco-8.2.1-3.el9.noarch.rp 216 kB/s | 11 kB 00:00 2023-11-18T19:04:20.545 INFO:teuthology.orchestra.run.smithi045.stdout:(108/145): python3-jaraco-classes-3.2.1-5.el9.n 541 kB/s | 18 kB 00:00 2023-11-18T19:04:20.562 INFO:teuthology.orchestra.run.smithi045.stdout:(109/145): python3-jaraco-collections-3.0.0-8.e 707 kB/s | 23 kB 00:00 2023-11-18T19:04:20.579 INFO:teuthology.orchestra.run.smithi045.stdout:(110/145): python3-jaraco-functools-3.5.0-2.el9 593 kB/s | 19 kB 00:00 2023-11-18T19:04:20.596 INFO:teuthology.orchestra.run.smithi045.stdout:(111/145): python3-jaraco-text-3.2.0-6.el9.noar 600 kB/s | 20 kB 00:00 2023-11-18T19:04:20.613 INFO:teuthology.orchestra.run.smithi045.stdout:(112/145): python3-jwt+crypto-2.4.0-1.el9.noarc 276 kB/s | 9.0 kB 00:00 2023-11-18T19:04:20.697 INFO:teuthology.orchestra.run.smithi045.stdout:(113/145): python3-jwt-2.4.0-1.el9.noarch.rpm 410 kB/s | 41 kB 00:00 2023-11-18T19:04:20.747 INFO:teuthology.orchestra.run.smithi045.stdout:(114/145): python3-logutils-0.3.5-21.el9.noarch 948 kB/s | 46 kB 00:00 2023-11-18T19:04:20.758 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-11-18T19:04:20.759 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-11-18T19:04:20.781 INFO:teuthology.orchestra.run.smithi045.stdout:(115/145): python3-more-itertools-8.12.0-2.el9. 2.4 MB/s | 79 kB 00:00 2023-11-18T19:04:20.831 INFO:teuthology.orchestra.run.smithi045.stdout:(116/145): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2023-11-18T19:04:20.857 INFO:teuthology.orchestra.run.smithi045.stdout:(117/145): python3-natsort-7.1.1-5.el9.noarch.r 773 kB/s | 58 kB 00:00 2023-11-18T19:04:20.890 INFO:teuthology.orchestra.run.smithi045.stdout:(118/145): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2023-11-18T19:04:20.916 INFO:teuthology.orchestra.run.smithi045.stdout:(119/145): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2023-11-18T19:04:21.375 INFO:teuthology.orchestra.run.smithi045.stdout:(120/145): ceph-test-18.0.0-7418.gb0f45a51.el9. 5.4 MB/s | 41 MB 00:07 2023-11-18T19:04:21.400 INFO:teuthology.orchestra.run.smithi045.stdout:(121/145): python3-pyOpenSSL-21.0.0-1.el9.noarc 177 kB/s | 90 kB 00:00 2023-11-18T19:04:21.425 INFO:teuthology.orchestra.run.smithi045.stdout:(122/145): python3-repoze-lru-0.7-16.el9.noarch 60 kB/s | 31 kB 00:00 2023-11-18T19:04:21.469 INFO:teuthology.orchestra.run.smithi045.stdout:(123/145): python3-rsa-4.9-2.el9.noarch.rpm 868 kB/s | 59 kB 00:00 2023-11-18T19:04:21.509 INFO:teuthology.orchestra.run.smithi045.stdout:(124/145): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-11-18T19:04:21.534 INFO:teuthology.orchestra.run.smithi045.stdout:(125/145): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2023-11-18T19:04:21.560 INFO:teuthology.orchestra.run.smithi045.stdout:(126/145): python3-typing-extensions-4.4.0-2.el 571 kB/s | 51 kB 00:00 2023-11-18T19:04:21.593 INFO:teuthology.orchestra.run.smithi045.stdout:(127/145): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-11-18T19:04:21.618 INFO:teuthology.orchestra.run.smithi045.stdout:(128/145): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2023-11-18T19:04:21.652 INFO:teuthology.orchestra.run.smithi045.stdout:(129/145): python3-zc-lockfile-2.0-10.el9.noarc 622 kB/s | 20 kB 00:00 2023-11-18T19:04:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:(130/145): re2-20211101-3.el9.x86_64.rpm 2.9 MB/s | 192 kB 00:00 2023-11-18T19:04:21.719 INFO:teuthology.orchestra.run.smithi045.stdout:(131/145): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2023-11-18T19:04:21.795 INFO:teuthology.orchestra.run.smithi045.stdout:(132/145): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-11-18T19:04:21.870 INFO:teuthology.orchestra.run.smithi045.stdout:(133/145): libacl-devel-2.3.1-4.el9.x86_64.rpm 913 kB/s | 68 kB 00:00 2023-11-18T19:04:21.970 INFO:teuthology.orchestra.run.smithi045.stdout:(134/145): NetworkManager-1.45.6-1.el9.x86_64.r 23 MB/s | 2.2 MB 00:00 2023-11-18T19:04:22.046 INFO:teuthology.orchestra.run.smithi045.stdout:(135/145): NetworkManager-libnm-1.45.6-1.el9.x8 24 MB/s | 1.8 MB 00:00 2023-11-18T19:04:22.071 INFO:teuthology.orchestra.run.smithi045.stdout:(136/145): NetworkManager-team-1.45.6-1.el9.x86 1.7 MB/s | 42 kB 00:00 2023-11-18T19:04:22.113 INFO:teuthology.orchestra.run.smithi045.stdout:(137/145): NetworkManager-tui-1.45.6-1.el9.x86_ 5.9 MB/s | 245 kB 00:00 2023-11-18T19:04:22.147 INFO:teuthology.orchestra.run.smithi045.stdout:(138/145): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2023-11-18T19:04:22.172 INFO:teuthology.orchestra.run.smithi045.stdout:(139/145): elfutils-debuginfod-client-0.190-1.e 1.5 MB/s | 36 kB 00:00 2023-11-18T19:04:22.272 INFO:teuthology.orchestra.run.smithi045.stdout:(140/145): librbd1-18.0.0-7418.gb0f45a51.el9.x8 5.5 MB/s | 3.0 MB 00:00 2023-11-18T19:04:22.306 INFO:teuthology.orchestra.run.smithi045.stdout:(141/145): elfutils-libelf-0.190-1.el9.x86_64.r 1.4 MB/s | 192 kB 00:00 2023-11-18T19:04:22.340 INFO:teuthology.orchestra.run.smithi045.stdout:(142/145): elfutils-libs-0.190-1.el9.x86_64.rpm 3.9 MB/s | 255 kB 00:00 2023-11-18T19:04:22.357 INFO:teuthology.orchestra.run.smithi045.stdout:(143/145): libacl-2.3.1-4.el9.x86_64.rpm 462 kB/s | 22 kB 00:00 2023-11-18T19:04:22.390 INFO:teuthology.orchestra.run.smithi045.stdout:(144/145): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2023-11-18T19:04:22.872 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-11-18T19:04:22.933 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-11-18T19:04:23.032 INFO:teuthology.orchestra.run.smithi045.stdout:(145/145): librados2-18.0.0-7418.gb0f45a51.el9. 2.5 MB/s | 3.3 MB 00:01 2023-11-18T19:04:23.042 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-11-18T19:04:23.043 INFO:teuthology.orchestra.run.smithi045.stdout:Total 14 MB/s | 200 MB 00:14 2023-11-18T19:04:23.100 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-11-18T19:04:23.376 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-11-18T19:04:23.376 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-11-18T19:04:25.703 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-11-18T19:04:25.704 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-11-18T19:04:29.008 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-11-18T19:04:29.091 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/158 2023-11-18T19:04:29.163 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/158 2023-11-18T19:04:29.346 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/158 2023-11-18T19:04:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/158 2023-11-18T19:04:29.803 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T19:04:29.955 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T19:04:29.979 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T19:04:30.115 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T19:04:30.187 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T19:04:30.228 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/158 2023-11-18T19:04:30.294 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/158 2023-11-18T19:04:30.364 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/158 2023-11-18T19:04:30.647 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/158 2023-11-18T19:04:30.703 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/158 2023-11-18T19:04:30.719 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T19:04:30.864 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T19:04:30.887 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T19:04:30.970 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T19:04:31.343 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/158 2023-11-18T19:04:31.551 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T19:04:31.638 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T19:04:31.847 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T19:04:31.928 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T19:04:31.977 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-11-18T19:04:32.058 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/158 2023-11-18T19:04:32.096 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/158 2023-11-18T19:04:32.281 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/158 2023-11-18T19:04:32.311 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T19:04:32.351 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/158 2023-11-18T19:04:32.446 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/158 2023-11-18T19:04:32.512 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/158 2023-11-18T19:04:32.546 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/158 2023-11-18T19:04:32.598 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/158 2023-11-18T19:04:32.655 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/158 2023-11-18T19:04:32.712 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/158 2023-11-18T19:04:32.758 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/158 2023-11-18T19:04:32.770 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T19:04:32.807 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/158 2023-11-18T19:04:32.840 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/158 2023-11-18T19:04:32.965 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 5/158 2023-11-18T19:04:32.984 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/158 2023-11-18T19:04:32.996 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T19:04:33.020 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 28/158 2023-11-18T19:04:33.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 29/158 2023-11-18T19:04:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T19:04:33.172 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 30/158 2023-11-18T19:04:33.206 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T19:04:33.246 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/158 2023-11-18T19:04:33.317 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/158 2023-11-18T19:04:33.358 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/158 2023-11-18T19:04:33.423 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/158 2023-11-18T19:04:33.475 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 10/158 2023-11-18T19:04:33.769 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/158 2023-11-18T19:04:33.836 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/158 2023-11-18T19:04:33.869 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T19:04:34.024 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T19:04:34.062 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T19:04:34.124 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/158 2023-11-18T19:04:34.210 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/158 2023-11-18T19:04:34.222 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 14/158 2023-11-18T19:04:34.291 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/158 2023-11-18T19:04:34.348 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 36/158 2023-11-18T19:04:34.395 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 37/158 2023-11-18T19:04:34.440 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/158 2023-11-18T19:04:34.591 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/158 2023-11-18T19:04:34.611 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 39/158 2023-11-18T19:04:34.717 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T19:04:34.799 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 16/158 2023-11-18T19:04:34.884 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 40/158 2023-11-18T19:04:34.978 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/158 2023-11-18T19:04:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T19:04:35.071 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T19:04:35.074 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/158 2023-11-18T19:04:35.115 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/158 2023-11-18T19:04:35.156 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 44/158 2023-11-18T19:04:35.226 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/158 2023-11-18T19:04:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/158 2023-11-18T19:04:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/158 2023-11-18T19:04:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/158 2023-11-18T19:04:35.576 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 17/158 2023-11-18T19:04:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/158 2023-11-18T19:04:35.639 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/158 2023-11-18T19:04:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 50/158 2023-11-18T19:04:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/158 2023-11-18T19:04:35.773 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/158 2023-11-18T19:04:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 52/158 2023-11-18T19:04:35.847 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/158 2023-11-18T19:04:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/158 2023-11-18T19:04:35.881 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/158 2023-11-18T19:04:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/158 2023-11-18T19:04:35.937 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/158 2023-11-18T19:04:35.997 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/158 2023-11-18T19:04:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 55/158 2023-11-18T19:04:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 56/158 2023-11-18T19:04:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/158 2023-11-18T19:04:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/158 2023-11-18T19:04:36.453 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/158 2023-11-18T19:04:36.531 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/158 2023-11-18T19:04:36.588 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/158 2023-11-18T19:04:36.595 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/158 2023-11-18T19:04:36.629 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/158 2023-11-18T19:04:36.771 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/158 2023-11-18T19:04:36.773 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/158 2023-11-18T19:04:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 28/158 2023-11-18T19:04:36.823 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/158 2023-11-18T19:04:36.856 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/158 2023-11-18T19:04:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 29/158 2023-11-18T19:04:36.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/158 2023-11-18T19:04:36.939 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/158 2023-11-18T19:04:36.983 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/158 2023-11-18T19:04:37.001 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 30/158 2023-11-18T19:04:37.027 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 67/158 2023-11-18T19:04:37.095 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/158 2023-11-18T19:04:37.188 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/158 2023-11-18T19:04:37.211 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/158 2023-11-18T19:04:37.259 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/158 2023-11-18T19:04:37.277 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/158 2023-11-18T19:04:37.327 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/158 2023-11-18T19:04:37.456 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/158 2023-11-18T19:04:37.497 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/158 2023-11-18T19:04:37.531 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/158 2023-11-18T19:04:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/158 2023-11-18T19:04:37.660 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/158 2023-11-18T19:04:37.798 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/158 2023-11-18T19:04:37.849 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/158 2023-11-18T19:04:37.994 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/158 2023-11-18T19:04:38.008 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/158 2023-11-18T19:04:38.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/158 2023-11-18T19:04:38.111 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/158 2023-11-18T19:04:38.161 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/158 2023-11-18T19:04:38.264 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 36/158 2023-11-18T19:04:38.316 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 37/158 2023-11-18T19:04:38.360 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/158 2023-11-18T19:04:38.548 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : re2-1:20211101-3.el9.x86_64 39/158 2023-11-18T19:04:38.617 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 40/158 2023-11-18T19:04:38.709 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/158 2023-11-18T19:04:38.815 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/158 2023-11-18T19:04:38.851 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/158 2023-11-18T19:04:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 44/158 2023-11-18T19:04:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/158 2023-11-18T19:04:39.034 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/158 2023-11-18T19:04:39.082 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/158 2023-11-18T19:04:39.093 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/158 2023-11-18T19:04:39.146 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/158 2023-11-18T19:04:39.172 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/158 2023-11-18T19:04:39.196 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/158 2023-11-18T19:04:39.304 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/158 2023-11-18T19:04:39.392 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/158 2023-11-18T19:04:39.427 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/158 2023-11-18T19:04:39.459 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/158 2023-11-18T19:04:39.459 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 50/158 2023-11-18T19:04:39.555 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/158 2023-11-18T19:04:39.608 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/158 2023-11-18T19:04:39.649 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 52/158 2023-11-18T19:04:39.706 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/158 2023-11-18T19:04:39.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/158 2023-11-18T19:04:39.920 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 55/158 2023-11-18T19:04:39.970 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 56/158 2023-11-18T19:04:40.039 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/158 2023-11-18T19:04:40.165 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/158 2023-11-18T19:04:40.390 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/158 2023-11-18T19:04:40.452 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/158 2023-11-18T19:04:40.517 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/158 2023-11-18T19:04:40.522 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/158 2023-11-18T19:04:40.703 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/158 2023-11-18T19:04:40.751 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/158 2023-11-18T19:04:40.775 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/158 2023-11-18T19:04:40.858 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/158 2023-11-18T19:04:40.909 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/158 2023-11-18T19:04:40.946 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/158 2023-11-18T19:04:40.999 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 67/158 2023-11-18T19:04:41.060 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/158 2023-11-18T19:04:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/158 2023-11-18T19:04:41.268 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/158 2023-11-18T19:04:41.316 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/158 2023-11-18T19:04:41.463 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/158 2023-11-18T19:04:41.500 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/158 2023-11-18T19:04:41.536 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/158 2023-11-18T19:04:41.636 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/158 2023-11-18T19:04:41.683 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/158 2023-11-18T19:04:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/158 2023-11-18T19:04:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/158 2023-11-18T19:04:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/158 2023-11-18T19:04:42.087 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/158 2023-11-18T19:04:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/158 2023-11-18T19:04:42.188 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/158 2023-11-18T19:04:42.226 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/158 2023-11-18T19:04:42.257 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-16.el9.x86_64 93/158 2023-11-18T19:04:42.291 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/158 2023-11-18T19:04:42.324 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 95/158 2023-11-18T19:04:42.687 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/158 2023-11-18T19:04:42.720 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T19:04:42.842 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T19:04:42.876 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/158 2023-11-18T19:04:42.930 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/158 2023-11-18T19:04:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/158 2023-11-18T19:04:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/158 2023-11-18T19:04:43.260 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/158 2023-11-18T19:04:43.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/158 2023-11-18T19:04:43.437 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T19:04:43.481 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T19:04:43.568 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/158 2023-11-18T19:04:43.572 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T19:04:43.597 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/158 2023-11-18T19:04:43.615 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/158 2023-11-18T19:04:43.695 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/158 2023-11-18T19:04:44.603 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/158 2023-11-18T19:04:44.754 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/158 2023-11-18T19:04:46.449 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/158 2023-11-18T19:04:46.454 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T19:04:46.497 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T19:04:46.537 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/158 2023-11-18T19:04:46.582 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/158 2023-11-18T19:04:46.622 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-16.el9.x86_64 93/158 2023-11-18T19:04:46.666 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/158 2023-11-18T19:04:46.709 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 95/158 2023-11-18T19:04:47.097 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/158 2023-11-18T19:04:47.138 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T19:04:47.158 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T19:04:47.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T19:04:47.287 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 97/158 2023-11-18T19:04:47.318 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 98/158 2023-11-18T19:04:47.375 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T19:04:47.375 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-18T19:04:47.375 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-18T19:04:47.375 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:04:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/158 2023-11-18T19:04:47.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T19:04:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T19:04:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T19:04:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 101/158 2023-11-18T19:04:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 102/158 2023-11-18T19:04:50.651 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T19:04:50.696 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T19:04:51.378 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 103/158 2023-11-18T19:04:51.525 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T19:04:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 104/158 2023-11-18T19:04:51.733 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-18T19:04:51.733 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-18T19:04:51.733 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:04:52.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T19:05:00.288 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T19:05:00.288 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-11-18T19:05:00.288 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-11-18T19:05:00.289 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-11-18T19:05:00.289 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-11-18T19:05:00.289 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-11-18T19:05:00.289 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2023-11-18T19:05:00.289 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-11-18T19:05:00.289 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:00.520 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T19:05:00.568 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T19:05:00.568 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:00.568 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-18T19:05:00.568 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:02.323 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T19:05:02.408 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T19:05:02.408 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:02.408 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-18T19:05:02.409 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T19:05:02.409 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T19:05:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:02.657 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T19:05:02.735 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T19:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-18T19:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T19:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T19:05:02.736 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:03.233 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T19:05:03.304 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T19:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-18T19:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T19:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T19:05:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:03.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 110/158 2023-11-18T19:05:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T19:05:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T19:05:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 112/158 2023-11-18T19:05:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 113/158 2023-11-18T19:05:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T19:05:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T19:05:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T19:05:05.337 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 105/158 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /root 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2023-11-18T19:05:05.338 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:05.568 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T19:05:05.623 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 106/158 2023-11-18T19:05:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-18T19:05:05.623 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:05.832 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T19:05:05.874 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T19:05:06.017 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T19:05:06.190 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 117/158 2023-11-18T19:05:06.248 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T19:05:06.322 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T19:05:06.322 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:06.322 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-18T19:05:06.322 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T19:05:06.322 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T19:05:06.323 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:06.385 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T19:05:06.423 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T19:05:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/158 2023-11-18T19:05:07.421 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T19:05:07.435 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/158 2023-11-18T19:05:07.470 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T19:05:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 107/158 2023-11-18T19:05:07.506 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:07.506 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-18T19:05:07.506 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T19:05:07.506 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-18T19:05:07.506 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T19:05:07.541 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:07.541 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-18T19:05:07.541 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T19:05:07.541 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T19:05:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:07.634 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T19:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T19:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-18T19:05:07.707 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:07.763 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T19:05:07.787 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T19:05:07.838 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T19:05:07.838 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:07.838 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-18T19:05:07.838 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T19:05:07.838 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T19:05:07.839 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 108/158 2023-11-18T19:05:07.859 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:07.859 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-18T19:05:07.859 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T19:05:07.859 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-18T19:05:07.859 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:08.214 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T19:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T19:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-18T19:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T19:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T19:05:08.289 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T19:05:08.478 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 109/158 2023-11-18T19:05:08.478 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:08.479 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-18T19:05:08.479 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T19:05:08.479 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-18T19:05:08.479 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:08.624 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.2-8.el9.noarch 110/158 2023-11-18T19:05:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T19:05:09.320 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 111/158 2023-11-18T19:05:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 112/158 2023-11-18T19:05:09.504 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 113/158 2023-11-18T19:05:09.547 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T19:05:09.891 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 114/158 2023-11-18T19:05:09.923 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T19:05:11.104 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 115/158 2023-11-18T19:05:11.140 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T19:05:11.291 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 116/158 2023-11-18T19:05:11.473 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 117/158 2023-11-18T19:05:11.534 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T19:05:11.641 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 118/158 2023-11-18T19:05:11.641 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:11.641 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-18T19:05:11.641 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T19:05:11.641 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-18T19:05:11.641 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:11.709 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T19:05:11.753 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 119/158 2023-11-18T19:05:11.885 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 120/158 2023-11-18T19:05:12.456 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/158 2023-11-18T19:05:12.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 127/158 2023-11-18T19:05:12.596 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/158 2023-11-18T19:05:12.638 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 129/158 2023-11-18T19:05:12.846 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/158 2023-11-18T19:05:12.879 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T19:05:12.910 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 130/158 2023-11-18T19:05:12.984 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 122/158 2023-11-18T19:05:12.985 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:12.985 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-18T19:05:12.985 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T19:05:12.985 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-18T19:05:12.985 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:13.029 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 131/158 2023-11-18T19:05:13.038 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T19:05:13.065 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 132/158 2023-11-18T19:05:13.099 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 133/158 2023-11-18T19:05:13.139 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 134/158 2023-11-18T19:05:13.144 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 123/158 2023-11-18T19:05:13.144 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:13.144 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-18T19:05:13.145 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:13.176 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 135/158 2023-11-18T19:05:13.230 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T19:05:13.277 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 136/158 2023-11-18T19:05:13.346 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 124/158 2023-11-18T19:05:13.346 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:13.346 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-18T19:05:13.346 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T19:05:13.346 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-18T19:05:13.346 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:13.348 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T19:05:13.384 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/158 2023-11-18T19:05:13.730 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T19:05:13.822 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 125/158 2023-11-18T19:05:13.823 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-18T19:05:13.823 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-18T19:05:13.823 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T19:05:13.823 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-18T19:05:13.823 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:14.251 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T19:05:14.299 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T19:05:14.356 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T19:05:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 140/158 2023-11-18T19:05:15.825 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 141/158 2023-11-18T19:05:15.905 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/158 2023-11-18T19:05:15.950 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/158 2023-11-18T19:05:16.086 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/158 2023-11-18T19:05:16.124 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/158 2023-11-18T19:05:16.189 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T19:05:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 147/158 2023-11-18T19:05:16.268 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 148/158 2023-11-18T19:05:16.268 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T19:05:16.416 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T19:05:16.455 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 150/158 2023-11-18T19:05:16.487 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 151/158 2023-11-18T19:05:16.520 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 152/158 2023-11-18T19:05:16.560 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T19:05:16.560 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T19:05:16.887 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T19:05:16.887 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T19:05:17.034 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T19:05:17.090 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 155/158 2023-11-18T19:05:17.091 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T19:05:17.236 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T19:05:17.275 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 157/158 2023-11-18T19:05:17.403 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T19:05:17.665 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T19:05:17.665 INFO:teuthology.orchestra.run.smithi135.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-18T19:05:17.665 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:18.250 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 126/158 2023-11-18T19:05:18.316 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 127/158 2023-11-18T19:05:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 128/158 2023-11-18T19:05:18.421 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 129/158 2023-11-18T19:05:18.779 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 130/158 2023-11-18T19:05:18.933 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 131/158 2023-11-18T19:05:18.974 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 132/158 2023-11-18T19:05:19.008 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 133/158 2023-11-18T19:05:19.047 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 134/158 2023-11-18T19:05:19.093 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 135/158 2023-11-18T19:05:19.194 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 136/158 2023-11-18T19:05:19.276 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T19:05:19.318 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/158 2023-11-18T19:05:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T19:05:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T19:05:20.409 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 139/158 2023-11-18T19:05:20.486 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 140/158 2023-11-18T19:05:22.011 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 141/158 2023-11-18T19:05:22.091 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 142/158 2023-11-18T19:05:22.166 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 143/158 2023-11-18T19:05:22.320 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.4-9.el9.x86_64 144/158 2023-11-18T19:05:22.361 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.7.4-5.el9.x86_64 145/158 2023-11-18T19:05:22.394 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T19:05:22.437 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 147/158 2023-11-18T19:05:22.489 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 148/158 2023-11-18T19:05:22.489 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T19:05:22.636 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 149/158 2023-11-18T19:05:22.661 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/158 2023-11-18T19:05:22.661 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/158 2023-11-18T19:05:22.661 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/158 2023-11-18T19:05:22.661 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/158 2023-11-18T19:05:22.661 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/158 2023-11-18T19:05:22.661 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 14/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 16/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 17/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 18/158 2023-11-18T19:05:22.662 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 19/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 20/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 21/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 22/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 28/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 29/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 30/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 31/158 2023-11-18T19:05:22.663 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 32/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 33/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 34/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 35/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 36/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 37/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 38/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/158 2023-11-18T19:05:22.664 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-16.el9.x86_64 47/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/158 2023-11-18T19:05:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/158 2023-11-18T19:05:22.666 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/158 2023-11-18T19:05:22.667 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/158 2023-11-18T19:05:22.668 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/158 2023-11-18T19:05:22.669 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/158 2023-11-18T19:05:22.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 133/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 135/158 2023-11-18T19:05:22.671 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/158 2023-11-18T19:05:22.672 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/158 2023-11-18T19:05:22.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/158 2023-11-18T19:05:22.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/158 2023-11-18T19:05:22.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/158 2023-11-18T19:05:22.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/158 2023-11-18T19:05:22.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/158 2023-11-18T19:05:22.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/158 2023-11-18T19:05:22.673 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/158 2023-11-18T19:05:22.681 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 150/158 2023-11-18T19:05:22.716 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 151/158 2023-11-18T19:05:22.749 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 152/158 2023-11-18T19:05:22.790 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T19:05:22.791 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T19:05:23.116 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 153/158 2023-11-18T19:05:23.116 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T19:05:23.288 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/158 2023-11-18T19:05:23.318 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 155/158 2023-11-18T19:05:23.319 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T19:05:23.465 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 156/158 2023-11-18T19:05:23.504 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 157/158 2023-11-18T19:05:23.636 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T19:05:23.911 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T19:05:23.911 INFO:teuthology.orchestra.run.smithi045.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-18T19:05:23.911 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: acl-2.3.1-4.el9.x86_64 2023-11-18T19:05:24.885 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-18T19:05:24.886 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2023-11-18T19:05:24.888 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-16.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-18T19:05:24.889 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-18T19:05:24.890 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.11-1.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-18T19:05:24.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-18T19:05:24.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-18T19:05:24.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-18T19:05:24.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-18T19:05:24.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-18T19:05:24.896 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-18T19:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-18T19:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:24.897 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-11-18T19:05:25.413 DEBUG:teuthology.parallel:result is None 2023-11-18T19:05:28.776 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 1/158 2023-11-18T19:05:28.776 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2/158 2023-11-18T19:05:28.776 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 3/158 2023-11-18T19:05:28.776 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 4/158 2023-11-18T19:05:28.776 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7418.gb0f45 5/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 6/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 7/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 8/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 9/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 10/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 11/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 12/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 13/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_ 14/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 15/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 16/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_6 17/158 2023-11-18T19:05:28.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86 18/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 19/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el 20/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9. 21/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_6 22/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 23/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 24/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 25/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 26/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 27/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 28/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51. 29/158 2023-11-18T19:05:28.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noa 30/158 2023-11-18T19:05:28.779 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.n 31/158 2023-11-18T19:05:28.779 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f 32/158 2023-11-18T19:05:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el 33/158 2023-11-18T19:05:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 34/158 2023-11-18T19:05:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.e 35/158 2023-11-18T19:05:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 36/158 2023-11-18T19:05:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 37/158 2023-11-18T19:05:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 38/158 2023-11-18T19:05:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-16.el9.x86_64 47/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/158 2023-11-18T19:05:28.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/158 2023-11-18T19:05:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/158 2023-11-18T19:05:28.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/158 2023-11-18T19:05:28.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/158 2023-11-18T19:05:28.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/158 2023-11-18T19:05:28.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/158 2023-11-18T19:05:28.800 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 133/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 135/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/158 2023-11-18T19:05:28.801 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/158 2023-11-18T19:05:28.802 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/158 2023-11-18T19:05:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/158 2023-11-18T19:05:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/158 2023-11-18T19:05:28.803 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/158 2023-11-18T19:05:31.050 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/158 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: acl-2.3.1-4.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-18T19:05:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.2-8.el9.noarch 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.7.4-5.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.052 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.053 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:18.0.0-7418.gb0f45a51.el9.noarch 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.4-9.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-18T19:05:31.054 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-16.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-18T19:05:31.055 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-18T19:05:31.056 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-13.11-1.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.057 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-18T19:05:31.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-18T19:05:31.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply-3.11-14.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-18T19:05:31.060 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-18T19:05:31.061 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:18.0.0-7418.gb0f45a51.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: re2-1:20211101-3.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-18T19:05:31.062 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-18T19:05:31.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:31.063 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-11-18T19:05:31.623 DEBUG:teuthology.parallel:result is None 2023-11-18T19:05:31.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:05:31.876 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-18T19:05:31.937 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-18T19:05:31.937 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-18T19:05:31.937 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-18T19:05:31.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:05:32.153 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-18T19:05:32.216 INFO:teuthology.orchestra.run.smithi135.stdout:18.0.0-7418.gb0f45a51.el9 2023-11-18T19:05:32.217 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7418.gb0f45a51.el9 2023-11-18T19:05:32.217 INFO:teuthology.task.install:The correct ceph version 18.0.0-7418.gb0f45a51 is installed. 2023-11-18T19:05:32.217 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-18T19:05:32.217 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:32.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T19:05:32.302 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:32.302 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-18T19:05:32.410 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-18T19:05:32.410 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:32.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T19:05:32.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T19:05:32.568 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:32.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-11-18T19:05:32.670 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-18T19:05:32.755 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-18T19:05:32.755 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:32.755 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T19:05:32.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T19:05:32.974 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:32.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-18T19:05:33.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-18T19:05:33.189 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-18T19:05:33.189 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:33.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T19:05:33.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T19:05:33.394 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:33.394 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-11-18T19:05:33.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-18T19:05:33.561 INFO:teuthology.run_tasks:Running task ceph... 2023-11-18T19:05:33.622 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-18T19:05:33.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-11-18T19:05:33.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2023-11-18T19:05:33.716 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-18T19:05:33.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T19:05:33.722 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-18T19:05:33.806 INFO:tasks.ceph:Creating extra log directories... 2023-11-18T19:05:33.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T19:05:33.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-18T19:05:33.903 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-18T19:05:33.904 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-18T19:05:33.904 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-18T19:05:33.904 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:33.904 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T19:05:33.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T19:05:34.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-18T19:05:34.243 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:34.243 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-18T19:05:34.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-18T19:05:34.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-18T19:05:34.667 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-18T19:05:34.667 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-18T19:05:34.668 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631', 'branch': 'main', 'description': 'fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7461631', 'kclient-workload': {'sequential': [{'kclient': ['client.1']}, {'workunit': {'clients': {'client.1': ['kernel_untar_build.sh']}}}]}, 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1491, 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxi6IfQxZmhIEmrciFlkJVcoI5Kuihsb/cws3xBpSC7NRmfCuG4ikrHEfr35KkPEihQCfq77SiOu0/Mz8NfKpc=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2Ybx6HbM45x/yzfJPFo+xiWmdEeDbtUwg16eOlEqGX6FCgudCR/BGrHBGbFi5r1vqgKjXLYxFwP4gjPnBVyFg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe', 'cluster': 'ceph'}}, {'parallel': ['user-workload', 'kclient-workload']}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-18_13:51:50', 'tube': 'smithi', 'user': 'yuriw', 'user-workload': {'sequential': [{'ceph-fuse': ['client.0']}, {'workunit': {'clients': {'client.0': ['suites/blogbench.sh']}}}]}, 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-18T19:05:34.668 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T19:05:34.676 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-18T19:05:34.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T19:05:34.763 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2023-11-18T19:05:34.860 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:34.860 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T19:05:34.909 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T19:05:34.910 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-18 19:05:24.420134559 +0000 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-18 19:02:51.674144666 +0000 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-18 19:02:51.674144666 +0000 2023-11-18T19:05:34.996 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-18 19:02:51.674144666 +0000 2023-11-18T19:05:34.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T19:05:35.107 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-18T19:05:35.107 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-18T19:05:35.107 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000243124 s, 2.1 MB/s 2023-11-18T19:05:35.110 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T19:05:35.157 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-11-18T19:05:35.197 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-18 19:05:24.421134543 +0000 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-18 19:02:52.675128362 +0000 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-18 19:02:52.675128362 +0000 2023-11-18T19:05:35.198 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-18 19:02:52.675128362 +0000 2023-11-18T19:05:35.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T19:05:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-18T19:05:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-18T19:05:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000189864 s, 2.7 MB/s 2023-11-18T19:05:35.313 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T19:05:35.358 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-11-18T19:05:35.442 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T19:05:35.442 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:35.442 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-11-18T19:05:35.442 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:35.442 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:35.442 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-18 19:05:24.422134526 +0000 2023-11-18T19:05:35.442 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-18 19:02:53.735111096 +0000 2023-11-18T19:05:35.443 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-18 19:02:53.735111096 +0000 2023-11-18T19:05:35.443 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-18 19:02:53.735111096 +0000 2023-11-18T19:05:35.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T19:05:35.571 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-18T19:05:35.571 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-18T19:05:35.571 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000260679 s, 2.0 MB/s 2023-11-18T19:05:35.574 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T19:05:35.629 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-11-18T19:05:35.676 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T19:05:35.676 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:35.676 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-11-18T19:05:35.676 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:35.676 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:35.676 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-18 19:05:24.422134526 +0000 2023-11-18T19:05:35.677 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-18 19:02:54.796093814 +0000 2023-11-18T19:05:35.677 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-18 19:02:54.797093797 +0000 2023-11-18T19:05:35.677 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-18 19:02:54.796093814 +0000 2023-11-18T19:05:35.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T19:05:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-18T19:05:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-18T19:05:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000224589 s, 2.3 MB/s 2023-11-18T19:05:35.762 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T19:05:35.811 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:35.812 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:35.812 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-11-18T19:05:35.872 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-18T19:05:35.872 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-11-18T19:05:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-18T19:05:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:35.928 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-11-18T19:05:35.929 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:35.929 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:35.929 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-11-18 19:05:18.141464551 +0000 2023-11-18T19:05:35.929 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-11-18 19:02:25.086437206 +0000 2023-11-18T19:05:35.929 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-11-18 19:02:25.086437206 +0000 2023-11-18T19:05:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-11-18 19:02:25.086437206 +0000 2023-11-18T19:05:35.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-18T19:05:36.019 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-11-18T19:05:36.020 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-11-18T19:05:36.020 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00031526 s, 1.6 MB/s 2023-11-18T19:05:36.023 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-18T19:05:36.078 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-11-18T19:05:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-18T19:05:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:36.130 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-11-18T19:05:36.131 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:36.131 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:36.131 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-11-18 19:05:18.141464551 +0000 2023-11-18T19:05:36.131 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-11-18 19:02:26.113415279 +0000 2023-11-18T19:05:36.131 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-11-18 19:02:26.113415279 +0000 2023-11-18T19:05:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-11-18 19:02:26.113415279 +0000 2023-11-18T19:05:36.131 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-18T19:05:36.218 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-11-18T19:05:36.218 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-11-18T19:05:36.218 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00038663 s, 1.3 MB/s 2023-11-18T19:05:36.222 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-18T19:05:36.279 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-11-18T19:05:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-18T19:05:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:36.326 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-11-18T19:05:36.326 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:36.326 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:36.326 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-11-18 19:05:18.142464530 +0000 2023-11-18T19:05:36.326 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-11-18 19:02:27.111393971 +0000 2023-11-18T19:05:36.326 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-11-18 19:02:27.111393971 +0000 2023-11-18T19:05:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-11-18 19:02:27.111393971 +0000 2023-11-18T19:05:36.326 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-18T19:05:36.458 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-11-18T19:05:36.459 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-11-18T19:05:36.459 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000322593 s, 1.6 MB/s 2023-11-18T19:05:36.462 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-18T19:05:36.520 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-11-18T19:05:36.569 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-11-18 19:05:18.143464509 +0000 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-11-18 19:02:28.525363781 +0000 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-11-18 19:02:28.525363781 +0000 2023-11-18T19:05:36.570 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-11-18 19:02:28.525363781 +0000 2023-11-18T19:05:36.570 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-18T19:05:36.657 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-11-18T19:05:36.657 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-11-18T19:05:36.657 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00030777 s, 1.7 MB/s 2023-11-18T19:05:36.661 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-18T19:05:36.717 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:36.717 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T19:05:36.717 INFO:tasks.ceph:Generating config... 2023-11-18T19:05:36.719 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-18T19:05:36.719 INFO:tasks.ceph:[client] debug client = 20 2023-11-18T19:05:36.719 INFO:tasks.ceph:[client] debug ms = 1 2023-11-18T19:05:36.719 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-18T19:05:36.719 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-18T19:05:36.719 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-18T19:05:36.719 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-18T19:05:36.719 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-18T19:05:36.719 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-18T19:05:36.720 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-18T19:05:36.721 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-18T19:05:36.722 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-18T19:05:36.722 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-18T19:05:36.722 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-18T19:05:36.722 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-18T19:05:36.722 INFO:tasks.ceph:Setting up mon.a... 2023-11-18T19:05:36.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-18T19:05:36.883 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-11-18T19:05:36.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-18T19:05:37.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T19:05:37.133 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]')] 2023-11-18T19:05:37.134 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-18T19:05:37.134 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:37.134 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T19:05:37.190 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:37.352 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:37.352 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid b96c09c0-a884-4d0b-a1ec-074e421eff36 2023-11-18T19:05:37.352 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-11-18T19:05:37.352 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-11-18T19:05:37.352 INFO:teuthology.orchestra.run.smithi045.stdout:fsid b96c09c0-a884-4d0b-a1ec-074e421eff36 2023-11-18T19:05:37.352 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-11-18T19:05:37.352261+0000 2023-11-18T19:05:37.352 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-11-18T19:05:37.352261+0000 2023-11-18T19:05:37.353 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-11-18T19:05:37.353 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-11-18T19:05:37.353 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-11-18T19:05:37.353 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2023-11-18T19:05:37.353 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2023-11-18T19:05:37.353 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-18T19:05:37.355 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-18T19:05:37.412 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b96c09c0-a884-4d0b-a1ec-074e421eff36... 2023-11-18T19:05:37.412 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T19:05:37.418 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-18T19:05:37.593 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-11-18T19:05:37.593 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-11-18T19:05:37.593 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-11-18T19:05:37.594 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-11-18T19:05:37.595 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-11-18T19:05:37.596 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on skipped message = False 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = b96c09c0-a884-4d0b-a1ec-074e421eff36 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-11-18T19:05:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug trim objects = true 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-11-18T19:05:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-11-18T19:05:37.599 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore compression mode = aggressive 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-11-18T19:05:37.600 INFO:teuthology.orchestra.run.smithi045.stdout: osd shutdown pgref assert = True 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-11-18T19:05:37.601 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T19:05:37.602 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-11-18T19:05:37.603 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-11-18T19:05:37.604 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-11-18T19:05:37.605 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2023-11-18T19:05:37.606 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-18T19:05:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2023-11-18T19:05:37.608 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.45,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on skipped message = False 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = b96c09c0-a884-4d0b-a1ec-074e421eff36 2023-11-18T19:05:37.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2023-11-18T19:05:37.610 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2023-11-18T19:05:37.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore compression mode = aggressive 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2023-11-18T19:05:37.612 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: osd shutdown pgref assert = True 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2023-11-18T19:05:37.613 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2023-11-18T19:05:37.614 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-18T19:05:37.615 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-18T19:05:37.616 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-11-18T19:05:37.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds balancer = 20 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-11-18T19:05:37.618 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-11-18T19:05:37.641 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-18T19:05:37.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-18T19:05:37.799 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-18T19:05:37.799 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:37.799 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-18T19:05:37.857 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:37.857 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-18T19:05:37.912 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:05:37.912 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:37.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T19:05:37.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T19:05:38.076 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:05:38.076 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:38.178 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:05:38.178 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:38.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-18T19:05:38.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-18T19:05:38.337 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:05:38.337 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:38.434 INFO:tasks.ceph:Setting up mon nodes... 2023-11-18T19:05:38.434 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-18T19:05:38.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T19:05:38.646 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-18T19:05:38.656 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T19:05:38.856 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-18T19:05:38.867 INFO:tasks.ceph:Setting up mds nodes... 2023-11-18T19:05:38.867 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T19:05:39.078 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-18T19:05:39.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-18T19:05:39.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T19:05:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-18T19:05:39.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-18T19:05:39.502 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T19:05:39.686 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-18T19:05:39.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-18T19:05:39.794 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T19:05:39.984 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-18T19:05:39.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-18T19:05:40.085 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-18T19:05:40.086 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-18T19:05:40.230 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-18T19:05:40.297 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-18T19:05:40.431 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-18T19:05:40.490 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-18T19:05:40.490 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-18T19:05:40.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-18T19:05:40.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:40.607 INFO:tasks.ceph:role: osd.0 2023-11-18T19:05:40.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:05:40.607 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T19:05:40.707 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:40.707 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:40.708 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:40.741 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-18T19:05:40.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-18T19:05:40.748 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-18T19:05:40.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-18T19:05:40.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-18T19:05:41.044 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:41.044 INFO:tasks.ceph:role: osd.1 2023-11-18T19:05:41.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:05:41.045 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T19:05:41.148 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:41.148 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:41.149 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:41.149 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:41.149 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:41.181 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-18T19:05:41.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-18T19:05:41.188 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-18T19:05:41.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-18T19:05:41.411 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-18T19:05:41.507 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:41.507 INFO:tasks.ceph:role: osd.2 2023-11-18T19:05:41.507 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:05:41.507 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T19:05:41.606 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:41.607 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:41.640 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-18T19:05:41.647 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-18T19:05:41.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-18T19:05:41.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-18T19:05:41.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-18T19:05:41.960 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:41.961 INFO:tasks.ceph:role: osd.3 2023-11-18T19:05:41.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:05:41.961 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T19:05:42.064 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:42.065 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:42.100 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-18T19:05:42.105 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-18T19:05:42.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-18T19:05:42.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-18T19:05:42.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:42.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:42.478+0000 7f4e29c0f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-18T19:05:42.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:42.479+0000 7f4e29c0f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-18T19:05:42.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:42.479+0000 7f4e29c0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T19:05:42.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:42.479+0000 7f4e29c0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T19:05:42.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:42.479+0000 7f4e29c0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-18T19:05:42.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:42.482+0000 7f4e29c0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-18T19:05:45.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-18T19:05:45.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:45.672+0000 7f000cc17500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-18T19:05:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:45.673+0000 7f000cc17500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-18T19:05:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:45.673+0000 7f000cc17500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T19:05:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:45.673+0000 7f000cc17500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T19:05:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:45.673+0000 7f000cc17500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-18T19:05:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:45.675+0000 7f000cc17500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-18T19:05:48.855 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-18T19:05:48.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:49.112+0000 7f22e4818500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-18T19:05:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:49.113+0000 7f22e4818500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-18T19:05:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:49.113+0000 7f22e4818500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T19:05:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:49.114+0000 7f22e4818500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T19:05:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:49.114+0000 7f22e4818500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-18T19:05:49.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:49.116+0000 7f22e4818500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-18T19:05:52.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-18T19:05:52.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:52.293+0000 7f8febfbc500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-18T19:05:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:52.294+0000 7f8febfbc500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-18T19:05:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:52.294+0000 7f8febfbc500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T19:05:52.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:52.294+0000 7f8febfbc500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T19:05:52.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:52.294+0000 7f8febfbc500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-18T19:05:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:05:52.296+0000 7f8febfbc500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-18T19:05:55.468 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-18T19:05:55.574 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-18T19:05:55.680 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:55.681 INFO:tasks.ceph:role: osd.4 2023-11-18T19:05:55.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:05:55.681 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-18T19:05:55.784 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:55.784 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:55.784 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:55.785 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:55.785 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:55.785 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:55.785 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:55.785 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:55.785 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:55.785 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:56.289 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-11-18T19:05:56.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-11-18T19:05:56.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-18T19:05:56.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-18T19:05:56.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-18T19:05:56.670 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:56.670 INFO:tasks.ceph:role: osd.5 2023-11-18T19:05:56.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:05:56.671 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-18T19:05:56.754 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:56.754 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:56.754 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:56.755 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:56.755 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:56.755 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:56.755 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:56.755 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:56.755 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:56.755 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:57.212 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-11-18T19:05:57.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-11-18T19:05:57.218 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-18T19:05:57.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-18T19:05:57.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-18T19:05:57.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:57.518 INFO:tasks.ceph:role: osd.6 2023-11-18T19:05:57.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:05:57.518 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-18T19:05:57.598 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:57.598 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:57.598 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:57.599 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:57.599 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:57.599 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:57.599 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:57.599 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:57.599 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:57.599 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:58.120 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-11-18T19:05:58.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-11-18T19:05:58.125 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-18T19:05:58.299 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-18T19:05:58.404 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-18T19:05:58.498 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-18T19:05:58.498 INFO:tasks.ceph:role: osd.7 2023-11-18T19:05:58.498 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:05:58.498 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-18T19:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-18T19:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-18T19:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-18T19:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-18T19:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-18T19:05:58.601 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-11-18T19:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-18T19:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-18T19:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-18T19:05:58.602 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-18T19:05:59.059 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-11-18T19:05:59.066 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-11-18T19:05:59.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-18T19:05:59.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-18T19:05:59.318 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:05:59.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:05:59.477+0000 7f494580c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-18T19:05:59.482 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:05:59.480+0000 7f494580c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-18T19:05:59.482 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:05:59.480+0000 7f494580c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T19:05:59.482 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:05:59.480+0000 7f494580c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T19:05:59.482 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:05:59.480+0000 7f494580c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-18T19:05:59.494 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:05:59.492+0000 7f494580c500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-18T19:06:02.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-18T19:06:02.530 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:06:02.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:02.662+0000 7efe2f594500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-18T19:06:02.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:02.662+0000 7efe2f594500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-18T19:06:02.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:02.662+0000 7efe2f594500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T19:06:02.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:02.662+0000 7efe2f594500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T19:06:02.664 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:02.662+0000 7efe2f594500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-18T19:06:02.666 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:02.665+0000 7efe2f594500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-18T19:06:04.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:06:04.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:06:05.849 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-18T19:06:05.946 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:06:06.081 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:06.081+0000 7f9c9828c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-18T19:06:06.082 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:06.081+0000 7f9c9828c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-18T19:06:06.082 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:06.082+0000 7f9c9828c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T19:06:06.082 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:06.082+0000 7f9c9828c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T19:06:06.083 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:06.082+0000 7f9c9828c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-18T19:06:06.084 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:06.084+0000 7f9c9828c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-18T19:06:09.021 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-18T19:06:09.120 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:06:09.255 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:09.255+0000 7f8bdb4a9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-18T19:06:09.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:09.255+0000 7f8bdb4a9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-18T19:06:09.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:09.255+0000 7f8bdb4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T19:06:09.258 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:09.256+0000 7f8bdb4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T19:06:09.258 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:09.256+0000 7f8bdb4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-18T19:06:09.258 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:09.258+0000 7f8bdb4a9500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-18T19:06:12.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-18T19:06:12.531 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-18T19:06:12.531 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:12.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-18T19:06:12.644 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:12.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-18T19:06:12.748 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:12.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-18T19:06:12.885 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:12.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-18T19:06:12.982 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:12.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-18T19:06:13.084 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:13.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-18T19:06:13.193 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:13.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-18T19:06:13.301 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:13.301 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-18T19:06:13.405 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:13.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-18T19:06:13.496 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:13.496 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-18T19:06:13.593 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:13.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-18T19:06:13.688 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:13.688 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-18T19:06:13.778 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:13.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-18T19:06:13.872 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:13.872 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-18T19:06:13.968 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:13.968 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-18T19:06:14.030 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:14.030 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-18T19:06:14.090 INFO:tasks.ceph:Adding keys to all mons... 2023-11-18T19:06:14.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T19:06:14.099 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-18T19:06:14.188 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQACC1llOzqEJhAAhCwINhHGya0DXn/GHDWalA== 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQADC1llOh2yBBAA33Mhg5pIsT3O78T4gCJmEw== 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQADC1llWYAzFxAA41ZlsYT3K19dbdPaQ8w/+g== 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAGC1llURCbHBAAI7Y3VsXJX6weDYzCyz6sQQ== 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAJC1llkw8pKBAAdWClNQp0rsoiW666/+yzXg== 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQANC1llLADOBhAA/KWgRDT6TZ4y8SvkievoZw== 2023-11-18T19:06:14.189 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAQC1llOx+UERAALSHgaIXyxxokWwVNXecC5g== 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQACC1llf2oJMxAA3byan+V2pw6a3krUyN31Fw== 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQADC1llC/nqKBAAus8kvMd2Nvp2gRHi9jc0Zw== 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQADC1ll4D2vOhAAr0O3Oh8OcrUPliyXjgn9gA== 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAXC1lllfWPHBAAmVJt354nedlpFPGwO542Yg== 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAaC1lleUuRJxAAblwhcfDoLsPj9x9xZchJDw== 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2023-11-18T19:06:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAeC1ll8n/cBBAA7FeTrkyRbyhat6/Cm9DYNQ== 2023-11-18T19:06:14.191 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2023-11-18T19:06:14.191 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAhC1ll5aVADxAAULsCe6nDdgQrNajANE5MaQ== 2023-11-18T19:06:14.191 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2023-11-18T19:06:14.191 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAEC1llYTnDDRAAE/cPCsnMO3ev4rvMAiwBDg== 2023-11-18T19:06:14.191 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2023-11-18T19:06:14.191 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAEC1llwgC3GRAANmPdcMX2vc/xRdG2u679ng== 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQACC1llOzqEJhAAhCwINhHGya0DXn/GHDWalA== 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQADC1llOh2yBBAA33Mhg5pIsT3O78T4gCJmEw== 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQADC1llWYAzFxAA41ZlsYT3K19dbdPaQ8w/+g== 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAGC1llURCbHBAAI7Y3VsXJX6weDYzCyz6sQQ== 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAJC1llkw8pKBAAdWClNQp0rsoiW666/+yzXg== 2023-11-18T19:06:14.197 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQANC1llLADOBhAA/KWgRDT6TZ4y8SvkievoZw== 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAQC1llOx+UERAALSHgaIXyxxokWwVNXecC5g== 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQACC1llf2oJMxAA3byan+V2pw6a3krUyN31Fw== 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQADC1llC/nqKBAAus8kvMd2Nvp2gRHi9jc0Zw== 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQADC1ll4D2vOhAAr0O3Oh8OcrUPliyXjgn9gA== 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAXC1lllfWPHBAAmVJt354nedlpFPGwO542Yg== 2023-11-18T19:06:14.198 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAaC1lleUuRJxAAblwhcfDoLsPj9x9xZchJDw== 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAeC1ll8n/cBBAA7FeTrkyRbyhat6/Cm9DYNQ== 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAhC1ll5aVADxAAULsCe6nDdgQrNajANE5MaQ== 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAEC1llYTnDDRAAE/cPCsnMO3ev4rvMAiwBDg== 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-11-18T19:06:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAEC1llwgC3GRAANmPdcMX2vc/xRdG2u679ng== 2023-11-18T19:06:14.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T19:06:14.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T19:06:14.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:14.372 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:14.522 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:14.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:14.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:14.685 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:14.832 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:14.840 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:14.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:14.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:15.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:15.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:15.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T19:06:15.309 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-18T19:06:15.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:15.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:15.611 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:15.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-18T19:06:15.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:15.775 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:15.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:15.931 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:16.081 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:16.087 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:16.230 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:16.238 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-18T19:06:16.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T19:06:16.391 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T19:06:16.543 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T19:06:16.552 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-18T19:06:16.704 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-18T19:06:16.704 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-18T19:06:16.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T19:06:16.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-18T19:06:17.072 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-18T19:06:17.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T19:06:17.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-18T19:06:17.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-18T19:06:17.518 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-18T19:06:17.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-18T19:06:17.761 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:06:17.770 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-18T19:06:17.824 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-18T19:06:17.824 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-18T19:06:17.824 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-18T19:06:17.829 INFO:tasks.ceph.mon.a:Started 2023-11-18T19:06:17.830 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-18T19:06:17.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-18T19:06:17.838 INFO:tasks.ceph.mon.b:Started 2023-11-18T19:06:17.838 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-18T19:06:17.838 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-18T19:06:17.846 INFO:tasks.ceph.mon.c:Started 2023-11-18T19:06:17.846 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-18T19:06:17.846 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-18T19:06:17.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-18T19:06:17.852 INFO:tasks.ceph.mgr.y:Started 2023-11-18T19:06:17.852 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-18T19:06:17.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-18T19:06:17.857 INFO:tasks.ceph.mgr.x:Started 2023-11-18T19:06:17.857 INFO:tasks.ceph:Setting crush tunables to default 2023-11-18T19:06:17.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-11-18T19:06:18.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.042+0000 7f770b4bb640 1 Processor -- start 2023-11-18T19:06:18.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.042+0000 7f770b4bb640 1 -- start start 2023-11-18T19:06:18.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.043+0000 7f770b4bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 0x7f77040c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.043+0000 7f770b4bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040c4ef0 con 0x7f770414e8b0 2023-11-18T19:06:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.043+0000 7f770b4bb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040c5400 con 0x7f770406c840 2023-11-18T19:06:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.043+0000 7f770b4bb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7704155010 con 0x7f7704155430 2023-11-18T19:06:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.044+0000 7f7708a56640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f770406c840 0x7f77040ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:45000/0 (socket says 172.21.15.45:45000) 2023-11-18T19:06:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.044+0000 7f7708a56640 1 -- 172.21.15.45:0/2134526348 learned_addr learned my addr 172.21.15.45:0/2134526348 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.044+0000 7f7709a58640 1 --2- 172.21.15.45:0/2134526348 >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 0x7f77040c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.044+0000 7f7709a58640 1 -- 172.21.15.45:0/2134526348 >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 msgr2=0x7f77040c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-18T19:06:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.044+0000 7f7709a58640 1 -- 172.21.15.45:0/2134526348 >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 msgr2=0x7f77040c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-18T19:06:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.044+0000 7f7709a58640 1 --2- 172.21.15.45:0/2134526348 >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 0x7f77040c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-18T19:06:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.044+0000 7f7709a58640 1 --2- 172.21.15.45:0/2134526348 >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 0x7f77040c49b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-18T19:06:18.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.053+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455849687 0 0) 0x7f77040c4ef0 con 0x7f770414e8b0 2023-11-18T19:06:18.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.053+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f0003520 con 0x7f770414e8b0 2023-11-18T19:06:18.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.053+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553978368 0 0) 0x7f77040c5400 con 0x7f770406c840 2023-11-18T19:06:18.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.053+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77040c4ef0 con 0x7f770406c840 2023-11-18T19:06:18.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2380026642 0 0) 0x7f76f0003520 con 0x7f770414e8b0 2023-11-18T19:06:18.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 msgr2=0x7f77040c49b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T19:06:18.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 --2- 172.21.15.45:0/2134526348 >> v2:172.21.15.45:3300/0 conn(0x7f7704155430 0x7f77040c49b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 >> v1:172.21.15.135:6789/0 conn(0x7f770406c840 legacy=0x7f77040ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:18.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040c6350 con 0x7f770414e8b0 2023-11-18T19:06:18.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f7700001670 con 0x7f770414e8b0 2023-11-18T19:06:18.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 >> v1:172.21.15.45:6789/0 conn(0x7f770414e8b0 legacy=0x7f7704157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:18.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76f0003b50 0x7f76f0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:18.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f00047c0 0x7f76f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0005250 0x7f76f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7704155010 con 0x7f76f00047c0 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f000c1a0 con 0x7f76f0003b50 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f000c360 con 0x7f76f0005250 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f7709257640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76f0003b50 0x7f76f0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.054+0000 7f7708a56640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f00047c0 0x7f76f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.055+0000 7f7709a58640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0005250 0x7f76f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.055+0000 7f7709257640 1 -- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0005250 msgr2=0x7f76f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.055+0000 7f7709257640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0005250 0x7f76f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.055+0000 7f7709257640 1 -- 172.21.15.45:0/2134526348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f00047c0 msgr2=0x7f76f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.055+0000 7f7709257640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f00047c0 0x7f76f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.055+0000 7f7709257640 1 -- 172.21.15.45:0/2134526348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0003520 con 0x7f76f0003b50 2023-11-18T19:06:18.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.055+0000 7f7709a58640 1 -- 172.21.15.45:0/2134526348 reap_dead start 2023-11-18T19:06:18.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.056+0000 7f7709257640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76f0003b50 0x7f76f0003f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7700007eb0 tx=0x7f76f00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89eede3f1ac8d43d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:18.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.057+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770002c8b0 con 0x7f76f0003b50 2023-11-18T19:06:18.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.057+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770002ca10 con 0x7f76f0003b50 2023-11-18T19:06:18.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.057+0000 7f76fbfff640 1 -- 172.21.15.45:0/2134526348 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770002cdc0 con 0x7f76f0003b50 2023-11-18T19:06:18.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.058+0000 7f770b4bb640 1 -- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76f0003b50 msgr2=0x7f76f0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:18.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.058+0000 7f770b4bb640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76f0003b50 0x7f76f0003f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7700007eb0 tx=0x7f76f00057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.058+0000 7f770b4bb640 1 -- 172.21.15.45:0/2134526348 shutdown_connections 2023-11-18T19:06:18.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.058+0000 7f770b4bb640 1 --2- 172.21.15.45:0/2134526348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76f0003b50 0x7f76f0003f50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.058+0000 7f770b4bb640 1 -- 172.21.15.45:0/2134526348 >> 172.21.15.45:0/2134526348 conn(0x7f77040663d0 msgr2=0x7f77040667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:18.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.058+0000 7f770b4bb640 1 -- 172.21.15.45:0/2134526348 shutdown_connections 2023-11-18T19:06:18.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.058+0000 7f770b4bb640 1 -- 172.21.15.45:0/2134526348 wait complete. 2023-11-18T19:06:18.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.060+0000 7f770b4bb640 1 Processor -- start 2023-11-18T19:06:18.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.060+0000 7f770b4bb640 1 -- start start 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.061+0000 7f770b4bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0003b50 0x7f77041eaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.061+0000 7f770b4bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040c1f10 0x7f77040c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.061+0000 7f770b4bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7704155b60 0x7f7704144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.061+0000 7f770b4bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77041ea050 con 0x7f77040c1f10 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.061+0000 7f770b4bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040c3bd0 con 0x7f7704155b60 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.061+0000 7f770b4bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77041ea2f0 con 0x7f76f0003b50 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040c1f10 0x7f77040c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7709257640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0003b50 0x7f77041eaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040c1f10 0x7f77040c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57582/0 (socket says 172.21.15.45:57582) 2023-11-18T19:06:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 -- 172.21.15.45:0/817537761 learned_addr learned my addr 172.21.15.45:0/817537761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7709a58640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7704155b60 0x7f7704144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 -- 172.21.15.45:0/817537761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0003b50 msgr2=0x7f77041eaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0003b50 0x7f77041eaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 -- 172.21.15.45:0/817537761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7704155b60 msgr2=0x7f7704144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7704155b60 0x7f7704144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 -- 172.21.15.45:0/817537761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77041ea5d0 con 0x7f77040c1f10 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.062+0000 7f7708a56640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040c1f10 0x7f77040c1100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f76f4004fb0 tx=0x7f76f4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.063+0000 7f76f9ffb640 1 -- 172.21.15.45:0/817537761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400f5e0 con 0x7f77040c1f10 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.063+0000 7f76f9ffb640 1 -- 172.21.15.45:0/817537761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400f760 con 0x7f77040c1f10 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.063+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770414d480 con 0x7f77040c1f10 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.063+0000 7f76f9ffb640 1 -- 172.21.15.45:0/817537761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400fb10 con 0x7f77040c1f10 2023-11-18T19:06:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.063+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77040c1640 con 0x7f77040c1f10 2023-11-18T19:06:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.064+0000 7f76f9ffb640 1 -- 172.21.15.45:0/817537761 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f76f401d460 con 0x7f77040c1f10 2023-11-18T19:06:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.064+0000 7f76f9ffb640 1 -- 172.21.15.45:0/817537761 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f76f4013510 con 0x7f77040c1f10 2023-11-18T19:06:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.065+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7704067940 con 0x7f77040c1f10 2023-11-18T19:06:18.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.068+0000 7f76f9ffb640 1 -- 172.21.15.45:0/817537761 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f76f4013720 con 0x7f77040c1f10 2023-11-18T19:06:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.141+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f77041ea810 con 0x7f77040c1f10 2023-11-18T19:06:18.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.147+0000 7f76f9ffb640 1 -- 172.21.15.45:0/817537761 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f77041ea810 con 0x7f77040c1f10 2023-11-18T19:06:18.149 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040c1f10 msgr2=0x7f77040c1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040c1f10 0x7f77040c1100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f76f4004fb0 tx=0x7f76f4001930 comp rx=0 tx=0).stop 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 shutdown_connections 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7704155b60 0x7f7704144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040c1f10 0x7f77040c1100 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 --2- 172.21.15.45:0/817537761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76f0003b50 0x7f77041eaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 >> 172.21.15.45:0/817537761 conn(0x7f77040663d0 msgr2=0x7f77040ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 shutdown_connections 2023-11-18T19:06:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:18.149+0000 7f770b4bb640 1 -- 172.21.15.45:0/817537761 wait complete. 2023-11-18T19:06:18.169 INFO:tasks.ceph:check_enable_crimson: False 2023-11-18T19:06:18.169 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-18T19:06:18.169 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:18.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-18T19:06:18.249 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:18.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-18T19:06:18.386 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:18.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-18T19:06:18.477 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:18.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-18T19:06:18.567 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:18.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-18T19:06:18.658 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:18.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-18T19:06:18.677 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:18.675+0000 7f195c232040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T19:06:18.739 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:18.738+0000 7f195c232040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T19:06:18.743 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:18.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-18T19:06:18.801 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:18.801+0000 7f481ba32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-18T19:06:18.864 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:18.863+0000 7f481ba32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-18T19:06:18.871 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:06:18.871 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-18T19:06:19.004 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new be538529-c274-4020-906b-31cab7a6bc06 0 2023-11-18T19:06:19.182 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.181+0000 7fd8ebe7c640 1 Processor -- start 2023-11-18T19:06:19.182 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.181+0000 7fd8ebe7c640 1 -- start start 2023-11-18T19:06:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ebe7c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd8e406c840 0x7fd8e40c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ebe7c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd8e4155430 0x7fd8e40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ebe7c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e40c4ef0 con 0x7fd8e414e8b0 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ebe7c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e4155010 con 0x7fd8e406c840 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ebe7c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40c5400 con 0x7fd8e4155430 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ea419640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd8e4155430 0x7fd8e40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ea419640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd8e4155430 0x7fd8e40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50462/0 (socket says 172.21.15.135:50462) 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8ea419640 1 -- 172.21.15.135:0/2141376196 learned_addr learned my addr 172.21.15.135:0/2141376196 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8e9c18640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd8e414e8b0 0x7fd8e4157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43210/0 (socket says 172.21.15.135:43210) 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.183+0000 7fd8e9417640 1 --2- 172.21.15.135:0/2141376196 >> v2:172.21.15.45:3300/0 conn(0x7fd8e406c840 0x7fd8e40c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.184+0000 7fd8ea419640 1 -- 172.21.15.135:0/2141376196 >> v2:172.21.15.45:3300/0 conn(0x7fd8e406c840 msgr2=0x7fd8e40c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.184+0000 7fd8ea419640 1 --2- 172.21.15.135:0/2141376196 >> v2:172.21.15.45:3300/0 conn(0x7fd8e406c840 0x7fd8e40c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.186 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.184+0000 7fd8ea419640 1 -- 172.21.15.135:0/2141376196 >> v1:172.21.15.135:6789/0 conn(0x7fd8e414e8b0 legacy=0x7fd8e4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.186 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.184+0000 7fd8ea419640 1 -- 172.21.15.135:0/2141376196 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40c6350 con 0x7fd8e4155430 2023-11-18T19:06:19.186 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.184+0000 7fd8e8c16640 1 -- 172.21.15.135:0/2141376196 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048636019 0 0) 0x7fd8e40c4ef0 con 0x7fd8e414e8b0 2023-11-18T19:06:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.185+0000 7fd8ea419640 1 --2- 172.21.15.135:0/2141376196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e4155430 0x7fd8e40ca360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40a9a80 tx=0x7fd8dc02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f672e0a7862e75d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.185+0000 7fd8e8c16640 1 -- 172.21.15.135:0/2141376196 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc02ca80 con 0x7fd8e4155430 2023-11-18T19:06:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.185+0000 7fd8e8c16640 1 -- 172.21.15.135:0/2141376196 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc02cbe0 con 0x7fd8e4155430 2023-11-18T19:06:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.185+0000 7fd8e8c16640 1 -- 172.21.15.135:0/2141376196 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0343f0 con 0x7fd8e4155430 2023-11-18T19:06:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.185+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/2141376196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e4155430 msgr2=0x7fd8e40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.186+0000 7fd8ebe7c640 1 --2- 172.21.15.135:0/2141376196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e4155430 0x7fd8e40ca360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40a9a80 tx=0x7fd8dc02bee0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.186+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/2141376196 shutdown_connections 2023-11-18T19:06:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.186+0000 7fd8ebe7c640 1 --2- 172.21.15.135:0/2141376196 >> v2:172.21.15.45:3300/0 conn(0x7fd8e406c840 0x7fd8e40c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.186+0000 7fd8ebe7c640 1 --2- 172.21.15.135:0/2141376196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e4155430 0x7fd8e40ca360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.186+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/2141376196 >> 172.21.15.135:0/2141376196 conn(0x7fd8e40663d0 msgr2=0x7fd8e40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.186+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/2141376196 shutdown_connections 2023-11-18T19:06:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.186+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/2141376196 wait complete. 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.187+0000 7fd8ebe7c640 1 Processor -- start 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.187+0000 7fd8ebe7c640 1 -- start start 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.188+0000 7fd8ebe7c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e406c840 0x7fd8e40ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.188+0000 7fd8ebe7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e414e8b0 0x7fd8e40ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.188+0000 7fd8ebe7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e4155430 0x7fd8e41e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.188+0000 7fd8ebe7c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e41ea180 con 0x7fd8e4155430 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.188+0000 7fd8ebe7c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e41ea460 con 0x7fd8e414e8b0 2023-11-18T19:06:19.191 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.188+0000 7fd8ebe7c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e41ea740 con 0x7fd8e406c840 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9417640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e414e8b0 0x7fd8e40ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9417640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e414e8b0 0x7fd8e40ad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50478/0 (socket says 172.21.15.135:50478) 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9417640 1 -- 172.21.15.135:0/4168008307 learned_addr learned my addr 172.21.15.135:0/4168008307 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9c18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e406c840 0x7fd8e40ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8ea419640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e4155430 0x7fd8e41e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9c18640 1 -- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e414e8b0 msgr2=0x7fd8e40ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9c18640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e414e8b0 0x7fd8e40ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9c18640 1 -- 172.21.15.135:0/4168008307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e4155430 msgr2=0x7fd8e41e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9c18640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e4155430 0x7fd8e41e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.192 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9c18640 1 -- 172.21.15.135:0/4168008307 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc009b30 con 0x7fd8e406c840 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9417640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e414e8b0 0x7fd8e40ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.189+0000 7fd8e9c18640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e406c840 0x7fd8e40ac2e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c450 tx=0x7fd8e000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.190+0000 7fd8da7fc640 1 -- 172.21.15.135:0/4168008307 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00074e0 con 0x7fd8e406c840 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.190+0000 7fd8da7fc640 1 -- 172.21.15.135:0/4168008307 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0007640 con 0x7fd8e406c840 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.190+0000 7fd8da7fc640 1 -- 172.21.15.135:0/4168008307 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0004a20 con 0x7fd8e406c840 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.190+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e41eaa20 con 0x7fd8e406c840 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.190+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e40ada60 con 0x7fd8e406c840 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.190+0000 7fd8da7fc640 1 -- 172.21.15.135:0/4168008307 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd8e0012400 con 0x7fd8e406c840 2023-11-18T19:06:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.190+0000 7fd8da7fc640 1 -- 172.21.15.135:0/4168008307 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd8e001c3f0 con 0x7fd8e406c840 2023-11-18T19:06:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.191+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e41eabb0 con 0x7fd8e406c840 2023-11-18T19:06:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.194+0000 7fd8da7fc640 1 -- 172.21.15.135:0/4168008307 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd8e0018070 con 0x7fd8e406c840 2023-11-18T19:06:19.272 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.271+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be538529-c274-4020-906b-31cab7a6bc06", "id": 0} v 0) v1 -- 0x7fd8e40747c0 con 0x7fd8e406c840 2023-11-18T19:06:19.280 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.279+0000 7fd8da7fc640 1 -- 172.21.15.135:0/4168008307 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be538529-c274-4020-906b-31cab7a6bc06", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd8e0012840 con 0x7fd8e406c840 2023-11-18T19:06:19.280 INFO:teuthology.orchestra.run.smithi135.stdout:0 2023-11-18T19:06:19.281 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.280+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e406c840 msgr2=0x7fd8e40ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.281 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.280+0000 7fd8ebe7c640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e406c840 0x7fd8e40ac2e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c450 tx=0x7fd8e000c910 comp rx=0 tx=0).stop 2023-11-18T19:06:19.281 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.280+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 shutdown_connections 2023-11-18T19:06:19.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.280+0000 7fd8ebe7c640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8e4155430 0x7fd8e41e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.280+0000 7fd8ebe7c640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e414e8b0 0x7fd8e40ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.280+0000 7fd8ebe7c640 1 --2- 172.21.15.135:0/4168008307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e406c840 0x7fd8e40ac2e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.280+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 >> 172.21.15.135:0/4168008307 conn(0x7fd8e40663d0 msgr2=0x7fd8e414b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:19.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.281+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 shutdown_connections 2023-11-18T19:06:19.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.281+0000 7fd8ebe7c640 1 -- 172.21.15.135:0/4168008307 wait complete. 2023-11-18T19:06:19.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 41e25e10-facd-48e0-831b-554f5f4c7b5f 1 2023-11-18T19:06:19.370 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.368+0000 7f195c232040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T19:06:19.434 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.433+0000 7f195c232040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T19:06:19.488 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.486+0000 7f195c232040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T19:06:19.495 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.495+0000 7eff50661640 1 Processor -- start 2023-11-18T19:06:19.496 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.495+0000 7eff50661640 1 -- start start 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.496+0000 7eff50661640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff4814e8b0 0x7eff480c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.496+0000 7eff50661640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7eff4806c840 0x7eff48157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.496+0000 7eff50661640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff481582e0 0x7eff480ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.496+0000 7eff50661640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff48155010 con 0x7eff481582e0 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.496+0000 7eff50661640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480c4ef0 con 0x7eff4806c840 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.496+0000 7eff50661640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480c5400 con 0x7eff4814e8b0 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.496+0000 7eff4e3fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff4814e8b0 0x7eff480c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.498 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4dbfc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7eff4806c840 0x7eff48157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4e3fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff4814e8b0 0x7eff480c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33814/0 (socket says 172.21.15.135:33814) 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4e3fd640 1 -- 172.21.15.135:0/2348586296 learned_addr learned my addr 172.21.15.135:0/2348586296 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4ebfe640 1 --2- 172.21.15.135:0/2348586296 >> v2:172.21.15.45:3300/0 conn(0x7eff481582e0 0x7eff480ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4dbfc640 1 -- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff4814e8b0 msgr2=0x7eff480c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4dbfc640 1 --2- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff4814e8b0 0x7eff480c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4dbfc640 1 -- 172.21.15.135:0/2348586296 >> v2:172.21.15.45:3300/0 conn(0x7eff481582e0 msgr2=0x7eff480ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4dbfc640 1 --2- 172.21.15.135:0/2348586296 >> v2:172.21.15.45:3300/0 conn(0x7eff481582e0 0x7eff480ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4dbfc640 1 -- 172.21.15.135:0/2348586296 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480c6350 con 0x7eff4806c840 2023-11-18T19:06:19.499 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.497+0000 7eff4e3fd640 1 --2- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff4814e8b0 0x7eff480c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.498+0000 7eff4dbfc640 1 --2- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff48157da0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff48067140 tx=0x7eff3802b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4798d32de66b00e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.498+0000 7eff4d3fb640 1 -- 172.21.15.135:0/2348586296 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38031520 con 0x7eff4806c840 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.498+0000 7eff4d3fb640 1 -- 172.21.15.135:0/2348586296 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38031680 con 0x7eff4806c840 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.498+0000 7eff4d3fb640 1 -- 172.21.15.135:0/2348586296 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38031a10 con 0x7eff4806c840 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 -- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 msgr2=0x7eff48157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 --2- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff48157da0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff48067140 tx=0x7eff3802b7c0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 -- 172.21.15.135:0/2348586296 shutdown_connections 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 --2- 172.21.15.135:0/2348586296 >> v2:172.21.15.45:3300/0 conn(0x7eff481582e0 0x7eff480ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 --2- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff48157da0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.502 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 --2- 172.21.15.135:0/2348586296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff4814e8b0 0x7eff480c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.502 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 -- 172.21.15.135:0/2348586296 >> 172.21.15.135:0/2348586296 conn(0x7eff480663d0 msgr2=0x7eff480667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:19.502 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 -- 172.21.15.135:0/2348586296 shutdown_connections 2023-11-18T19:06:19.502 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.499+0000 7eff50661640 1 -- 172.21.15.135:0/2348586296 wait complete. 2023-11-18T19:06:19.502 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.502+0000 7eff50661640 1 Processor -- start 2023-11-18T19:06:19.502 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.502+0000 7eff50661640 1 -- start start 2023-11-18T19:06:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.503+0000 7eff50661640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff4814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.503+0000 7eff50661640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff4814e8b0 0x7eff481edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.503+0000 7eff50661640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff481582e0 0x7eff480abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.503+0000 7eff50661640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff480c2b60 con 0x7eff4814e8b0 2023-11-18T19:06:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.503+0000 7eff50661640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff480c33c0 con 0x7eff4806c840 2023-11-18T19:06:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.503+0000 7eff50661640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff481ee600 con 0x7eff481582e0 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff4814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff4814fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50496/0 (socket says 172.21.15.135:50496) 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 -- 172.21.15.135:0/1197951945 learned_addr learned my addr 172.21.15.135:0/1197951945 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4ebfe640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff481582e0 0x7eff480abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4dbfc640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff4814e8b0 0x7eff481edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 -- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff481582e0 msgr2=0x7eff480abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff481582e0 0x7eff480abd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 -- 172.21.15.135:0/1197951945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff4814e8b0 msgr2=0x7eff481edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff4814e8b0 0x7eff481edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 -- 172.21.15.135:0/1197951945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff440094d0 con 0x7eff4806c840 2023-11-18T19:06:19.507 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4dbfc640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff4814e8b0 0x7eff481edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:19.507 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.504+0000 7eff4e3fd640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff4814fd40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e980 tx=0x7eff4400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.505+0000 7eff3effd640 1 -- 172.21.15.135:0/1197951945 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400ca00 con 0x7eff4806c840 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.505+0000 7eff3effd640 1 -- 172.21.15.135:0/1197951945 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400cb60 con 0x7eff4806c840 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.505+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff38009400 con 0x7eff4806c840 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.505+0000 7eff3effd640 1 -- 172.21.15.135:0/1197951945 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44004030 con 0x7eff4806c840 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.505+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff480c3050 con 0x7eff4806c840 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.505+0000 7eff3effd640 1 -- 172.21.15.135:0/1197951945 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff44003610 con 0x7eff4806c840 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.505+0000 7eff3effd640 1 -- 172.21.15.135:0/1197951945 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7eff44003c70 con 0x7eff4806c840 2023-11-18T19:06:19.508 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.506+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff480747c0 con 0x7eff4806c840 2023-11-18T19:06:19.509 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.509+0000 7eff3effd640 1 -- 172.21.15.135:0/1197951945 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7eff44020060 con 0x7eff4806c840 2023-11-18T19:06:19.520 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:19.519+0000 7f481ba32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-18T19:06:19.562 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.561+0000 7f195c232040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T19:06:19.582 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:19.581+0000 7f481ba32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-18T19:06:19.587 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.587+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "41e25e10-facd-48e0-831b-554f5f4c7b5f", "id": 1} v 0) v1 -- 0x7eff48151ea0 con 0x7eff4806c840 2023-11-18T19:06:19.595 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.594+0000 7eff3effd640 1 -- 172.21.15.135:0/1197951945 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "41e25e10-facd-48e0-831b-554f5f4c7b5f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7eff440135e0 con 0x7eff4806c840 2023-11-18T19:06:19.595 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-11-18T19:06:19.596 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.595+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 msgr2=0x7eff4814fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.596 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.595+0000 7eff50661640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff4814fd40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e980 tx=0x7eff4400ee40 comp rx=0 tx=0).stop 2023-11-18T19:06:19.596 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.595+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 shutdown_connections 2023-11-18T19:06:19.596 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.595+0000 7eff50661640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff481582e0 0x7eff480abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.595+0000 7eff50661640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff4814e8b0 0x7eff481edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.595+0000 7eff50661640 1 --2- 172.21.15.135:0/1197951945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff4806c840 0x7eff4814fd40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.595+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 >> 172.21.15.135:0/1197951945 conn(0x7eff480663d0 msgr2=0x7eff48157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.596+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 shutdown_connections 2023-11-18T19:06:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.596+0000 7eff50661640 1 -- 172.21.15.135:0/1197951945 wait complete. 2023-11-18T19:06:19.612 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 271297e6-5282-403f-aebb-b3a01192ea66 2 2023-11-18T19:06:19.616 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.614+0000 7f195c232040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T19:06:19.636 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:19.636+0000 7f481ba32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-18T19:06:19.702 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:19.701+0000 7f481ba32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-18T19:06:19.735 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.734+0000 7f195c232040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-18T19:06:19.754 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:19.753+0000 7f481ba32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-18T19:06:19.799 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.799+0000 7f706759e640 1 Processor -- start 2023-11-18T19:06:19.800 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.799+0000 7f706759e640 1 -- start start 2023-11-18T19:06:19.801 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.800+0000 7f706759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70681519c0 0x7f70680c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.801 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.800+0000 7f706759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706806c800 con 0x7f7068154f00 2023-11-18T19:06:19.801 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.800+0000 7f706759e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706806cec0 con 0x7f70680c66d0 2023-11-18T19:06:19.801 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.800+0000 7f706759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70681553b0 con 0x7f70681519c0 2023-11-18T19:06:19.801 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7066d9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f70680c66d0 0x7f706815ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43226/0 (socket says 172.21.15.135:43226) 2023-11-18T19:06:19.801 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7066d9d640 1 -- 172.21.15.135:0/1629126970 learned_addr learned my addr 172.21.15.135:0/1629126970 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f706659c640 1 --2- 172.21.15.135:0/1629126970 >> v2:172.21.15.45:3300/0 conn(0x7f70681519c0 0x7f70680c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201407260 0 0) 0x7f706806cec0 con 0x7f70680c66d0 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7054003520 con 0x7f70680c66d0 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3183595416 0 0) 0x7f7054003520 con 0x7f70680c66d0 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 >> v2:172.21.15.45:3300/0 conn(0x7f70681519c0 msgr2=0x7f70680c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 --2- 172.21.15.135:0/1629126970 >> v2:172.21.15.45:3300/0 conn(0x7f70681519c0 0x7f70680c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 >> v1:172.21.15.45:6789/0 conn(0x7f7068154f00 legacy=0x7f706806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680c4640 con 0x7f70680c66d0 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.801+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f70600019f0 con 0x7f70680c66d0 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 >> v1:172.21.15.135:6789/0 conn(0x7f70680c66d0 legacy=0x7f706815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7065d9b640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7054003970 0x7f7054003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7065d9b640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70540047c0 0x7f7054004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7065d9b640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7054005180 0x7f705400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70681553b0 con 0x7f7054003970 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705400c0d0 con 0x7f70540047c0 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705400c290 con 0x7f7054005180 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f705dd9b640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70540047c0 0x7f7054004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f7066d9d640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7054005180 0x7f705400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f706659c640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7054003970 0x7f7054003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f705dd9b640 1 -- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7054005180 msgr2=0x7f705400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f705dd9b640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7054005180 0x7f705400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f705dd9b640 1 -- 172.21.15.135:0/1629126970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7054003970 msgr2=0x7f7054003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:19.805 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f705dd9b640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7054003970 0x7f7054003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.806 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f705dd9b640 1 -- 172.21.15.135:0/1629126970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054003520 con 0x7f70540047c0 2023-11-18T19:06:19.806 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.802+0000 7f706659c640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7054003970 0x7f7054003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:19.806 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.803+0000 7f7066d9d640 1 -- 172.21.15.135:0/1629126970 reap_dead start 2023-11-18T19:06:19.807 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.804+0000 7f705dd9b640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70540047c0 0x7f7054004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7050001750 tx=0x7f70540057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e76d505cd5bc4fc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:19.807 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.804+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70500052d0 con 0x7f70540047c0 2023-11-18T19:06:19.807 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.804+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705002e050 con 0x7f70540047c0 2023-11-18T19:06:19.807 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.804+0000 7f7065d9b640 1 -- 172.21.15.135:0/1629126970 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050003830 con 0x7f70540047c0 2023-11-18T19:06:19.807 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.804+0000 7f706759e640 1 -- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70540047c0 msgr2=0x7f7054004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.807 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.804+0000 7f706759e640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70540047c0 0x7f7054004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7050001750 tx=0x7f70540057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.805+0000 7f706759e640 1 -- 172.21.15.135:0/1629126970 shutdown_connections 2023-11-18T19:06:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.805+0000 7f706759e640 1 --2- 172.21.15.135:0/1629126970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70540047c0 0x7f7054004c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.805+0000 7f706759e640 1 -- 172.21.15.135:0/1629126970 >> 172.21.15.135:0/1629126970 conn(0x7f70680aba30 msgr2=0x7f70680abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.805+0000 7f706759e640 1 -- 172.21.15.135:0/1629126970 shutdown_connections 2023-11-18T19:06:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.805+0000 7f706759e640 1 -- 172.21.15.135:0/1629126970 wait complete. 2023-11-18T19:06:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.806+0000 7f706759e640 1 Processor -- start 2023-11-18T19:06:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.806+0000 7f706759e640 1 -- start start 2023-11-18T19:06:19.810 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706759e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70540047c0 0x7f7068153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.810 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7068154550 0x7f70680c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.810 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706759e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7068146bd0 0x7f706814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:19.810 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7068154100 con 0x7f7068154550 2023-11-18T19:06:19.810 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706759e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706814ebf0 con 0x7f7068146bd0 2023-11-18T19:06:19.810 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706759e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706814e650 con 0x7f70540047c0 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70540047c0 0x7f7068153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70540047c0 0x7f7068153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33838/0 (socket says 172.21.15.135:33838) 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.807+0000 7f706659c640 1 -- 172.21.15.135:0/1710797720 learned_addr learned my addr 172.21.15.135:0/1710797720 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f7066d9d640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7068146bd0 0x7f706814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f705dd9b640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7068154550 0x7f70680c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f706659c640 1 -- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7068146bd0 msgr2=0x7f706814c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f706659c640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7068146bd0 0x7f706814c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f706659c640 1 -- 172.21.15.135:0/1710797720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7068154550 msgr2=0x7f70680c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f706659c640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7068154550 0x7f70680c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f706659c640 1 -- 172.21.15.135:0/1710797720 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706814e910 con 0x7f70540047c0 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f706659c640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70540047c0 0x7f7068153660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f705800f490 tx=0x7f705800f890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f705f7fe640 1 -- 172.21.15.135:0/1710797720 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058014870 con 0x7f70540047c0 2023-11-18T19:06:19.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.808+0000 7f705f7fe640 1 -- 172.21.15.135:0/1710797720 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70580149d0 con 0x7f70540047c0 2023-11-18T19:06:19.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.809+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706814be00 con 0x7f70540047c0 2023-11-18T19:06:19.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.809+0000 7f705f7fe640 1 -- 172.21.15.135:0/1710797720 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058014d40 con 0x7f70540047c0 2023-11-18T19:06:19.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.809+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7068147080 con 0x7f70540047c0 2023-11-18T19:06:19.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.809+0000 7f705f7fe640 1 -- 172.21.15.135:0/1710797720 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f705801d700 con 0x7f70540047c0 2023-11-18T19:06:19.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.809+0000 7f705f7fe640 1 -- 172.21.15.135:0/1710797720 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f705801ddd0 con 0x7f70540047c0 2023-11-18T19:06:19.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.810+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70680683a0 con 0x7f70540047c0 2023-11-18T19:06:19.813 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.812+0000 7f705f7fe640 1 -- 172.21.15.135:0/1710797720 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f705803cce0 con 0x7f70540047c0 2023-11-18T19:06:19.820 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.819+0000 7f195c232040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T19:06:19.875 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:19.874+0000 7f481ba32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-18T19:06:19.876 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.875+0000 7f195c232040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T19:06:19.891 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.890+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "271297e6-5282-403f-aebb-b3a01192ea66", "id": 2} v 0) v1 -- 0x7f70680a9d20 con 0x7f70540047c0 2023-11-18T19:06:19.898 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.897+0000 7f705f7fe640 1 -- 172.21.15.135:0/1710797720 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "271297e6-5282-403f-aebb-b3a01192ea66", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f705802b030 con 0x7f70540047c0 2023-11-18T19:06:19.898 INFO:teuthology.orchestra.run.smithi135.stdout:2 2023-11-18T19:06:19.899 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70540047c0 msgr2=0x7f7068153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70540047c0 0x7f7068153660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f705800f490 tx=0x7f705800f890 comp rx=0 tx=0).stop 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 shutdown_connections 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7068146bd0 0x7f706814c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7068154550 0x7f70680c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 --2- 172.21.15.135:0/1710797720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70540047c0 0x7f7068153660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 >> 172.21.15.135:0/1710797720 conn(0x7f70680aba30 msgr2=0x7f70680abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 shutdown_connections 2023-11-18T19:06:19.900 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:19.899+0000 7f706759e640 1 -- 172.21.15.135:0/1710797720 wait complete. 2023-11-18T19:06:19.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 7478f8b5-9e26-4735-884e-d40e38bb31bf 3 2023-11-18T19:06:19.940 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.939+0000 7f195c232040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T19:06:19.966 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:19.958+0000 7f481ba32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-18T19:06:19.998 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:19.996+0000 7f195c232040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T19:06:20.015 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:20.014+0000 7f481ba32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-18T19:06:20.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:20.080+0000 7f481ba32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-18T19:06:20.138 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:20.137+0000 7f481ba32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-18T19:06:20.154 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.153+0000 7fc387fff640 1 Processor -- start 2023-11-18T19:06:20.154 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.153+0000 7fc387fff640 1 -- start start 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc387fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388151bb0 0x7fc3880c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc387fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc388155260 0x7fc3880c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc387fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3880c8410 0x7fc38806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc387fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880c55d0 con 0x7fc3880c8410 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc387fff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc388151f90 con 0x7fc388155260 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc387fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc388154570 con 0x7fc388151bb0 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc386ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388151bb0 0x7fc3880c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.157 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc37ffff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc388155260 0x7fc3880c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc386ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388151bb0 0x7fc3880c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33844/0 (socket says 172.21.15.135:33844) 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.155+0000 7fc386ffd640 1 -- 172.21.15.135:0/3927330627 learned_addr learned my addr 172.21.15.135:0/3927330627 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.156+0000 7fc3877fe640 1 --2- 172.21.15.135:0/3927330627 >> v2:172.21.15.45:3300/0 conn(0x7fc3880c8410 0x7fc38806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.156+0000 7fc386ffd640 1 -- 172.21.15.135:0/3927330627 >> v2:172.21.15.135:3300/0 conn(0x7fc388155260 msgr2=0x7fc3880c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.156+0000 7fc386ffd640 1 --2- 172.21.15.135:0/3927330627 >> v2:172.21.15.135:3300/0 conn(0x7fc388155260 0x7fc3880c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.156+0000 7fc386ffd640 1 -- 172.21.15.135:0/3927330627 >> v2:172.21.15.45:3300/0 conn(0x7fc3880c8410 msgr2=0x7fc38806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.156+0000 7fc386ffd640 1 --2- 172.21.15.135:0/3927330627 >> v2:172.21.15.45:3300/0 conn(0x7fc3880c8410 0x7fc38806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.156+0000 7fc386ffd640 1 -- 172.21.15.135:0/3927330627 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880c4c70 con 0x7fc388151bb0 2023-11-18T19:06:20.159 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.157+0000 7fc386ffd640 1 --2- 172.21.15.135:0/3927330627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388151bb0 0x7fc3880c4730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc38808b7d0 tx=0x7fc37802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68758aa457edb2cc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.157+0000 7fc3867fc640 1 -- 172.21.15.135:0/3927330627 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378031870 con 0x7fc388151bb0 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.157+0000 7fc3867fc640 1 -- 172.21.15.135:0/3927330627 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3780319d0 con 0x7fc388151bb0 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.157+0000 7fc3867fc640 1 -- 172.21.15.135:0/3927330627 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378031d60 con 0x7fc388151bb0 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 -- 172.21.15.135:0/3927330627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388151bb0 msgr2=0x7fc3880c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 --2- 172.21.15.135:0/3927330627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388151bb0 0x7fc3880c4730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc38808b7d0 tx=0x7fc37802b910 comp rx=0 tx=0).stop 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 -- 172.21.15.135:0/3927330627 shutdown_connections 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 --2- 172.21.15.135:0/3927330627 >> v2:172.21.15.45:3300/0 conn(0x7fc3880c8410 0x7fc38806af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 --2- 172.21.15.135:0/3927330627 >> v2:172.21.15.135:3300/0 conn(0x7fc388155260 0x7fc3880c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.160 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 --2- 172.21.15.135:0/3927330627 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388151bb0 0x7fc3880c4730 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.161 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 -- 172.21.15.135:0/3927330627 >> 172.21.15.135:0/3927330627 conn(0x7fc3880abd40 msgr2=0x7fc3880ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:20.161 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 -- 172.21.15.135:0/3927330627 shutdown_connections 2023-11-18T19:06:20.161 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.158+0000 7fc387fff640 1 -- 172.21.15.135:0/3927330627 wait complete. 2023-11-18T19:06:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.160+0000 7fc387fff640 1 Processor -- start 2023-11-18T19:06:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.160+0000 7fc387fff640 1 -- start start 2023-11-18T19:06:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc387fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3880c8410 0x7fc3880aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc387fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc388151bb0 0x7fc3880ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc387fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388155260 0x7fc3880af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc387fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880acff0 con 0x7fc3880c8410 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc387fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880ad2d0 con 0x7fc388151bb0 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc387fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880ad5b0 con 0x7fc388155260 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc37ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc388151bb0 0x7fc3880ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc3877fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388155260 0x7fc3880af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc37ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc388151bb0 0x7fc3880ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50528/0 (socket says 172.21.15.135:50528) 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc37ffff640 1 -- 172.21.15.135:0/3775996890 learned_addr learned my addr 172.21.15.135:0/3775996890 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc386ffd640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3880c8410 0x7fc3880aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc3877fe640 1 -- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc388151bb0 msgr2=0x7fc3880ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc3877fe640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc388151bb0 0x7fc3880ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc3877fe640 1 -- 172.21.15.135:0/3775996890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3880c8410 msgr2=0x7fc3880aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc3877fe640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3880c8410 0x7fc3880aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc3877fe640 1 -- 172.21.15.135:0/3775996890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780094d0 con 0x7fc388155260 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.161+0000 7fc37ffff640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc388151bb0 0x7fc3880ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc3877fe640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388155260 0x7fc3880af2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc380007d40 tx=0x7fc38000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc37f7fe640 1 -- 172.21.15.135:0/3775996890 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380003990 con 0x7fc388155260 2023-11-18T19:06:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc37f7fe640 1 -- 172.21.15.135:0/3775996890 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc380003b10 con 0x7fc388155260 2023-11-18T19:06:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc37f7fe640 1 -- 172.21.15.135:0/3775996890 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380004030 con 0x7fc388155260 2023-11-18T19:06:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3880ad890 con 0x7fc388155260 2023-11-18T19:06:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3880af800 con 0x7fc388155260 2023-11-18T19:06:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc37f7fe640 1 -- 172.21.15.135:0/3775996890 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc380004490 con 0x7fc388155260 2023-11-18T19:06:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.162+0000 7fc37f7fe640 1 -- 172.21.15.135:0/3775996890 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc380004740 con 0x7fc388155260 2023-11-18T19:06:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.163+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3880addb0 con 0x7fc388155260 2023-11-18T19:06:20.167 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.166+0000 7fc37f7fe640 1 -- 172.21.15.135:0/3775996890 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc3880addb0 con 0x7fc388155260 2023-11-18T19:06:20.244 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.243+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7478f8b5-9e26-4735-884e-d40e38bb31bf", "id": 3} v 0) v1 -- 0x7fc3880683a0 con 0x7fc388155260 2023-11-18T19:06:20.250 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.249+0000 7fc37f7fe640 1 -- 172.21.15.135:0/3775996890 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7478f8b5-9e26-4735-884e-d40e38bb31bf", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc380019070 con 0x7fc388155260 2023-11-18T19:06:20.250 INFO:teuthology.orchestra.run.smithi135.stdout:3 2023-11-18T19:06:20.251 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.250+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388155260 msgr2=0x7fc3880af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.250+0000 7fc387fff640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388155260 0x7fc3880af2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc380007d40 tx=0x7fc38000e4b0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.251+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 shutdown_connections 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.251+0000 7fc387fff640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc388155260 0x7fc3880af2c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.251+0000 7fc387fff640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc388151bb0 0x7fc3880ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.251+0000 7fc387fff640 1 --2- 172.21.15.135:0/3775996890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3880c8410 0x7fc3880aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.251+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 >> 172.21.15.135:0/3775996890 conn(0x7fc3880abd40 msgr2=0x7fc3880ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.251+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 shutdown_connections 2023-11-18T19:06:20.252 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.251+0000 7fc387fff640 1 -- 172.21.15.135:0/3775996890 wait complete. 2023-11-18T19:06:20.267 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 0d3c7eca-17a4-47f2-8570-ba8482bb260e 4 2023-11-18T19:06:20.445 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.444+0000 7fe71127c640 1 Processor -- start 2023-11-18T19:06:20.445 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.444+0000 7fe71127c640 1 -- start start 2023-11-18T19:06:20.447 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe71127c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c06c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.447 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe71127c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c157c10 con 0x7fe70c1583d0 2023-11-18T19:06:20.447 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe71127c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c154ee0 con 0x7fe70c0c6e00 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe71127c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c152140 con 0x7fe70c151d60 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe70affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c06c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe70affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c06c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33856/0 (socket says 172.21.15.135:33856) 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe70affd640 1 -- 172.21.15.135:0/1078266593 learned_addr learned my addr 172.21.15.135:0/1078266593 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.446+0000 7fe7027fc640 1 --1- 172.21.15.135:0/1078266593 >> v1:172.21.15.135:6789/0 conn(0x7fe70c0c6e00 0x7fe70c154660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43240/0 (socket says 172.21.15.135:43240) 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.447+0000 7fe70affd640 1 -- 172.21.15.135:0/1078266593 >> v1:172.21.15.135:6789/0 conn(0x7fe70c0c6e00 legacy=0x7fe70c154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.447+0000 7fe70a7fc640 1 -- 172.21.15.135:0/1078266593 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437677470 0 0) 0x7fe70c154ee0 con 0x7fe70c0c6e00 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.447+0000 7fe70affd640 1 -- 172.21.15.135:0/1078266593 >> v1:172.21.15.45:6789/0 conn(0x7fe70c1583d0 legacy=0x7fe70c0c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.447+0000 7fe70affd640 1 -- 172.21.15.135:0/1078266593 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c1551c0 con 0x7fe70c151d60 2023-11-18T19:06:20.449 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.448+0000 7fe70affd640 1 --2- 172.21.15.135:0/1078266593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c06c430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0098a0 tx=0x7fe6fc02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5be8c2f8ad39bd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:20.449 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.448+0000 7fe70a7fc640 1 -- 172.21.15.135:0/1078266593 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc02f830 con 0x7fe70c151d60 2023-11-18T19:06:20.449 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.448+0000 7fe70a7fc640 1 -- 172.21.15.135:0/1078266593 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc02f990 con 0x7fe70c151d60 2023-11-18T19:06:20.449 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.448+0000 7fe70a7fc640 1 -- 172.21.15.135:0/1078266593 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc02fd20 con 0x7fe70c151d60 2023-11-18T19:06:20.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.449+0000 7fe71127c640 1 -- 172.21.15.135:0/1078266593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 msgr2=0x7fe70c06c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.449+0000 7fe71127c640 1 --2- 172.21.15.135:0/1078266593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c06c430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0098a0 tx=0x7fe6fc02ba10 comp rx=0 tx=0).stop 2023-11-18T19:06:20.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.449+0000 7fe71127c640 1 -- 172.21.15.135:0/1078266593 shutdown_connections 2023-11-18T19:06:20.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.449+0000 7fe71127c640 1 --2- 172.21.15.135:0/1078266593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c06c430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.449+0000 7fe71127c640 1 -- 172.21.15.135:0/1078266593 >> 172.21.15.135:0/1078266593 conn(0x7fe70c0c47d0 msgr2=0x7fe70c0c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.449+0000 7fe71127c640 1 -- 172.21.15.135:0/1078266593 shutdown_connections 2023-11-18T19:06:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.449+0000 7fe71127c640 1 -- 172.21.15.135:0/1078266593 wait complete. 2023-11-18T19:06:20.452 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.451+0000 7fe71127c640 1 Processor -- start 2023-11-18T19:06:20.452 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.451+0000 7fe71127c640 1 -- start start 2023-11-18T19:06:20.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe71127c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70c0c6e00 0x7fe70c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe71127c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe71127c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe70c1583d0 0x7fe70c070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe71127c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1469f0 con 0x7fe70c1583d0 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe71127c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c146c60 con 0x7fe70c0c6e00 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe71127c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1472a0 con 0x7fe70c151d60 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe7027fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe70affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70c0c6e00 0x7fe70c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe7027fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c14e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33868/0 (socket says 172.21.15.135:33868) 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe70affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70c0c6e00 0x7fe70c154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50544/0 (socket says 172.21.15.135:50544) 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.452+0000 7fe7027fc640 1 -- 172.21.15.135:0/3035843100 learned_addr learned my addr 172.21.15.135:0/3035843100 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe70b7fe640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe70c1583d0 0x7fe70c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe7027fc640 1 -- 172.21.15.135:0/3035843100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70c0c6e00 msgr2=0x7fe70c154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe7027fc640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70c0c6e00 0x7fe70c154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe7027fc640 1 -- 172.21.15.135:0/3035843100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe70c1583d0 msgr2=0x7fe70c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe7027fc640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe70c1583d0 0x7fe70c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe7027fc640 1 -- 172.21.15.135:0/3035843100 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0094d0 con 0x7fe70c151d60 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe70b7fe640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe70c1583d0 0x7fe70c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe7027fc640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c14e9e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400c420 tx=0x7fe6f400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe703fff640 1 -- 172.21.15.135:0/3035843100 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40074e0 con 0x7fe70c151d60 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe703fff640 1 -- 172.21.15.135:0/3035843100 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f4007640 con 0x7fe70c151d60 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c146fe0 con 0x7fe70c151d60 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.453+0000 7fe703fff640 1 -- 172.21.15.135:0/3035843100 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4004a00 con 0x7fe70c151d60 2023-11-18T19:06:20.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.454+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c0708b0 con 0x7fe70c151d60 2023-11-18T19:06:20.457 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.454+0000 7fe703fff640 1 -- 172.21.15.135:0/3035843100 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe6f401d3f0 con 0x7fe70c151d60 2023-11-18T19:06:20.457 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.454+0000 7fe703fff640 1 -- 172.21.15.135:0/3035843100 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe6f40138d0 con 0x7fe70c151d60 2023-11-18T19:06:20.457 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.455+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c0747c0 con 0x7fe70c151d60 2023-11-18T19:06:20.458 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.457+0000 7fe703fff640 1 -- 172.21.15.135:0/3035843100 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe6f4013bb0 con 0x7fe70c151d60 2023-11-18T19:06:20.476 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:20.474+0000 7f195c232040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-18T19:06:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.535+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d3c7eca-17a4-47f2-8570-ba8482bb260e", "id": 4} v 0) v1 -- 0x7fe70c0c2310 con 0x7fe70c151d60 2023-11-18T19:06:20.542 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.541+0000 7fe703fff640 1 -- 172.21.15.135:0/3035843100 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d3c7eca-17a4-47f2-8570-ba8482bb260e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6f4013e40 con 0x7fe70c151d60 2023-11-18T19:06:20.542 INFO:teuthology.orchestra.run.smithi135.stdout:4 2023-11-18T19:06:20.543 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.542+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 msgr2=0x7fe70c14e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.543 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.542+0000 7fe71127c640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c14e9e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400c420 tx=0x7fe6f400c8e0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.543 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.543+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 shutdown_connections 2023-11-18T19:06:20.544 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.543+0000 7fe71127c640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe70c1583d0 0x7fe70c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.544 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.543+0000 7fe71127c640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe70c151d60 0x7fe70c14e9e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.544 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.543+0000 7fe71127c640 1 --2- 172.21.15.135:0/3035843100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe70c0c6e00 0x7fe70c154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.544 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.543+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 >> 172.21.15.135:0/3035843100 conn(0x7fe70c0c47d0 msgr2=0x7fe70c0c3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:20.544 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.543+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 shutdown_connections 2023-11-18T19:06:20.544 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.543+0000 7fe71127c640 1 -- 172.21.15.135:0/3035843100 wait complete. 2023-11-18T19:06:20.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63 5 2023-11-18T19:06:20.618 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:20.617+0000 7f481ba32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-18T19:06:20.645 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:20.644+0000 7f195c232040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T19:06:20.745 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.744+0000 7faee9040640 1 Processor -- start 2023-11-18T19:06:20.746 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.745+0000 7faee9040640 1 -- start start 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee9040640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee4071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee9040640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faee4071d90 0x7faee415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee9040640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee4157c50 con 0x7faee41553b0 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee9040640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee4157f30 con 0x7faee4071d90 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee9040640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee4158210 con 0x7faee406ecc0 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee3fff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7faee41553b0 0x7faee406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43244/0 (socket says 172.21.15.135:43244) 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee3fff640 1 -- 172.21.15.135:0/3828554919 learned_addr learned my addr 172.21.15.135:0/3828554919 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faee883f640 1 --2- 172.21.15.135:0/3828554919 >> v2:172.21.15.135:3300/0 conn(0x7faee4071d90 0x7faee415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.746+0000 7faedb7fe640 1 --2- 172.21.15.135:0/3828554919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee4071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.748 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.747+0000 7faedb7fe640 1 -- 172.21.15.135:0/3828554919 >> v2:172.21.15.135:3300/0 conn(0x7faee4071d90 msgr2=0x7faee415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:20.749 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.747+0000 7faedb7fe640 1 --2- 172.21.15.135:0/3828554919 >> v2:172.21.15.135:3300/0 conn(0x7faee4071d90 0x7faee415ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.749 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.747+0000 7faee37fe640 1 -- 172.21.15.135:0/3828554919 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880993327 0 0) 0x7faee4157c50 con 0x7faee41553b0 2023-11-18T19:06:20.749 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.747+0000 7faedb7fe640 1 -- 172.21.15.135:0/3828554919 >> v1:172.21.15.135:6789/0 conn(0x7faee41553b0 legacy=0x7faee406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.749 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.747+0000 7faedb7fe640 1 -- 172.21.15.135:0/3828554919 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee41584f0 con 0x7faee406ecc0 2023-11-18T19:06:20.749 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.747+0000 7faee883f640 1 --2- 172.21.15.135:0/3828554919 >> v2:172.21.15.135:3300/0 conn(0x7faee4071d90 0x7faee415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:20.750 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.748+0000 7faedb7fe640 1 --2- 172.21.15.135:0/3828554919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee4071850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faecc0097a0 tx=0x7faecc02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43407dbb713a639 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.748+0000 7faee37fe640 1 -- 172.21.15.135:0/3828554919 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc031780 con 0x7faee406ecc0 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.748+0000 7faee37fe640 1 -- 172.21.15.135:0/3828554919 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc0318e0 con 0x7faee406ecc0 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.748+0000 7faee37fe640 1 -- 172.21.15.135:0/3828554919 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc031c70 con 0x7faee406ecc0 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 -- 172.21.15.135:0/3828554919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 msgr2=0x7faee4071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 --2- 172.21.15.135:0/3828554919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee4071850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faecc0097a0 tx=0x7faecc02b820 comp rx=0 tx=0).stop 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 -- 172.21.15.135:0/3828554919 shutdown_connections 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 --2- 172.21.15.135:0/3828554919 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee4071850 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 --2- 172.21.15.135:0/3828554919 >> v2:172.21.15.135:3300/0 conn(0x7faee4071d90 0x7faee415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 -- 172.21.15.135:0/3828554919 >> 172.21.15.135:0/3828554919 conn(0x7faee40a8810 msgr2=0x7faee40a8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:20.751 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 -- 172.21.15.135:0/3828554919 shutdown_connections 2023-11-18T19:06:20.752 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.749+0000 7faee9040640 1 -- 172.21.15.135:0/3828554919 wait complete. 2023-11-18T19:06:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.751+0000 7faee9040640 1 Processor -- start 2023-11-18T19:06:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.751+0000 7faee9040640 1 -- start start 2023-11-18T19:06:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee9040640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee406df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee9040640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4071d90 0x7faee40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee9040640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee41553b0 0x7faee40abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee9040640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee406e480 con 0x7faee41553b0 2023-11-18T19:06:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee9040640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4156a60 con 0x7faee4071d90 2023-11-18T19:06:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee9040640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee41ea590 con 0x7faee406ecc0 2023-11-18T19:06:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faedb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4071d90 0x7faee40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee406df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:33874/0 (socket says 172.21.15.135:33874) 2023-11-18T19:06:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee3fff640 1 -- 172.21.15.135:0/193172710 learned_addr learned my addr 172.21.15.135:0/193172710 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee883f640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee41553b0 0x7faee40abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faedb7fe640 1 -- 172.21.15.135:0/193172710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 msgr2=0x7faee406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faedb7fe640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee406df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faedb7fe640 1 -- 172.21.15.135:0/193172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee41553b0 msgr2=0x7faee40abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faedb7fe640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee41553b0 0x7faee40abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faedb7fe640 1 -- 172.21.15.135:0/193172710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc009400 con 0x7faee4071d90 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.752+0000 7faee883f640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee41553b0 0x7faee40abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faedb7fe640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4071d90 0x7faee40a98e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faee4158350 tx=0x7faecc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faee17fa640 1 -- 172.21.15.135:0/193172710 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc032820 con 0x7faee4071d90 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faee17fa640 1 -- 172.21.15.135:0/193172710 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc0329a0 con 0x7faee4071d90 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc009400 con 0x7faee4071d90 2023-11-18T19:06:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faee17fa640 1 -- 172.21.15.135:0/193172710 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc032d50 con 0x7faee4071d90 2023-11-18T19:06:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee41eaac0 con 0x7faee4071d90 2023-11-18T19:06:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faee17fa640 1 -- 172.21.15.135:0/193172710 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faecc045440 con 0x7faee4071d90 2023-11-18T19:06:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.753+0000 7faee17fa640 1 -- 172.21.15.135:0/193172710 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7faecc03b970 con 0x7faee4071d90 2023-11-18T19:06:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.754+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee40c6860 con 0x7faee4071d90 2023-11-18T19:06:20.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.759+0000 7faee17fa640 1 -- 172.21.15.135:0/193172710 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7faecc03b3f0 con 0x7faee4071d90 2023-11-18T19:06:20.785 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:20.785+0000 7f481ba32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-18T19:06:20.798 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:20.797+0000 7f195c232040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T19:06:20.837 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.836+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63", "id": 5} v 0) v1 -- 0x7faee40683a0 con 0x7faee4071d90 2023-11-18T19:06:20.843 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.842+0000 7faee17fa640 1 -- 172.21.15.135:0/193172710 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faecc03b590 con 0x7faee4071d90 2023-11-18T19:06:20.844 INFO:teuthology.orchestra.run.smithi135.stdout:5 2023-11-18T19:06:20.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4071d90 msgr2=0x7faee40a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:20.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4071d90 0x7faee40a98e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faee4158350 tx=0x7faecc0046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 shutdown_connections 2023-11-18T19:06:20.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee41553b0 0x7faee40abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faee4071d90 0x7faee40a98e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 --2- 172.21.15.135:0/193172710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faee406ecc0 0x7faee406df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:20.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 >> 172.21.15.135:0/193172710 conn(0x7faee40a8810 msgr2=0x7faee40a8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:20.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 shutdown_connections 2023-11-18T19:06:20.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:20.844+0000 7faee9040640 1 -- 172.21.15.135:0/193172710 wait complete. 2023-11-18T19:06:20.855 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:20.853+0000 7f195c232040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T19:06:20.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 536ff7c7-f8b4-4ab0-ab68-7f018ea09954 6 2023-11-18T19:06:20.938 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:20.937+0000 7f481ba32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-18T19:06:20.970 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:20.969+0000 7f195c232040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T19:06:20.993 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:20.993+0000 7f481ba32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-18T19:06:21.042 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.041+0000 7f9ad176c640 1 Processor -- start 2023-11-18T19:06:21.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.042+0000 7f9ad176c640 1 -- start start 2023-11-18T19:06:21.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.043+0000 7f9ad176c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9acc14fc40 0x7f9acc152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.043+0000 7f9ad176c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9acc0ab740 0x7f9acc0c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.043+0000 7f9ad176c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc0c07d0 con 0x7f9acc06dca0 2023-11-18T19:06:21.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.043+0000 7f9ad176c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc072070 con 0x7f9acc14fc40 2023-11-18T19:06:21.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.043+0000 7f9ad176c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc072310 con 0x7f9acc0ab740 2023-11-18T19:06:21.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.043+0000 7f9ac3fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9acc0ab740 0x7f9acc0c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9ac3fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9acc0ab740 0x7f9acc0c1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50570/0 (socket says 172.21.15.135:50570) 2023-11-18T19:06:21.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9ac3fff640 1 -- 172.21.15.135:0/820379745 learned_addr learned my addr 172.21.15.135:0/820379745 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:21.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9acb7fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9acc06dca0 0x7f9acc0c4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43246/0 (socket says 172.21.15.135:43246) 2023-11-18T19:06:21.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9acaffd640 1 --2- 172.21.15.135:0/820379745 >> v2:172.21.15.45:3300/0 conn(0x7f9acc14fc40 0x7f9acc152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9ac3fff640 1 -- 172.21.15.135:0/820379745 >> v2:172.21.15.45:3300/0 conn(0x7f9acc14fc40 msgr2=0x7f9acc152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9ac3fff640 1 --2- 172.21.15.135:0/820379745 >> v2:172.21.15.45:3300/0 conn(0x7f9acc14fc40 0x7f9acc152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9ac3fff640 1 -- 172.21.15.135:0/820379745 >> v1:172.21.15.135:6789/0 conn(0x7f9acc06dca0 legacy=0x7f9acc0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.044+0000 7f9ac3fff640 1 -- 172.21.15.135:0/820379745 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0725f0 con 0x7f9acc0ab740 2023-11-18T19:06:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.045+0000 7f9ac3fff640 1 --2- 172.21.15.135:0/820379745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc0c1d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9acc066da0 tx=0x7f9ab402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c7d0de01a41fe66 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.045+0000 7f9aca7fc640 1 -- 172.21.15.135:0/820379745 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40317e0 con 0x7f9acc0ab740 2023-11-18T19:06:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.045+0000 7f9aca7fc640 1 -- 172.21.15.135:0/820379745 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4031940 con 0x7f9acc0ab740 2023-11-18T19:06:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.045+0000 7f9aca7fc640 1 -- 172.21.15.135:0/820379745 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4031cd0 con 0x7f9acc0ab740 2023-11-18T19:06:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 -- 172.21.15.135:0/820379745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 msgr2=0x7f9acc0c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 --2- 172.21.15.135:0/820379745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc0c1d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9acc066da0 tx=0x7f9ab402b880 comp rx=0 tx=0).stop 2023-11-18T19:06:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 -- 172.21.15.135:0/820379745 shutdown_connections 2023-11-18T19:06:21.051 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 --2- 172.21.15.135:0/820379745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc0c1d50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.051 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 --2- 172.21.15.135:0/820379745 >> v2:172.21.15.45:3300/0 conn(0x7f9acc14fc40 0x7f9acc152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.051 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 -- 172.21.15.135:0/820379745 >> 172.21.15.135:0/820379745 conn(0x7f9acc0a7980 msgr2=0x7f9acc0a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:21.051 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 -- 172.21.15.135:0/820379745 shutdown_connections 2023-11-18T19:06:21.051 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.046+0000 7f9ad176c640 1 -- 172.21.15.135:0/820379745 wait complete. 2023-11-18T19:06:21.053 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.048+0000 7f9ad176c640 1 Processor -- start 2023-11-18T19:06:21.053 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.048+0000 7f9ad176c640 1 -- start start 2023-11-18T19:06:21.053 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ad176c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9acc06dca0 0x7f9acc14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.053 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ad176c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ad176c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14fc40 0x7f9acc1402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ad176c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1ee390 con 0x7f9acc14fc40 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ad176c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1538a0 con 0x7f9acc0ab740 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ad176c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc153b80 con 0x7f9acc06dca0 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9acc06dca0 0x7f9acc14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc13fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50586/0 (socket says 172.21.15.135:50586) 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 -- 172.21.15.135:0/2119461085 learned_addr learned my addr 172.21.15.135:0/2119461085 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9acb7fe640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14fc40 0x7f9acc1402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 -- 172.21.15.135:0/2119461085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9acc06dca0 msgr2=0x7f9acc14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.054 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9acc06dca0 0x7f9acc14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 -- 172.21.15.135:0/2119461085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14fc40 msgr2=0x7f9acc1402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14fc40 0x7f9acc1402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.049+0000 7f9ac3fff640 1 -- 172.21.15.135:0/2119461085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40094d0 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ac3fff640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc13fd90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4000c00 tx=0x7f9ab40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ac37fe640 1 -- 172.21.15.135:0/2119461085 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4032880 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ac37fe640 1 -- 172.21.15.135:0/2119461085 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4032a00 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc153e60 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ac37fe640 1 -- 172.21.15.135:0/2119461085 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4032db0 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc154680 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ac37fe640 1 -- 172.21.15.135:0/2119461085 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9ab404e750 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.050+0000 7f9ac37fe640 1 -- 172.21.15.135:0/2119461085 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f9ab4045ce0 con 0x7f9acc0ab740 2023-11-18T19:06:21.055 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.051+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc066b80 con 0x7f9acc0ab740 2023-11-18T19:06:21.056 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.055+0000 7f9ac37fe640 1 -- 172.21.15.135:0/2119461085 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9ab402e070 con 0x7f9acc0ab740 2023-11-18T19:06:21.088 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:21.087+0000 7f195c232040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T19:06:21.111 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:21.110+0000 7f481ba32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-18T19:06:21.135 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.134+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "536ff7c7-f8b4-4ab0-ab68-7f018ea09954", "id": 6} v 0) v1 -- 0x7f9acc06d9c0 con 0x7f9acc0ab740 2023-11-18T19:06:21.141 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.141+0000 7f9ac37fe640 1 -- 172.21.15.135:0/2119461085 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "536ff7c7-f8b4-4ab0-ab68-7f018ea09954", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ab404eb40 con 0x7f9acc0ab740 2023-11-18T19:06:21.142 INFO:teuthology.orchestra.run.smithi135.stdout:6 2023-11-18T19:06:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.142+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 msgr2=0x7f9acc13fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.142+0000 7f9ad176c640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc13fd90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4000c00 tx=0x7f9ab40046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.142+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 shutdown_connections 2023-11-18T19:06:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.142+0000 7f9ad176c640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9acc14fc40 0x7f9acc1402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.142+0000 7f9ad176c640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9acc0ab740 0x7f9acc13fd90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.142+0000 7f9ad176c640 1 --2- 172.21.15.135:0/2119461085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9acc06dca0 0x7f9acc14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.142+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 >> 172.21.15.135:0/2119461085 conn(0x7f9acc0a7980 msgr2=0x7f9acc0c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.143+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 shutdown_connections 2023-11-18T19:06:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.143+0000 7f9ad176c640 1 -- 172.21.15.135:0/2119461085 wait complete. 2023-11-18T19:06:21.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e 7 2023-11-18T19:06:21.229 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:21.228+0000 7f481ba32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-18T19:06:21.256 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:21.255+0000 7f195c232040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T19:06:21.308 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:21.307+0000 7f195c232040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T19:06:21.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.338+0000 7f03d1ef8640 1 Processor -- start 2023-11-18T19:06:21.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.338+0000 7f03d1ef8640 1 -- start start 2023-11-18T19:06:21.340 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.339+0000 7f03d1ef8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03cc154f00 0x7f03cc15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.340 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.339+0000 7f03d1ef8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc06c800 con 0x7f03cc1519c0 2023-11-18T19:06:21.340 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.339+0000 7f03d1ef8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc06cec0 con 0x7f03cc0c7bc0 2023-11-18T19:06:21.340 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.339+0000 7f03d1ef8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0c8070 con 0x7f03cc154f00 2023-11-18T19:06:21.341 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cbfff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f03cc0c7bc0 0x7f03cc0c66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43260/0 (socket says 172.21.15.135:43260) 2023-11-18T19:06:21.341 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cbfff640 1 -- 172.21.15.135:0/2254026096 learned_addr learned my addr 172.21.15.135:0/2254026096 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03d16f7640 1 --2- 172.21.15.135:0/2254026096 >> v2:172.21.15.45:3300/0 conn(0x7f03cc154f00 0x7f03cc15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547485790 0 0) 0x7f03cc06cec0 con 0x7f03cc0c7bc0 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03bc003520 con 0x7f03cc0c7bc0 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 488842823 0 0) 0x7f03bc003520 con 0x7f03cc0c7bc0 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 >> v2:172.21.15.45:3300/0 conn(0x7f03cc154f00 msgr2=0x7f03cc15fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 --2- 172.21.15.135:0/2254026096 >> v2:172.21.15.45:3300/0 conn(0x7f03cc154f00 0x7f03cc15fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 >> v1:172.21.15.45:6789/0 conn(0x7f03cc1519c0 legacy=0x7f03cc06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0c4640 con 0x7f03cc0c7bc0 2023-11-18T19:06:21.343 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f03b8001670 con 0x7f03cc0c7bc0 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 >> v1:172.21.15.135:6789/0 conn(0x7f03cc0c7bc0 legacy=0x7f03cc0c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03bc003970 0x7f03bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03bc0047c0 0x7f03bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.340+0000 7f03cb7fe640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc005180 0x7f03bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0c8070 con 0x7f03bc003970 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc00c020 con 0x7f03bc005180 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc00c1e0 con 0x7f03bc0047c0 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cbfff640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03bc0047c0 0x7f03bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03d16f7640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc005180 0x7f03bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03d0ef6640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03bc003970 0x7f03bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.344 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cbfff640 1 -- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc005180 msgr2=0x7f03bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:21.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cbfff640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc005180 0x7f03bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cbfff640 1 -- 172.21.15.135:0/2254026096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03bc003970 msgr2=0x7f03bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:21.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cbfff640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03bc003970 0x7f03bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03cbfff640 1 -- 172.21.15.135:0/2254026096 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc003520 con 0x7f03bc0047c0 2023-11-18T19:06:21.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03d16f7640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc005180 0x7f03bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:21.345 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.341+0000 7f03d16f7640 1 -- 172.21.15.135:0/2254026096 reap_dead start 2023-11-18T19:06:21.346 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.343+0000 7f03cbfff640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03bc0047c0 0x7f03bc004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03b800c240 tx=0x7f03bc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edeee9248860d83f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:21.346 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.343+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8005ad0 con 0x7f03bc0047c0 2023-11-18T19:06:21.346 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.343+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b8005c50 con 0x7f03bc0047c0 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.343+0000 7f03cb7fe640 1 -- 172.21.15.135:0/2254026096 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b802c830 con 0x7f03bc0047c0 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.344+0000 7f03d1ef8640 1 -- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03bc0047c0 msgr2=0x7f03bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.344+0000 7f03d1ef8640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03bc0047c0 0x7f03bc004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03b800c240 tx=0x7f03bc0057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.344+0000 7f03d1ef8640 1 -- 172.21.15.135:0/2254026096 shutdown_connections 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.344+0000 7f03d1ef8640 1 --2- 172.21.15.135:0/2254026096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03bc0047c0 0x7f03bc004c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.344+0000 7f03d1ef8640 1 -- 172.21.15.135:0/2254026096 >> 172.21.15.135:0/2254026096 conn(0x7f03cc0aba30 msgr2=0x7f03cc0abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.344+0000 7f03d1ef8640 1 -- 172.21.15.135:0/2254026096 shutdown_connections 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.344+0000 7f03d1ef8640 1 -- 172.21.15.135:0/2254026096 wait complete. 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.346+0000 7f03d1ef8640 1 Processor -- start 2023-11-18T19:06:21.347 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.346+0000 7f03d1ef8640 1 -- start start 2023-11-18T19:06:21.349 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.346+0000 7f03d1ef8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc0047c0 0x7f03cc155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.346+0000 7f03d1ef8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03cc1535b0 0x7f03cc1e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d1ef8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03cc1ea4d0 0x7f03cc1ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d1ef8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc158440 con 0x7f03cc1535b0 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d1ef8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0af980 con 0x7f03bc0047c0 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d1ef8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc1511e0 con 0x7f03cc1ea4d0 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc0047c0 0x7f03cc155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d16f7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03cc1ea4d0 0x7f03cc1ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc0047c0 0x7f03cc155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50600/0 (socket says 172.21.15.135:50600) 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 -- 172.21.15.135:0/1987750355 learned_addr learned my addr 172.21.15.135:0/1987750355 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03cbfff640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03cc1535b0 0x7f03cc1e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.350 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 -- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03cc1ea4d0 msgr2=0x7f03cc1ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03cc1ea4d0 0x7f03cc1ed390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 -- 172.21.15.135:0/1987750355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03cc1535b0 msgr2=0x7f03cc1e9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03cc1535b0 0x7f03cc1e9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 -- 172.21.15.135:0/1987750355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc158670 con 0x7f03bc0047c0 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d16f7640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03cc1ea4d0 0x7f03cc1ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.347+0000 7f03d0ef6640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc0047c0 0x7f03cc155ea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e850 tx=0x7f03c000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.348+0000 7f03c97fa640 1 -- 172.21.15.135:0/1987750355 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0003b80 con 0x7f03bc0047c0 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.348+0000 7f03c97fa640 1 -- 172.21.15.135:0/1987750355 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0003ce0 con 0x7f03bc0047c0 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.348+0000 7f03c97fa640 1 -- 172.21.15.135:0/1987750355 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c00052f0 con 0x7f03bc0047c0 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.348+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc0af610 con 0x7f03bc0047c0 2023-11-18T19:06:21.351 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.348+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc1542a0 con 0x7f03bc0047c0 2023-11-18T19:06:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.348+0000 7f03c97fa640 1 -- 172.21.15.135:0/1987750355 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f03c000c6c0 con 0x7f03bc0047c0 2023-11-18T19:06:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.348+0000 7f03c97fa640 1 -- 172.21.15.135:0/1987750355 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f03c001d460 con 0x7f03bc0047c0 2023-11-18T19:06:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.349+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc0af470 con 0x7f03bc0047c0 2023-11-18T19:06:21.352 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.351+0000 7f03c97fa640 1 -- 172.21.15.135:0/1987750355 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f03cc0af470 con 0x7f03bc0047c0 2023-11-18T19:06:21.398 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:21.397+0000 7f481ba32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-18T19:06:21.430 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.429+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e", "id": 7} v 0) v1 -- 0x7f03cc0683a0 con 0x7f03bc0047c0 2023-11-18T19:06:21.436 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.435+0000 7f03c97fa640 1 -- 172.21.15.135:0/1987750355 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f03c0001810 con 0x7f03bc0047c0 2023-11-18T19:06:21.436 INFO:teuthology.orchestra.run.smithi135.stdout:7 2023-11-18T19:06:21.437 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.436+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc0047c0 msgr2=0x7f03cc155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.436+0000 7f03d1ef8640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc0047c0 0x7f03cc155ea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e850 tx=0x7f03c000ed10 comp rx=0 tx=0).stop 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.437+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 shutdown_connections 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.437+0000 7f03d1ef8640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f03cc1ea4d0 0x7f03cc1ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.437+0000 7f03d1ef8640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03cc1535b0 0x7f03cc1e9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.437+0000 7f03d1ef8640 1 --2- 172.21.15.135:0/1987750355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03bc0047c0 0x7f03cc155ea0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.437+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 >> 172.21.15.135:0/1987750355 conn(0x7f03cc0aba30 msgr2=0x7f03cc0abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.437+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 shutdown_connections 2023-11-18T19:06:21.438 INFO:teuthology.orchestra.run.smithi135.stderr:2023-11-18T19:06:21.437+0000 7f03d1ef8640 1 -- 172.21.15.135:0/1987750355 wait complete. 2023-11-18T19:06:21.451 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:21.451+0000 7f481ba32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-18T19:06:21.453 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-18T19:06:21.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-18T19:06:21.461 INFO:tasks.ceph.osd.0:Started 2023-11-18T19:06:21.461 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-18T19:06:21.462 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-18T19:06:21.468 INFO:tasks.ceph.osd.1:Started 2023-11-18T19:06:21.468 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-18T19:06:21.468 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-18T19:06:21.474 INFO:tasks.ceph.osd.2:Started 2023-11-18T19:06:21.474 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-18T19:06:21.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-18T19:06:21.482 INFO:tasks.ceph.osd.3:Started 2023-11-18T19:06:21.482 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-18T19:06:21.482 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-18T19:06:21.483 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:21.481+0000 7f195c232040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T19:06:21.491 INFO:tasks.ceph.osd.4:Started 2023-11-18T19:06:21.491 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-18T19:06:21.492 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-18T19:06:21.500 INFO:tasks.ceph.osd.5:Started 2023-11-18T19:06:21.500 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-18T19:06:21.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-18T19:06:21.506 INFO:tasks.ceph.osd.6:Started 2023-11-18T19:06:21.506 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-18T19:06:21.506 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-18T19:06:21.513 INFO:tasks.ceph.osd.7:Started 2023-11-18T19:06:21.513 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:21.626 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:21.625+0000 7f481ba32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-18T19:06:21.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.750+0000 7f8d54d89640 1 Processor -- start 2023-11-18T19:06:21.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.750+0000 7f8d54d89640 1 -- start start 2023-11-18T19:06:21.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.751+0000 7f8d54d89640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d500a4d30 0x7f8d50152320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.751+0000 7f8d54d89640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500a54a0 con 0x7f8d50152860 2023-11-18T19:06:21.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.751+0000 7f8d54d89640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5006d5d0 con 0x7f8d5014c4e0 2023-11-18T19:06:21.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.751+0000 7f8d54d89640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5006d8b0 con 0x7f8d500a4d30 2023-11-18T19:06:21.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d4ed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8d50152860 0x7f8d5015cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51300/0 (socket says 172.21.15.45:51300) 2023-11-18T19:06:21.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d4ed9d640 1 -- 172.21.15.45:0/1172806447 learned_addr learned my addr 172.21.15.45:0/1172806447 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:21.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d45d9b640 1 --2- 172.21.15.45:0/1172806447 >> v2:172.21.15.45:3300/0 conn(0x7f8d500a4d30 0x7f8d50152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d4dd9b640 1 -- 172.21.15.45:0/1172806447 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319222532 0 0) 0x7f8d500a54a0 con 0x7f8d50152860 2023-11-18T19:06:21.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d4dd9b640 1 -- 172.21.15.45:0/1172806447 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d3c003520 con 0x7f8d50152860 2023-11-18T19:06:21.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d4dd9b640 1 -- 172.21.15.45:0/1172806447 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840895716 0 0) 0x7f8d5006d5d0 con 0x7f8d5014c4e0 2023-11-18T19:06:21.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d4dd9b640 1 -- 172.21.15.45:0/1172806447 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d500a54a0 con 0x7f8d5014c4e0 2023-11-18T19:06:21.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d45d9b640 1 -- 172.21.15.45:0/1172806447 >> v1:172.21.15.135:6789/0 conn(0x7f8d5014c4e0 legacy=0x7f8d500c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d45d9b640 1 -- 172.21.15.45:0/1172806447 >> v1:172.21.15.45:6789/0 conn(0x7f8d50152860 legacy=0x7f8d5015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.752+0000 7f8d45d9b640 1 -- 172.21.15.45:0/1172806447 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5006db90 con 0x7f8d500a4d30 2023-11-18T19:06:21.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.753+0000 7f8d45d9b640 1 --2- 172.21.15.45:0/1172806447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d500a4d30 0x7f8d50152320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d380097a0 tx=0x7f8d3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d555b61806f85641 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:21.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d4dd9b640 1 -- 172.21.15.45:0/1172806447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38030610 con 0x7f8d500a4d30 2023-11-18T19:06:21.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d4dd9b640 1 -- 172.21.15.45:0/1172806447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d38030770 con 0x7f8d500a4d30 2023-11-18T19:06:21.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d4dd9b640 1 -- 172.21.15.45:0/1172806447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38030b00 con 0x7f8d500a4d30 2023-11-18T19:06:21.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d54d89640 1 -- 172.21.15.45:0/1172806447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d500a4d30 msgr2=0x7f8d50152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d54d89640 1 --2- 172.21.15.45:0/1172806447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d500a4d30 0x7f8d50152320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d380097a0 tx=0x7f8d3802b960 comp rx=0 tx=0).stop 2023-11-18T19:06:21.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d54d89640 1 -- 172.21.15.45:0/1172806447 shutdown_connections 2023-11-18T19:06:21.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d54d89640 1 --2- 172.21.15.45:0/1172806447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d500a4d30 0x7f8d50152320 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d54d89640 1 -- 172.21.15.45:0/1172806447 >> 172.21.15.45:0/1172806447 conn(0x7f8d5006a500 msgr2=0x7f8d5006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:21.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d54d89640 1 -- 172.21.15.45:0/1172806447 shutdown_connections 2023-11-18T19:06:21.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.754+0000 7f8d54d89640 1 -- 172.21.15.45:0/1172806447 wait complete. 2023-11-18T19:06:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.756+0000 7f8d54d89640 1 Processor -- start 2023-11-18T19:06:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.756+0000 7f8d54d89640 1 -- start start 2023-11-18T19:06:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d54d89640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d500a4d30 0x7f8d50151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d54d89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5014c4e0 0x7f8d50155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d54d89640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d50152860 0x7f8d501eb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d54d89640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50153ec0 con 0x7f8d5014c4e0 2023-11-18T19:06:21.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d54d89640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50154760 con 0x7f8d50152860 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d54d89640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50154480 con 0x7f8d500a4d30 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d45d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5014c4e0 0x7f8d50155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d45d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5014c4e0 0x7f8d50155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57628/0 (socket says 172.21.15.45:57628) 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d45d9b640 1 -- 172.21.15.45:0/4131258891 learned_addr learned my addr 172.21.15.45:0/4131258891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d4e59c640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d500a4d30 0x7f8d50151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.757+0000 7f8d4ed9d640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d50152860 0x7f8d501eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d45d9b640 1 -- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d500a4d30 msgr2=0x7f8d50151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d45d9b640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d500a4d30 0x7f8d50151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d45d9b640 1 -- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d50152860 msgr2=0x7f8d501eb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d45d9b640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d50152860 0x7f8d501eb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d45d9b640 1 -- 172.21.15.45:0/4131258891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009400 con 0x7f8d5014c4e0 2023-11-18T19:06:21.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d45d9b640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5014c4e0 0x7f8d50155ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d3802bf70 tx=0x7f8d38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:21.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d477fe640 1 -- 172.21.15.45:0/4131258891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3803e040 con 0x7f8d5014c4e0 2023-11-18T19:06:21.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d477fe640 1 -- 172.21.15.45:0/4131258891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d38039980 con 0x7f8d5014c4e0 2023-11-18T19:06:21.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d50153870 con 0x7f8d5014c4e0 2023-11-18T19:06:21.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d477fe640 1 -- 172.21.15.45:0/4131258891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38039d30 con 0x7f8d5014c4e0 2023-11-18T19:06:21.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.758+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d50151ea0 con 0x7f8d5014c4e0 2023-11-18T19:06:21.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.759+0000 7f8d477fe640 1 -- 172.21.15.45:0/4131258891 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8d3804e740 con 0x7f8d5014c4e0 2023-11-18T19:06:21.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.759+0000 7f8d477fe640 1 -- 172.21.15.45:0/4131258891 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8d38044d20 con 0x7f8d5014c4e0 2023-11-18T19:06:21.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.759+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d500747c0 con 0x7f8d5014c4e0 2023-11-18T19:06:21.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.762+0000 7f8d477fe640 1 -- 172.21.15.45:0/4131258891 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8d38049070 con 0x7f8d5014c4e0 2023-11-18T19:06:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.826+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d500c4da0 con 0x7f8d5014c4e0 2023-11-18T19:06:21.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.827+0000 7f8d477fe640 1 -- 172.21.15.45:0/4131258891 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8d38034070 con 0x7f8d5014c4e0 2023-11-18T19:06:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:21.829 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:21.431825+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5014c4e0 msgr2=0x7f8d50155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5014c4e0 0x7f8d50155ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d3802bf70 tx=0x7f8d38004730 comp rx=0 tx=0).stop 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 shutdown_connections 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d50152860 0x7f8d501eb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5014c4e0 0x7f8d50155ef0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 --2- 172.21.15.45:0/4131258891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d500a4d30 0x7f8d50151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 >> 172.21.15.45:0/4131258891 conn(0x7f8d5006a500 msgr2=0x7f8d50147520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 shutdown_connections 2023-11-18T19:06:21.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:21.828+0000 7f8d54d89640 1 -- 172.21.15.45:0/4131258891 wait complete. 2023-11-18T19:06:21.846 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-18T19:06:21.846 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-18T19:06:22.173 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-11-18T19:06:22.172+0000 7f60c960f500 -1 Falling back to public interface 2023-11-18T19:06:22.178 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-18T19:06:22.177+0000 7f1b1de13500 -1 Falling back to public interface 2023-11-18T19:06:22.190 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-18T19:06:22.189+0000 7f0bcd8ad500 -1 Falling back to public interface 2023-11-18T19:06:22.199 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-18T19:06:22.198+0000 7f94dae0c500 -1 Falling back to public interface 2023-11-18T19:06:22.204 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-11-18T19:06:22.204+0000 7f5c43e13500 -1 Falling back to public interface 2023-11-18T19:06:22.217 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-11-18T19:06:22.217+0000 7fcbf7a1a500 -1 Falling back to public interface 2023-11-18T19:06:22.221 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-11-18T19:06:22.221+0000 7ff364e02500 -1 Falling back to public interface 2023-11-18T19:06:22.222 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-11-18T19:06:22.222+0000 7ff363da9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6820/0: (98) Address already in use 2023-11-18T19:06:22.224 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-18T19:06:22.223+0000 7fabff4ad500 -1 Falling back to public interface 2023-11-18T19:06:22.621 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:22.620+0000 7f195c232040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T19:06:22.652 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:22.718 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:22.717+0000 7f481ba32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-18T19:06:22.836 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.834+0000 7fb5ac7fb640 1 Processor -- start 2023-11-18T19:06:22.836 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.834+0000 7fb5ac7fb640 1 -- start start 2023-11-18T19:06:22.837 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5ac7fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a4155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5ac7fb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5a40c4910 0x7fb5a40c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5ac7fb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a406c6a0 con 0x7fb5a4151c90 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5ac7fb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a40c56a0 con 0x7fb5a40c4910 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5ac7fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a40ac8c0 con 0x7fb5a40c7fb0 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5aad98640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5a40c4910 0x7fb5a40c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5a9d96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a4155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5a9d96640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a4155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:54330/0 (socket says 172.21.15.45:54330) 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5aa597640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb5a4151c90 0x7fb5a41583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:45016/0 (socket says 172.21.15.45:45016) 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5a9d96640 1 -- 172.21.15.45:0/1452345144 learned_addr learned my addr 172.21.15.45:0/1452345144 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:22.838 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.836+0000 7fb5aad98640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5a40c4910 0x7fb5a40c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:59888/0 (socket says 172.21.15.45:59888) 2023-11-18T19:06:22.839 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.837+0000 7fb5a9d96640 1 -- 172.21.15.45:0/1452345144 >> v2:172.21.15.135:3300/0 conn(0x7fb5a40c4910 msgr2=0x7fb5a40c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:22.839 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.837+0000 7fb5a9d96640 1 --2- 172.21.15.45:0/1452345144 >> v2:172.21.15.135:3300/0 conn(0x7fb5a40c4910 0x7fb5a40c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.840 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.837+0000 7fb5a9d96640 1 -- 172.21.15.45:0/1452345144 >> v1:172.21.15.135:6789/0 conn(0x7fb5a4151c90 legacy=0x7fb5a41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:22.840 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.837+0000 7fb5a9d96640 1 -- 172.21.15.45:0/1452345144 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a40ac020 con 0x7fb5a40c7fb0 2023-11-18T19:06:22.840 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.838+0000 7fb5a9d96640 1 --2- 172.21.15.45:0/1452345144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a4155190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb598009870 tx=0x7fb59802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baf980c739081d26 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:22.840 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.838+0000 7fb5a9595640 1 -- 172.21.15.45:0/1452345144 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598030840 con 0x7fb5a40c7fb0 2023-11-18T19:06:22.840 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.838+0000 7fb5a9595640 1 -- 172.21.15.45:0/1452345144 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980309a0 con 0x7fb5a40c7fb0 2023-11-18T19:06:22.840 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.838+0000 7fb5a9595640 1 -- 172.21.15.45:0/1452345144 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598030d30 con 0x7fb5a40c7fb0 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/1452345144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 msgr2=0x7fb5a4155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 --2- 172.21.15.45:0/1452345144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a4155190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb598009870 tx=0x7fb59802b980 comp rx=0 tx=0).stop 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/1452345144 shutdown_connections 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 --2- 172.21.15.45:0/1452345144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a4155190 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 --2- 172.21.15.45:0/1452345144 >> v2:172.21.15.135:3300/0 conn(0x7fb5a40c4910 0x7fb5a40c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/1452345144 >> 172.21.15.45:0/1452345144 conn(0x7fb5a4071e10 msgr2=0x7fb5a4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/1452345144 shutdown_connections 2023-11-18T19:06:22.841 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.839+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/1452345144 wait complete. 2023-11-18T19:06:22.842 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.840+0000 7fb5ac7fb640 1 Processor -- start 2023-11-18T19:06:22.842 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.841+0000 7fb5ac7fb640 1 -- start start 2023-11-18T19:06:22.843 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.841+0000 7fb5ac7fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5a40c4910 0x7fb5a40c1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:22.843 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.841+0000 7fb5ac7fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a41ee130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:22.843 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.841+0000 7fb5ac7fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a4151c90 0x7fb5a4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:22.843 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.841+0000 7fb5ac7fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a40c3460 con 0x7fb5a40c4910 2023-11-18T19:06:22.843 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.841+0000 7fb5ac7fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a41ee670 con 0x7fb5a4151c90 2023-11-18T19:06:22.843 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.841+0000 7fb5ac7fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a41ea630 con 0x7fb5a40c7fb0 2023-11-18T19:06:22.843 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aa597640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5a40c4910 0x7fb5a40c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:22.844 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a4151c90 0x7fb5a4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:22.844 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a4151c90 0x7fb5a4156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:59904/0 (socket says 172.21.15.45:59904) 2023-11-18T19:06:22.844 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 -- 172.21.15.45:0/155315938 learned_addr learned my addr 172.21.15.45:0/155315938 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:22.844 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5a9d96640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a41ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:22.845 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 -- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 msgr2=0x7fb5a41ee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:22.845 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a41ee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.845 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 -- 172.21.15.45:0/155315938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5a40c4910 msgr2=0x7fb5a40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:22.845 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5a40c4910 0x7fb5a40c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.845 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.842+0000 7fb5aad98640 1 -- 172.21.15.45:0/155315938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980094d0 con 0x7fb5a4151c90 2023-11-18T19:06:22.845 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb5aad98640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a4151c90 0x7fb5a4156d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00efc0 tx=0x7fb59c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:22.845 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb596ffd640 1 -- 172.21.15.45:0/155315938 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c009ba0 con 0x7fb5a4151c90 2023-11-18T19:06:22.846 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb596ffd640 1 -- 172.21.15.45:0/155315938 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c00f040 con 0x7fb5a4151c90 2023-11-18T19:06:22.846 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a414e010 con 0x7fb5a4151c90 2023-11-18T19:06:22.846 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb596ffd640 1 -- 172.21.15.45:0/155315938 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0146c0 con 0x7fb5a4151c90 2023-11-18T19:06:22.846 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a414e5d0 con 0x7fb5a4151c90 2023-11-18T19:06:22.846 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb596ffd640 1 -- 172.21.15.45:0/155315938 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb59c014b20 con 0x7fb5a4151c90 2023-11-18T19:06:22.846 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.843+0000 7fb596ffd640 1 -- 172.21.15.45:0/155315938 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb59c014dd0 con 0x7fb5a4151c90 2023-11-18T19:06:22.846 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.844+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a40c62f0 con 0x7fb5a4151c90 2023-11-18T19:06:22.848 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.847+0000 7fb596ffd640 1 -- 172.21.15.45:0/155315938 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb59c018020 con 0x7fb5a4151c90 2023-11-18T19:06:22.914 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.913+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5a41517d0 con 0x7fb5a4151c90 2023-11-18T19:06:22.916 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.914+0000 7fb596ffd640 1 -- 172.21.15.45:0/155315938 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb59c01d400 con 0x7fb5a4151c90 2023-11-18T19:06:22.916 INFO:teuthology.misc.health.smithi045.stdout: 2023-11-18T19:06:22.916 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:21.431825+0000","last_up_change":"0.000000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a4151c90 msgr2=0x7fb5a4156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a4151c90 0x7fb5a4156d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00efc0 tx=0x7fb59c00c490 comp rx=0 tx=0).stop 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 shutdown_connections 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a4151c90 0x7fb5a4156d80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a40c7fb0 0x7fb5a41ee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 --2- 172.21.15.45:0/155315938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5a40c4910 0x7fb5a40c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 >> 172.21.15.45:0/155315938 conn(0x7fb5a4071e10 msgr2=0x7fb5a40721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 shutdown_connections 2023-11-18T19:06:22.918 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:22.916+0000 7fb5ac7fb640 1 -- 172.21.15.45:0/155315938 wait complete. 2023-11-18T19:06:22.931 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-18T19:06:22.949 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:22.948+0000 7f195c232040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T19:06:23.012 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:23.011+0000 7f195c232040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T19:06:23.050 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:23.049+0000 7f481ba32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-18T19:06:23.115 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:23.114+0000 7f481ba32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-18T19:06:23.133 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:23.132+0000 7f195c232040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T19:06:23.236 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-11-18T19:06:23.235+0000 7f481ba32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-18T19:06:24.166 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:24.164+0000 7f18fce95640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-18T19:06:24.174 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-18T19:06:24.173+0000 7f18fce95640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-18T19:06:24.748 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-11-18T19:06:24.748+0000 7fcbf7a1a500 -1 osd.7 0 log_to_monitors true 2023-11-18T19:06:25.543 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-18T19:06:25.542+0000 7fabff4ad500 -1 osd.2 0 log_to_monitors true 2023-11-18T19:06:25.692 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-11-18T19:06:25.691+0000 7f60c960f500 -1 osd.4 0 log_to_monitors true 2023-11-18T19:06:25.728 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-11-18T19:06:25.727+0000 7f5c43e13500 -1 osd.6 0 log_to_monitors true 2023-11-18T19:06:25.762 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-11-18T19:06:25.761+0000 7ff364e02500 -1 osd.5 0 log_to_monitors true 2023-11-18T19:06:25.785 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-18T19:06:25.784+0000 7f1b1de13500 -1 osd.0 0 log_to_monitors true 2023-11-18T19:06:25.798 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-18T19:06:25.797+0000 7f94dae0c500 -1 osd.1 0 log_to_monitors true 2023-11-18T19:06:25.799 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-18T19:06:25.797+0000 7f0bcd8ad500 -1 osd.3 0 log_to_monitors true 2023-11-18T19:06:27.144 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-11-18T19:06:27.143+0000 7fcbf3405640 -1 osd.7 0 waiting for initial osdmap 2023-11-18T19:06:27.154 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-11-18T19:06:27.153+0000 7fcbeb22c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:28.444 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-11-18T19:06:28.439+0000 7f5c3ff67640 -1 osd.6 0 waiting for initial osdmap 2023-11-18T19:06:28.450 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-11-18T19:06:28.448+0000 7f5c3757a640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:28.482 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-11-18T19:06:28.480+0000 7f60c4ece640 -1 osd.4 0 waiting for initial osdmap 2023-11-18T19:06:28.496 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-11-18T19:06:28.494+0000 7f60bccf5640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:28.496 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-11-18T19:06:28.494+0000 7ff360d90640 -1 osd.5 0 waiting for initial osdmap 2023-11-18T19:06:28.504 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-11-18T19:06:28.502+0000 7ff358bb7640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:28.701 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-18T19:06:28.699+0000 7f1b19753640 -1 osd.0 0 waiting for initial osdmap 2023-11-18T19:06:28.707 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-18T19:06:28.706+0000 7f1b1157a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:28.741 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-18T19:06:28.739+0000 7f0bca04f640 -1 osd.3 0 waiting for initial osdmap 2023-11-18T19:06:28.748 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-18T19:06:28.747+0000 7f0bc1662640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:28.785 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-18T19:06:28.783+0000 7fabfb43b640 -1 osd.2 0 waiting for initial osdmap 2023-11-18T19:06:28.789 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-18T19:06:28.787+0000 7f94d688d640 -1 osd.1 0 waiting for initial osdmap 2023-11-18T19:06:28.791 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-18T19:06:28.790+0000 7fabf3262640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:28.794 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-18T19:06:28.793+0000 7f94ce6b4640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-18T19:06:29.737 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:29.930 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.929+0000 7f28ff646640 1 Processor -- start 2023-11-18T19:06:29.930 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.930+0000 7f28ff646640 1 -- start start 2023-11-18T19:06:29.932 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.931+0000 7f28ff646640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28f80a5030 0x7f28f814f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:29.932 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.931+0000 7f28ff646640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28f814fdd0 0x7f28f806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:29.932 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.931+0000 7f28ff646640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f806de10 0x7f28f81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:29.932 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.931+0000 7f28ff646640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f8072b50 con 0x7f28f814fdd0 2023-11-18T19:06:29.932 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.931+0000 7f28ff646640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80c4d70 con 0x7f28f80a5030 2023-11-18T19:06:29.932 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.931+0000 7f28ff646640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80c5050 con 0x7f28f806de10 2023-11-18T19:06:29.932 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28f814fdd0 0x7f28f806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:29.933 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28f814fdd0 0x7f28f806d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49864/0 (socket says 172.21.15.45:49864) 2023-11-18T19:06:29.933 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 -- 172.21.15.45:0/622429245 learned_addr learned my addr 172.21.15.45:0/622429245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:29.933 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fd3e2640 1 --2- 172.21.15.45:0/622429245 >> v2:172.21.15.135:3300/0 conn(0x7f28f80a5030 0x7f28f814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:29.933 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fdbe3640 1 --2- 172.21.15.45:0/622429245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f806de10 0x7f28f81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:29.934 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 -- 172.21.15.45:0/622429245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f806de10 msgr2=0x7f28f81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:29.934 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 --2- 172.21.15.45:0/622429245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f806de10 0x7f28f81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:29.934 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 -- 172.21.15.45:0/622429245 >> v2:172.21.15.135:3300/0 conn(0x7f28f80a5030 msgr2=0x7f28f814f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:29.934 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 --2- 172.21.15.45:0/622429245 >> v2:172.21.15.135:3300/0 conn(0x7f28f80a5030 0x7f28f814f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:29.934 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fcbe1640 1 -- 172.21.15.45:0/622429245 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80c5330 con 0x7f28f814fdd0 2023-11-18T19:06:29.935 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.932+0000 7f28fdbe3640 1 --2- 172.21.15.45:0/622429245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f806de10 0x7f28f81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:29.935 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.933+0000 7f28fcbe1640 1 --2- 172.21.15.45:0/622429245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f814fdd0 0x7f28f806d8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f28f8067d80 tx=0x7f28e802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d3f88529729ce1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:29.935 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.933+0000 7f28effff640 1 -- 172.21.15.45:0/622429245 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8031860 con 0x7f28f814fdd0 2023-11-18T19:06:29.935 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.933+0000 7f28effff640 1 -- 172.21.15.45:0/622429245 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e80319c0 con 0x7f28f814fdd0 2023-11-18T19:06:29.935 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28effff640 1 -- 172.21.15.45:0/622429245 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8031d50 con 0x7f28f814fdd0 2023-11-18T19:06:29.936 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 -- 172.21.15.45:0/622429245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f814fdd0 msgr2=0x7f28f806d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:29.936 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 --2- 172.21.15.45:0/622429245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f814fdd0 0x7f28f806d8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f28f8067d80 tx=0x7f28e802b900 comp rx=0 tx=0).stop 2023-11-18T19:06:29.936 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 -- 172.21.15.45:0/622429245 shutdown_connections 2023-11-18T19:06:29.936 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 --2- 172.21.15.45:0/622429245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f806de10 0x7f28f81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:29.936 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 --2- 172.21.15.45:0/622429245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f814fdd0 0x7f28f806d8d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:29.936 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 --2- 172.21.15.45:0/622429245 >> v2:172.21.15.135:3300/0 conn(0x7f28f80a5030 0x7f28f814f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:29.936 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 -- 172.21.15.45:0/622429245 >> 172.21.15.45:0/622429245 conn(0x7f28f80a7a80 msgr2=0x7f28f80a7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:29.937 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 -- 172.21.15.45:0/622429245 shutdown_connections 2023-11-18T19:06:29.937 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.934+0000 7f28ff646640 1 -- 172.21.15.45:0/622429245 wait complete. 2023-11-18T19:06:29.938 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.936+0000 7f28ff646640 1 Processor -- start 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.936+0000 7f28ff646640 1 -- start start 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.937+0000 7f28ff646640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28f806de10 0x7f28f8071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.937+0000 7f28ff646640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f80a5030 0x7f28f81ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.937+0000 7f28ff646640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f814fdd0 0x7f28f81eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.937+0000 7f28ff646640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f814b920 con 0x7f28f80a5030 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.937+0000 7f28ff646640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f814b400 con 0x7f28f806de10 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.937+0000 7f28ff646640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f814aad0 con 0x7f28f814fdd0 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f80a5030 0x7f28f81ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f80a5030 0x7f28f81ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49868/0 (socket says 172.21.15.45:49868) 2023-11-18T19:06:29.939 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 -- 172.21.15.45:0/1360134040 learned_addr learned my addr 172.21.15.45:0/1360134040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fd3e2640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28f806de10 0x7f28f8071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fdbe3640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f814fdd0 0x7f28f81eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 -- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f814fdd0 msgr2=0x7f28f81eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f814fdd0 0x7f28f81eddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 -- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28f806de10 msgr2=0x7f28f8071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28f806de10 0x7f28f8071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 -- 172.21.15.45:0/1360134040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80094d0 con 0x7f28f80a5030 2023-11-18T19:06:29.940 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.938+0000 7f28fcbe1640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f80a5030 0x7f28f81ed890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f28e802b940 tx=0x7f28e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:29.941 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.939+0000 7f28edffb640 1 -- 172.21.15.45:0/1360134040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e803ad30 con 0x7f28f80a5030 2023-11-18T19:06:29.941 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.939+0000 7f28edffb640 1 -- 172.21.15.45:0/1360134040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e80443f0 con 0x7f28f80a5030 2023-11-18T19:06:29.942 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.939+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f814adb0 con 0x7f28f80a5030 2023-11-18T19:06:29.942 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.939+0000 7f28edffb640 1 -- 172.21.15.45:0/1360134040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80447a0 con 0x7f28f80a5030 2023-11-18T19:06:29.942 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.939+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f814a7d0 con 0x7f28f80a5030 2023-11-18T19:06:29.942 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.940+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f8068460 con 0x7f28f80a5030 2023-11-18T19:06:29.942 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.941+0000 7f28edffb640 1 -- 172.21.15.45:0/1360134040 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f28e8044900 con 0x7f28f80a5030 2023-11-18T19:06:29.943 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.942+0000 7f28edffb640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f28dc06adb0 0x7f28dc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:29.943 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.942+0000 7f28edffb640 1 -- 172.21.15.45:0/1360134040 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f28e80ab600 con 0x7f28f80a5030 2023-11-18T19:06:29.943 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.942+0000 7f28fd3e2640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f28dc06adb0 0x7f28dc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:29.943 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.943+0000 7f28fd3e2640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f28dc06adb0 0x7f28dc06d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f28f4006fd0 tx=0x7f28f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:29.947 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:29.947+0000 7f28edffb640 1 -- 172.21.15.45:0/1360134040 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28e8076c60 con 0x7f28f80a5030 2023-11-18T19:06:30.143 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.143+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28f814e470 con 0x7f28f80a5030 2023-11-18T19:06:30.145 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.144+0000 7f28edffb640 1 -- 172.21.15.45:0/1360134040 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10919 (secure 0 0 0) 0x7f28e8035090 con 0x7f28f80a5030 2023-11-18T19:06:30.145 INFO:teuthology.misc.health.smithi045.stdout: 2023-11-18T19:06:30.145 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":15,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:29.435799+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:30.148 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f28dc06adb0 msgr2=0x7f28dc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.148 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f28dc06adb0 0x7f28dc06d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f28f4006fd0 tx=0x7f28f4008040 comp rx=0 tx=0).stop 2023-11-18T19:06:30.148 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f80a5030 msgr2=0x7f28f81ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.148 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f80a5030 0x7f28f81ed890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f28e802b940 tx=0x7f28e80046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.148 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 shutdown_connections 2023-11-18T19:06:30.149 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f28dc06adb0 0x7f28dc06d270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.149 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28f814fdd0 0x7f28f81eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.149 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f80a5030 0x7f28f81ed890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.149 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 --2- 172.21.15.45:0/1360134040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28f806de10 0x7f28f8071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.149 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 >> 172.21.15.45:0/1360134040 conn(0x7f28f80a7a80 msgr2=0x7f28f80721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:30.149 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 shutdown_connections 2023-11-18T19:06:30.149 INFO:teuthology.misc.health.smithi045.stderr:2023-11-18T19:06:30.147+0000 7f28ff646640 1 -- 172.21.15.45:0/1360134040 wait complete. 2023-11-18T19:06:30.161 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-18T19:06:30.161 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-18T19:06:30.161 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-18T19:06:30.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-18T19:06:30.166 INFO:tasks.ceph.mds.a:Started 2023-11-18T19:06:30.166 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-18T19:06:30.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-18T19:06:30.171 INFO:tasks.ceph.mds.c:Started 2023-11-18T19:06:30.171 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-18T19:06:30.171 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-18T19:06:30.182 INFO:tasks.ceph.mds.b:Started 2023-11-18T19:06:30.182 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-18T19:06:30.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-18T19:06:30.190 INFO:tasks.ceph.mds.d:Started 2023-11-18T19:06:30.191 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-18T19:06:30.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:30.319 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-18T19:06:30.319 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-18T19:06:30.349 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-11-18T19:06:30.351 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-11-18T19:06:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.372+0000 7f20819a9640 1 Processor -- start 2023-11-18T19:06:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.373+0000 7f20819a9640 1 -- start start 2023-11-18T19:06:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f20819a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f207c151c00 0x7f207c0c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f20819a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f20819a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f207c0bd590 0x7f207c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f20819a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207c0c5610 con 0x7f207c0bd590 2023-11-18T19:06:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f20819a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207c0cac50 con 0x7f207c151c00 2023-11-18T19:06:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f20819a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0ca200 con 0x7f207c0c7e00 2023-11-18T19:06:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f207b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f207c0bd590 0x7f207c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f207b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f207c0bd590 0x7f207c154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49910/0 (socket says 172.21.15.45:49910) 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.374+0000 7f207b7fe640 1 -- 172.21.15.45:0/1612507708 learned_addr learned my addr 172.21.15.45:0/1612507708 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f2073fff640 1 --2- 172.21.15.45:0/1612507708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f207affd640 1 --2- 172.21.15.45:0/1612507708 >> v2:172.21.15.135:3300/0 conn(0x7f207c151c00 0x7f207c0c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f207b7fe640 1 -- 172.21.15.45:0/1612507708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 msgr2=0x7f207c1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f207b7fe640 1 --2- 172.21.15.45:0/1612507708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f207b7fe640 1 -- 172.21.15.45:0/1612507708 >> v2:172.21.15.135:3300/0 conn(0x7f207c151c00 msgr2=0x7f207c0c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f207b7fe640 1 --2- 172.21.15.45:0/1612507708 >> v2:172.21.15.135:3300/0 conn(0x7f207c151c00 0x7f207c0c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f207b7fe640 1 -- 172.21.15.45:0/1612507708 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c151fe0 con 0x7f207c0bd590 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f2073fff640 1 --2- 172.21.15.45:0/1612507708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.375+0000 7f207affd640 1 --2- 172.21.15.45:0/1612507708 >> v2:172.21.15.135:3300/0 conn(0x7f207c151c00 0x7f207c0c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.376+0000 7f207b7fe640 1 --2- 172.21.15.45:0/1612507708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c0bd590 0x7f207c154b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f207c06c480 tx=0x7f207402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3da170b56d8f59f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.376+0000 7f207a7fc640 1 -- 172.21.15.45:0/1612507708 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207402c9f0 con 0x7f207c0bd590 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.376+0000 7f207a7fc640 1 -- 172.21.15.45:0/1612507708 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207402cb50 con 0x7f207c0bd590 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.376+0000 7f207a7fc640 1 -- 172.21.15.45:0/1612507708 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740343f0 con 0x7f207c0bd590 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 -- 172.21.15.45:0/1612507708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c0bd590 msgr2=0x7f207c154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 --2- 172.21.15.45:0/1612507708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c0bd590 0x7f207c154b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f207c06c480 tx=0x7f207402be50 comp rx=0 tx=0).stop 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 -- 172.21.15.45:0/1612507708 shutdown_connections 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 --2- 172.21.15.45:0/1612507708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c0bd590 0x7f207c154b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 --2- 172.21.15.45:0/1612507708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 --2- 172.21.15.45:0/1612507708 >> v2:172.21.15.135:3300/0 conn(0x7f207c151c00 0x7f207c0c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 -- 172.21.15.45:0/1612507708 >> 172.21.15.45:0/1612507708 conn(0x7f207c0663d0 msgr2=0x7f207c0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 -- 172.21.15.45:0/1612507708 shutdown_connections 2023-11-18T19:06:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.377+0000 7f20819a9640 1 -- 172.21.15.45:0/1612507708 wait complete. 2023-11-18T19:06:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.378+0000 7f20819a9640 1 Processor -- start 2023-11-18T19:06:30.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.379+0000 7f20819a9640 1 -- start start 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.379+0000 7f20819a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c0bd590 0x7f207c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.379+0000 7f20819a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.379+0000 7f20819a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c151c00 0x7f207c0bd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.379+0000 7f20819a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0af1e0 con 0x7f207c151c00 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.379+0000 7f20819a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0c3b30 con 0x7f207c0bd590 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.379+0000 7f20819a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0af430 con 0x7f207c0c7e00 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c151c00 0x7f207c0bd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c151c00 0x7f207c0bd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49924/0 (socket says 172.21.15.45:49924) 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 -- 172.21.15.45:0/1480177450 learned_addr learned my addr 172.21.15.45:0/1480177450 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207affd640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c0bd590 0x7f207c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f2073fff640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 -- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 msgr2=0x7f207c1ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 -- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c0bd590 msgr2=0x7f207c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c0bd590 0x7f207c150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.380+0000 7f207b7fe640 1 -- 172.21.15.45:0/1480177450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2074009b30 con 0x7f207c151c00 2023-11-18T19:06:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.381+0000 7f207b7fe640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c151c00 0x7f207c0bd970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2074036040 tx=0x7f2074004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.381+0000 7f2078ff9640 1 -- 172.21.15.45:0/1480177450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074009510 con 0x7f207c151c00 2023-11-18T19:06:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.381+0000 7f2078ff9640 1 -- 172.21.15.45:0/1480177450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207403e450 con 0x7f207c151c00 2023-11-18T19:06:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.381+0000 7f2078ff9640 1 -- 172.21.15.45:0/1480177450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207403e800 con 0x7f207c151c00 2023-11-18T19:06:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.381+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c0bf130 con 0x7f207c151c00 2023-11-18T19:06:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.381+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c0bf6f0 con 0x7f207c151c00 2023-11-18T19:06:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.382+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c0bf910 con 0x7f207c151c00 2023-11-18T19:06:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.383+0000 7f2078ff9640 1 -- 172.21.15.45:0/1480177450 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f207403e960 con 0x7f207c151c00 2023-11-18T19:06:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.384+0000 7f2078ff9640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205c06ade0 0x7f205c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.384+0000 7f2078ff9640 1 -- 172.21.15.45:0/1480177450 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f20740abe70 con 0x7f207c151c00 2023-11-18T19:06:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.384+0000 7f207affd640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205c06ade0 0x7f205c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.385+0000 7f207affd640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205c06ade0 0x7f205c06d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f207c0af190 tx=0x7f206c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.389+0000 7f2078ff9640 1 -- 172.21.15.45:0/1480177450 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2074077430 con 0x7f207c151c00 2023-11-18T19:06:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.583+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f207c0747c0 con 0x7f207c151c00 2023-11-18T19:06:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.584+0000 7f2078ff9640 1 -- 172.21.15.45:0/1480177450 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11080 (secure 0 0 0) 0x7f207407aa50 con 0x7f207c151c00 2023-11-18T19:06:30.584 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:30.585 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:30.439854+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205c06ade0 msgr2=0x7f205c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205c06ade0 0x7f205c06d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f207c0af190 tx=0x7f206c008040 comp rx=0 tx=0).stop 2023-11-18T19:06:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c151c00 msgr2=0x7f207c0bd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c151c00 0x7f207c0bd970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2074036040 tx=0x7f2074004a40 comp rx=0 tx=0).stop 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 shutdown_connections 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207c151c00 0x7f207c0bd970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205c06ade0 0x7f205c06d2a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f207c0c7e00 0x7f207c1ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 --2- 172.21.15.45:0/1480177450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207c0bd590 0x7f207c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.586+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 >> 172.21.15.45:0/1480177450 conn(0x7f207c0663d0 msgr2=0x7f207c14e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.587+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 shutdown_connections 2023-11-18T19:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.587+0000 7f20819a9640 1 -- 172.21.15.45:0/1480177450 wait complete. 2023-11-18T19:06:30.603 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-18T19:06:30.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:06:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.824+0000 7fa31f59e640 1 Processor -- start 2023-11-18T19:06:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.824+0000 7fa31f59e640 1 -- start start 2023-11-18T19:06:30.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.826+0000 7fa31f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa32014e580 0x7fa3200c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.826+0000 7fa31f59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa320155510 con 0x7fa3200bd520 2023-11-18T19:06:30.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.826+0000 7fa31f59e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa320154f90 con 0x7fa3200c7d90 2023-11-18T19:06:30.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.826+0000 7fa31f59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200ca4d0 con 0x7fa32014e580 2023-11-18T19:06:30.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.826+0000 7fa31dd9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa3200bd520 0x7fa320157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45772/0 (socket says 172.21.15.45:45772) 2023-11-18T19:06:30.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.826+0000 7fa31dd9b640 1 -- 172.21.15.45:0/925986600 learned_addr learned my addr 172.21.15.45:0/925986600 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:30.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.826+0000 7fa31e59c640 1 --2- 172.21.15.45:0/925986600 >> v2:172.21.15.45:3300/0 conn(0x7fa32014e580 0x7fa3200c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.827+0000 7fa31d59a640 1 -- 172.21.15.45:0/925986600 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179807427 0 0) 0x7fa320155510 con 0x7fa3200bd520 2023-11-18T19:06:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.827+0000 7fa31d59a640 1 -- 172.21.15.45:0/925986600 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa308003520 con 0x7fa3200bd520 2023-11-18T19:06:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.827+0000 7fa31e59c640 1 -- 172.21.15.45:0/925986600 >> v1:172.21.15.135:6789/0 conn(0x7fa3200c7d90 legacy=0x7fa320158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.827+0000 7fa31e59c640 1 -- 172.21.15.45:0/925986600 >> v1:172.21.15.45:6789/0 conn(0x7fa3200bd520 legacy=0x7fa320157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.827+0000 7fa31e59c640 1 -- 172.21.15.45:0/925986600 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32006cbb0 con 0x7fa32014e580 2023-11-18T19:06:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.828+0000 7fa31e59c640 1 --2- 172.21.15.45:0/925986600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa32014e580 0x7fa3200c4810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa3100097a0 tx=0x7fa31002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91aabaddf8fbff22 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.828+0000 7fa31d59a640 1 -- 172.21.15.45:0/925986600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31002e070 con 0x7fa32014e580 2023-11-18T19:06:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.828+0000 7fa31d59a640 1 -- 172.21.15.45:0/925986600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3100315a0 con 0x7fa32014e580 2023-11-18T19:06:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.828+0000 7fa31d59a640 1 -- 172.21.15.45:0/925986600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310031930 con 0x7fa32014e580 2023-11-18T19:06:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.829+0000 7fa31f59e640 1 -- 172.21.15.45:0/925986600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa32014e580 msgr2=0x7fa3200c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.829+0000 7fa31f59e640 1 --2- 172.21.15.45:0/925986600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa32014e580 0x7fa3200c4810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa3100097a0 tx=0x7fa31002b840 comp rx=0 tx=0).stop 2023-11-18T19:06:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.829+0000 7fa31f59e640 1 -- 172.21.15.45:0/925986600 shutdown_connections 2023-11-18T19:06:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.829+0000 7fa31f59e640 1 --2- 172.21.15.45:0/925986600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa32014e580 0x7fa3200c4810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.829+0000 7fa31f59e640 1 -- 172.21.15.45:0/925986600 >> 172.21.15.45:0/925986600 conn(0x7fa320066610 msgr2=0x7fa320066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.829+0000 7fa31f59e640 1 -- 172.21.15.45:0/925986600 shutdown_connections 2023-11-18T19:06:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.829+0000 7fa31f59e640 1 -- 172.21.15.45:0/925986600 wait complete. 2023-11-18T19:06:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.831+0000 7fa31f59e640 1 Processor -- start 2023-11-18T19:06:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.831+0000 7fa31f59e640 1 -- start start 2023-11-18T19:06:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3200bd520 0x7fa3201dde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3200c7d90 0x7fa3201eb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa32014e580 0x7fa3201eb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c3890 con 0x7fa3200c7d90 2023-11-18T19:06:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31f59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201e18f0 con 0x7fa3200bd520 2023-11-18T19:06:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c29c0 con 0x7fa32014e580 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3200c7d90 0x7fa3201eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3200c7d90 0x7fa3201eb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49930/0 (socket says 172.21.15.45:49930) 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.832+0000 7fa31dd9b640 1 -- 172.21.15.45:0/3619004164 learned_addr learned my addr 172.21.15.45:0/3619004164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31e59c640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3200bd520 0x7fa3201dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31dd9b640 1 -- 172.21.15.45:0/3619004164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa32014e580 msgr2=0x7fa3201eb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31dd9b640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa32014e580 0x7fa3201eb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31dd9b640 1 -- 172.21.15.45:0/3619004164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3200bd520 msgr2=0x7fa3201dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31dd9b640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3200bd520 0x7fa3201dde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31dd9b640 1 -- 172.21.15.45:0/3619004164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310009400 con 0x7fa3200c7d90 2023-11-18T19:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31dd9b640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3200c7d90 0x7fa3201eb390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c410 tx=0x7fa31400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:30.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa30effd640 1 -- 172.21.15.45:0/3619004164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314005ce0 con 0x7fa3200c7d90 2023-11-18T19:06:30.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa30effd640 1 -- 172.21.15.45:0/3619004164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314005e40 con 0x7fa3200c7d90 2023-11-18T19:06:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa30effd640 1 -- 172.21.15.45:0/3619004164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140072f0 con 0x7fa3200c7d90 2023-11-18T19:06:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200c2c10 con 0x7fa3200c7d90 2023-11-18T19:06:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.833+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3200c31d0 con 0x7fa3200c7d90 2023-11-18T19:06:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.834+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3201eb0b0 con 0x7fa3200c7d90 2023-11-18T19:06:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.835+0000 7fa30effd640 1 -- 172.21.15.45:0/3619004164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fa314007450 con 0x7fa3200c7d90 2023-11-18T19:06:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.837+0000 7fa30effd640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa30006adb0 0x7fa30006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.837+0000 7fa30effd640 1 -- 172.21.15.45:0/3619004164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fa3140885e0 con 0x7fa3200c7d90 2023-11-18T19:06:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.837+0000 7fa31e59c640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa30006adb0 0x7fa30006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:30.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.838+0000 7fa31e59c640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa30006adb0 0x7fa30006d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa310036000 tx=0x7fa31003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:30.841+0000 7fa30effd640 1 -- 172.21.15.45:0/3619004164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3201eb0b0 con 0x7fa3200c7d90 2023-11-18T19:06:31.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.073+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3201eb0b0 con 0x7fa3200c7d90 2023-11-18T19:06:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.074+0000 7fa30effd640 1 -- 172.21.15.45:0/3619004164 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fa314017540 con 0x7fa3200c7d90 2023-11-18T19:06:31.074 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:31.074 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-18T19:06:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 2 2023-11-18T19:06:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa30006adb0 msgr2=0x7fa30006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa30006adb0 0x7fa30006d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa310036000 tx=0x7fa31003d040 comp rx=0 tx=0).stop 2023-11-18T19:06:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3200c7d90 msgr2=0x7fa3201eb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3200c7d90 0x7fa3201eb390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c410 tx=0x7fa31400c8d0 comp rx=0 tx=0).stop 2023-11-18T19:06:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 shutdown_connections 2023-11-18T19:06:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa30006adb0 0x7fa30006d270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa32014e580 0x7fa3201eb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3200c7d90 0x7fa3201eb390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 --2- 172.21.15.45:0/3619004164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3200bd520 0x7fa3201dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.076+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 >> 172.21.15.45:0/3619004164 conn(0x7fa320066610 msgr2=0x7fa3200aa460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.077+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 shutdown_connections 2023-11-18T19:06:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:31.077+0000 7fa31f59e640 1 -- 172.21.15.45:0/3619004164 wait complete. 2023-11-18T19:06:33.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:06:33.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.301+0000 7f4044814640 1 Processor -- start 2023-11-18T19:06:33.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.301+0000 7f4044814640 1 -- start start 2023-11-18T19:06:33.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.303+0000 7f4044814640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f4040157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.303+0000 7f4044814640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4040155510 con 0x7f40400c7d90 2023-11-18T19:06:33.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.303+0000 7f4044814640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4040154f90 con 0x7f404014e580 2023-11-18T19:06:33.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.303+0000 7f4044814640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400ca4d0 con 0x7f40400bd520 2023-11-18T19:06:33.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.303+0000 7f403ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f40400c7d90 0x7f4040158190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52664/0 (socket says 172.21.15.45:52664) 2023-11-18T19:06:33.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.303+0000 7f403ffff640 1 -- 172.21.15.45:0/3762776984 learned_addr learned my addr 172.21.15.45:0/3762776984 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:33.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.303+0000 7f4037fff640 1 --2- 172.21.15.45:0/3762776984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f4040157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.304+0000 7f403effd640 1 -- 172.21.15.45:0/3762776984 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964022531 0 0) 0x7f4040155510 con 0x7f40400c7d90 2023-11-18T19:06:33.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.304+0000 7f403effd640 1 -- 172.21.15.45:0/3762776984 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f402c003520 con 0x7f40400c7d90 2023-11-18T19:06:33.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.304+0000 7f403effd640 1 -- 172.21.15.45:0/3762776984 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693065683 0 0) 0x7f402c003520 con 0x7f40400c7d90 2023-11-18T19:06:33.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.304+0000 7f4037fff640 1 -- 172.21.15.45:0/3762776984 >> v1:172.21.15.135:6789/0 conn(0x7f404014e580 legacy=0x7f40400c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.304+0000 7f4037fff640 1 -- 172.21.15.45:0/3762776984 >> v1:172.21.15.45:6789/0 conn(0x7f40400c7d90 legacy=0x7f4040158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.304+0000 7f4037fff640 1 -- 172.21.15.45:0/3762776984 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404006cbb0 con 0x7f40400bd520 2023-11-18T19:06:33.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.306+0000 7f4037fff640 1 --2- 172.21.15.45:0/3762776984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f4040157c50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f40280097d0 tx=0x7f402802b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65c48006f88e07c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:33.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.306+0000 7f403effd640 1 -- 172.21.15.45:0/3762776984 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40380019f0 con 0x7f40400bd520 2023-11-18T19:06:33.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.306+0000 7f403effd640 1 -- 172.21.15.45:0/3762776984 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402802e050 con 0x7f40400bd520 2023-11-18T19:06:33.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.306+0000 7f403effd640 1 -- 172.21.15.45:0/3762776984 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028030710 con 0x7f40400bd520 2023-11-18T19:06:33.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.307+0000 7f4044814640 1 -- 172.21.15.45:0/3762776984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 msgr2=0x7f4040157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.307+0000 7f4044814640 1 --2- 172.21.15.45:0/3762776984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f4040157c50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f40280097d0 tx=0x7f402802b5d0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.307+0000 7f4044814640 1 -- 172.21.15.45:0/3762776984 shutdown_connections 2023-11-18T19:06:33.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.307+0000 7f4044814640 1 --2- 172.21.15.45:0/3762776984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f4040157c50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.307+0000 7f4044814640 1 -- 172.21.15.45:0/3762776984 >> 172.21.15.45:0/3762776984 conn(0x7f4040066610 msgr2=0x7f4040066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:33.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.307+0000 7f4044814640 1 -- 172.21.15.45:0/3762776984 shutdown_connections 2023-11-18T19:06:33.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.307+0000 7f4044814640 1 -- 172.21.15.45:0/3762776984 wait complete. 2023-11-18T19:06:33.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.308+0000 7f4044814640 1 Processor -- start 2023-11-18T19:06:33.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.309+0000 7f4044814640 1 -- start start 2023-11-18T19:06:33.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.309+0000 7f4044814640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f40400bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.309+0000 7f4044814640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40400c7d90 0x7f40401e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.309+0000 7f4044814640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f404014e580 0x7f40401e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f4044814640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40401e7900 con 0x7f404014e580 2023-11-18T19:06:33.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f4044814640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40400bd900 con 0x7f40400c7d90 2023-11-18T19:06:33.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f4044814640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400bdb50 con 0x7f40400bd520 2023-11-18T19:06:33.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f404014e580 0x7f40401e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f404014e580 0x7f40401e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34204/0 (socket says 172.21.15.45:34204) 2023-11-18T19:06:33.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 -- 172.21.15.45:0/68111401 learned_addr learned my addr 172.21.15.45:0/68111401 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403f7fe640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f40400bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f4037fff640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40400c7d90 0x7f40401e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 -- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 msgr2=0x7f40400bebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f40400bebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 -- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40400c7d90 msgr2=0x7f40401e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40400c7d90 0x7f40401e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f403ffff640 1 -- 172.21.15.45:0/68111401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028009400 con 0x7f404014e580 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.310+0000 7f4037fff640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40400c7d90 0x7f40401e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:33.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.311+0000 7f403ffff640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f404014e580 0x7f40401e73c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f403800c8c0 tx=0x7f403800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:33.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.311+0000 7f403cff9640 1 -- 172.21.15.45:0/68111401 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800a640 con 0x7f404014e580 2023-11-18T19:06:33.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.311+0000 7f403cff9640 1 -- 172.21.15.45:0/68111401 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403800a7c0 con 0x7f404014e580 2023-11-18T19:06:33.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.311+0000 7f403cff9640 1 -- 172.21.15.45:0/68111401 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800ab70 con 0x7f404014e580 2023-11-18T19:06:33.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.312+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40400bde30 con 0x7f404014e580 2023-11-18T19:06:33.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.312+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40400be3f0 con 0x7f404014e580 2023-11-18T19:06:33.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.313+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4040067910 con 0x7f404014e580 2023-11-18T19:06:33.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.314+0000 7f403cff9640 1 -- 172.21.15.45:0/68111401 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f403800acd0 con 0x7f404014e580 2023-11-18T19:06:33.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.315+0000 7f403cff9640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f402006ae30 0x7f402006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.315+0000 7f403cff9640 1 -- 172.21.15.45:0/68111401 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4038088ad0 con 0x7f404014e580 2023-11-18T19:06:33.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.320+0000 7f403cff9640 1 -- 172.21.15.45:0/68111401 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4038054120 con 0x7f404014e580 2023-11-18T19:06:33.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.322+0000 7f403f7fe640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f402006ae30 0x7f402006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.322+0000 7f403f7fe640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f402006ae30 0x7f402006d2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4030000f60 tx=0x7f4030009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:33.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.559+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4040158870 con 0x7f404014e580 2023-11-18T19:06:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.560+0000 7f403cff9640 1 -- 172.21.15.45:0/68111401 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f4038018020 con 0x7f404014e580 2023-11-18T19:06:33.560 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:33.561 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-18T19:06:33.561 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-11-18T19:06:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f402006ae30 msgr2=0x7f402006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f402006ae30 0x7f402006d2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4030000f60 tx=0x7f4030009040 comp rx=0 tx=0).stop 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f404014e580 msgr2=0x7f40401e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f404014e580 0x7f40401e73c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f403800c8c0 tx=0x7f403800cd80 comp rx=0 tx=0).stop 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 shutdown_connections 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f404014e580 0x7f40401e73c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40400c7d90 0x7f40401e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f402006ae30 0x7f402006d2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 --2- 172.21.15.45:0/68111401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f40400bd520 0x7f40400bebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 >> 172.21.15.45:0/68111401 conn(0x7f4040066610 msgr2=0x7f4040157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 shutdown_connections 2023-11-18T19:06:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.563+0000 7f4044814640 1 -- 172.21.15.45:0/68111401 wait complete. 2023-11-18T19:06:33.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:33.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.772+0000 7fd788c47640 1 Processor -- start 2023-11-18T19:06:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.772+0000 7fd788c47640 1 -- start start 2023-11-18T19:06:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.774+0000 7fd788c47640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd78414e580 0x7fd7840c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.774+0000 7fd788c47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840bd520 0x7fd784157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.774+0000 7fd788c47640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd784155510 con 0x7fd7840c7d90 2023-11-18T19:06:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.774+0000 7fd788c47640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd784154f90 con 0x7fd78414e580 2023-11-18T19:06:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.774+0000 7fd788c47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840ca4d0 con 0x7fd7840bd520 2023-11-18T19:06:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.774+0000 7fd7837fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd78414e580 0x7fd7840c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.774+0000 7fd77affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840bd520 0x7fd784157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.775+0000 7fd7837fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd78414e580 0x7fd7840c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:60168/0 (socket says 172.21.15.45:60168) 2023-11-18T19:06:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.775+0000 7fd7837fe640 1 -- 172.21.15.45:0/3041423199 learned_addr learned my addr 172.21.15.45:0/3041423199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.775+0000 7fd77affd640 1 -- 172.21.15.45:0/3041423199 >> v2:172.21.15.135:3300/0 conn(0x7fd78414e580 msgr2=0x7fd7840c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.775+0000 7fd77affd640 1 --2- 172.21.15.45:0/3041423199 >> v2:172.21.15.135:3300/0 conn(0x7fd78414e580 0x7fd7840c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.775+0000 7fd77affd640 1 -- 172.21.15.45:0/3041423199 >> v1:172.21.15.135:6789/0 conn(0x7fd7840c7d90 legacy=0x7fd784158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.775+0000 7fd77affd640 1 -- 172.21.15.45:0/3041423199 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78406cbb0 con 0x7fd7840bd520 2023-11-18T19:06:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.775+0000 7fd7837fe640 1 --2- 172.21.15.45:0/3041423199 >> v2:172.21.15.135:3300/0 conn(0x7fd78414e580 0x7fd7840c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.777+0000 7fd77affd640 1 --2- 172.21.15.45:0/3041423199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840bd520 0x7fd784157c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0097a0 tx=0x7fd76c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8b83222e70587f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.777+0000 7fd782ffd640 1 -- 172.21.15.45:0/3041423199 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c031780 con 0x7fd7840bd520 2023-11-18T19:06:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.777+0000 7fd782ffd640 1 -- 172.21.15.45:0/3041423199 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c0318e0 con 0x7fd7840bd520 2023-11-18T19:06:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.777+0000 7fd782ffd640 1 -- 172.21.15.45:0/3041423199 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c031c70 con 0x7fd7840bd520 2023-11-18T19:06:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 -- 172.21.15.45:0/3041423199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840bd520 msgr2=0x7fd784157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 --2- 172.21.15.45:0/3041423199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840bd520 0x7fd784157c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0097a0 tx=0x7fd76c02b820 comp rx=0 tx=0).stop 2023-11-18T19:06:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 -- 172.21.15.45:0/3041423199 shutdown_connections 2023-11-18T19:06:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 --2- 172.21.15.45:0/3041423199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840bd520 0x7fd784157c50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 --2- 172.21.15.45:0/3041423199 >> v2:172.21.15.135:3300/0 conn(0x7fd78414e580 0x7fd7840c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 -- 172.21.15.45:0/3041423199 >> 172.21.15.45:0/3041423199 conn(0x7fd784066610 msgr2=0x7fd784066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 -- 172.21.15.45:0/3041423199 shutdown_connections 2023-11-18T19:06:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.778+0000 7fd788c47640 1 -- 172.21.15.45:0/3041423199 wait complete. 2023-11-18T19:06:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.780+0000 7fd788c47640 1 Processor -- start 2023-11-18T19:06:33.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.780+0000 7fd788c47640 1 -- start start 2023-11-18T19:06:33.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd788c47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7840bd520 0x7fd78414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd788c47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840c7d90 0x7fd7841ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd788c47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd78414e580 0x7fd7840c0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd788c47640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784151890 con 0x7fd7840bd520 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd788c47640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840bff90 con 0x7fd78414e580 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd788c47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7841edcc0 con 0x7fd7840c7d90 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7840bd520 0x7fd78414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7840bd520 0x7fd78414f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34220/0 (socket says 172.21.15.45:34220) 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 -- 172.21.15.45:0/2409817044 learned_addr learned my addr 172.21.15.45:0/2409817044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd77affd640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840c7d90 0x7fd7841ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd783fff640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd78414e580 0x7fd7840c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 -- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840c7d90 msgr2=0x7fd7841ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840c7d90 0x7fd7841ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 -- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd78414e580 msgr2=0x7fd7840c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd78414e580 0x7fd7840c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.782+0000 7fd7837fe640 1 -- 172.21.15.45:0/2409817044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774009b30 con 0x7fd7840bd520 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.783+0000 7fd7837fe640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7840bd520 0x7fd78414f950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd77400efc0 tx=0x7fd77400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.783+0000 7fd780ff9640 1 -- 172.21.15.45:0/2409817044 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77400ce60 con 0x7fd7840bd520 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.783+0000 7fd780ff9640 1 -- 172.21.15.45:0/2409817044 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77400f040 con 0x7fd7840bd520 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.783+0000 7fd780ff9640 1 -- 172.21.15.45:0/2409817044 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774014680 con 0x7fd7840bd520 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.783+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c009400 con 0x7fd7840bd520 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.783+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7841edfa0 con 0x7fd7840bd520 2023-11-18T19:06:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.784+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd784067910 con 0x7fd7840bd520 2023-11-18T19:06:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.785+0000 7fd780ff9640 1 -- 172.21.15.45:0/2409817044 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd7740147e0 con 0x7fd7840bd520 2023-11-18T19:06:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.786+0000 7fd780ff9640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd76406ade0 0x7fd76406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.786+0000 7fd780ff9640 1 -- 172.21.15.45:0/2409817044 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd7740899f0 con 0x7fd7840bd520 2023-11-18T19:06:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.787+0000 7fd77affd640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd76406ade0 0x7fd76406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.787+0000 7fd77affd640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd76406ade0 0x7fd76406d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd76c036000 tx=0x7fd76c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.791+0000 7fd780ff9640 1 -- 172.21.15.45:0/2409817044 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd774054ec0 con 0x7fd7840bd520 2023-11-18T19:06:33.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.989+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd784068410 con 0x7fd7840bd520 2023-11-18T19:06:33.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.991+0000 7fd780ff9640 1 -- 172.21.15.45:0/2409817044 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fd7740584e0 con 0x7fd7840bd520 2023-11-18T19:06:33.991 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:33.991 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:33.474607+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd76406ade0 msgr2=0x7fd76406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd76406ade0 0x7fd76406d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd76c036000 tx=0x7fd76c03d040 comp rx=0 tx=0).stop 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7840bd520 msgr2=0x7fd78414f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7840bd520 0x7fd78414f950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd77400efc0 tx=0x7fd77400c490 comp rx=0 tx=0).stop 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 shutdown_connections 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd78414e580 0x7fd7840c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd76406ade0 0x7fd76406d2a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7840c7d90 0x7fd7841ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 --2- 172.21.15.45:0/2409817044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7840bd520 0x7fd78414f950 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 >> 172.21.15.45:0/2409817044 conn(0x7fd784066610 msgr2=0x7fd7840c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:33.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 shutdown_connections 2023-11-18T19:06:33.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:33.993+0000 7fd788c47640 1 -- 172.21.15.45:0/2409817044 wait complete. 2023-11-18T19:06:34.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-18T19:06:34.012 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:06:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.234+0000 7f166c86e640 1 Processor -- start 2023-11-18T19:06:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.234+0000 7f166c86e640 1 -- start start 2023-11-18T19:06:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f166c86e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f16680c39c0 0x7f1668152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f166c86e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f166806a8e0 0x7f166806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f166c86e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166806ad10 con 0x7f166806a500 2023-11-18T19:06:34.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f166c86e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680c3fa0 con 0x7f166806a8e0 2023-11-18T19:06:34.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f166c86e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680c4280 con 0x7f16680c39c0 2023-11-18T19:06:34.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f1666d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f166806a500 0x7f166806d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52670/0 (socket says 172.21.15.45:52670) 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f1666d9d640 1 -- 172.21.15.45:0/3064753630 learned_addr learned my addr 172.21.15.45:0/3064753630 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.236+0000 7f166759e640 1 --2- 172.21.15.45:0/3064753630 >> v2:172.21.15.45:3300/0 conn(0x7f166806a8e0 0x7f166806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.237+0000 7f165ffff640 1 --2- 172.21.15.45:0/3064753630 >> v2:172.21.15.135:3300/0 conn(0x7f16680c39c0 0x7f1668152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.237+0000 7f166759e640 1 -- 172.21.15.45:0/3064753630 >> v2:172.21.15.135:3300/0 conn(0x7f16680c39c0 msgr2=0x7f1668152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.237+0000 7f166759e640 1 --2- 172.21.15.45:0/3064753630 >> v2:172.21.15.135:3300/0 conn(0x7f16680c39c0 0x7f1668152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.237+0000 7f166759e640 1 -- 172.21.15.45:0/3064753630 >> v1:172.21.15.45:6789/0 conn(0x7f166806a500 legacy=0x7f166806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.237+0000 7f166659c640 1 -- 172.21.15.45:0/3064753630 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529450306 0 0) 0x7f166806ad10 con 0x7f166806a500 2023-11-18T19:06:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.237+0000 7f166759e640 1 -- 172.21.15.45:0/3064753630 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680c4560 con 0x7f166806a8e0 2023-11-18T19:06:34.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.238+0000 7f166759e640 1 --2- 172.21.15.45:0/3064753630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f166806dcd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1668079c80 tx=0x7f166002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948b894e579e53f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:34.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.238+0000 7f166659c640 1 -- 172.21.15.45:0/3064753630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166002cbf0 con 0x7f166806a8e0 2023-11-18T19:06:34.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.238+0000 7f166659c640 1 -- 172.21.15.45:0/3064753630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166002cd50 con 0x7f166806a8e0 2023-11-18T19:06:34.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166659c640 1 -- 172.21.15.45:0/3064753630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660034660 con 0x7f166806a8e0 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 -- 172.21.15.45:0/3064753630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 msgr2=0x7f166806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 --2- 172.21.15.45:0/3064753630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f166806dcd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1668079c80 tx=0x7f166002be40 comp rx=0 tx=0).stop 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 -- 172.21.15.45:0/3064753630 shutdown_connections 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 --2- 172.21.15.45:0/3064753630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f166806dcd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 --2- 172.21.15.45:0/3064753630 >> v2:172.21.15.135:3300/0 conn(0x7f16680c39c0 0x7f1668152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 -- 172.21.15.45:0/3064753630 >> 172.21.15.45:0/3064753630 conn(0x7f16680a7870 msgr2=0x7f16680a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 -- 172.21.15.45:0/3064753630 shutdown_connections 2023-11-18T19:06:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.239+0000 7f166c86e640 1 -- 172.21.15.45:0/3064753630 wait complete. 2023-11-18T19:06:34.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.241+0000 7f166c86e640 1 Processor -- start 2023-11-18T19:06:34.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.241+0000 7f166c86e640 1 -- start start 2023-11-18T19:06:34.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f166c86e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f166806a500 0x7f16680aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f166c86e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f16680bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f166c86e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16680c39c0 0x7f1668143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f166c86e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16681eb7e0 con 0x7f166806a8e0 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f166c86e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680c0770 con 0x7f166806a500 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f166c86e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16681eb1f0 con 0x7f16680c39c0 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f165ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f16680bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f165ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f16680bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34232/0 (socket says 172.21.15.45:34232) 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.242+0000 7f165ffff640 1 -- 172.21.15.45:0/70943233 learned_addr learned my addr 172.21.15.45:0/70943233 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f1666d9d640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f166806a500 0x7f16680aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f166759e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16680c39c0 0x7f1668143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f165ffff640 1 -- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16680c39c0 msgr2=0x7f1668143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f165ffff640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16680c39c0 0x7f1668143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f165ffff640 1 -- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f166806a500 msgr2=0x7f16680aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f165ffff640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f166806a500 0x7f16680aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f165ffff640 1 -- 172.21.15.45:0/70943233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1660009a70 con 0x7f166806a8e0 2023-11-18T19:06:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f166759e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16680c39c0 0x7f1668143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f165ffff640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f16680bf160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f165000d5f0 tx=0x7f165000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.243+0000 7f165f7fe640 1 -- 172.21.15.45:0/70943233 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16500125f0 con 0x7f166806a8e0 2023-11-18T19:06:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.244+0000 7f165f7fe640 1 -- 172.21.15.45:0/70943233 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650012750 con 0x7f166806a8e0 2023-11-18T19:06:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.244+0000 7f165f7fe640 1 -- 172.21.15.45:0/70943233 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650012b00 con 0x7f166806a8e0 2023-11-18T19:06:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.244+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16680a97b0 con 0x7f166806a8e0 2023-11-18T19:06:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.244+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16681eb400 con 0x7f166806a8e0 2023-11-18T19:06:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.245+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16680683a0 con 0x7f166806a8e0 2023-11-18T19:06:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.246+0000 7f165f7fe640 1 -- 172.21.15.45:0/70943233 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1650012c60 con 0x7f166806a8e0 2023-11-18T19:06:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.247+0000 7f165f7fe640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f164806ae40 0x7f164806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.247+0000 7f165f7fe640 1 -- 172.21.15.45:0/70943233 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1650089720 con 0x7f166806a8e0 2023-11-18T19:06:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.247+0000 7f1666d9d640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f164806ae40 0x7f164806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.248+0000 7f1666d9d640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f164806ae40 0x7f164806d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1658000f60 tx=0x7f1658007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.251+0000 7f165f7fe640 1 -- 172.21.15.45:0/70943233 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1650054bb0 con 0x7f166806a8e0 2023-11-18T19:06:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.443+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f166806bd70 con 0x7f166806a8e0 2023-11-18T19:06:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.444+0000 7f165f7fe640 1 -- 172.21.15.45:0/70943233 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16500581d0 con 0x7f166806a8e0 2023-11-18T19:06:34.446 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:06:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f164806ae40 msgr2=0x7f164806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f164806ae40 0x7f164806d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1658000f60 tx=0x7f1658007c00 comp rx=0 tx=0).stop 2023-11-18T19:06:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 msgr2=0x7f16680bf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f16680bf160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f165000d5f0 tx=0x7f165000dab0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 shutdown_connections 2023-11-18T19:06:34.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f164806ae40 0x7f164806d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16680c39c0 0x7f1668143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166806a8e0 0x7f16680bf160 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 --2- 172.21.15.45:0/70943233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f166806a500 0x7f16680aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 >> 172.21.15.45:0/70943233 conn(0x7f16680a7870 msgr2=0x7f16680a6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:34.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 shutdown_connections 2023-11-18T19:06:34.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.447+0000 7f166c86e640 1 -- 172.21.15.45:0/70943233 wait complete. 2023-11-18T19:06:34.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-18T19:06:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.685+0000 7f15810e7640 1 Processor -- start 2023-11-18T19:06:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.686+0000 7f15810e7640 1 -- start start 2023-11-18T19:06:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.687+0000 7f15810e7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c14c4e0 0x7f157c0a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.687+0000 7f15810e7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f157c0c5440 0x7f157c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.687+0000 7f15810e7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0a5270 con 0x7f157c0c4fc0 2023-11-18T19:06:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.687+0000 7f15810e7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0a54a0 con 0x7f157c0c5440 2023-11-18T19:06:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.687+0000 7f15810e7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c152f70 con 0x7f157c14c4e0 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f157c0c4fc0 0x7f157c152320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52674/0 (socket says 172.21.15.45:52674) 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157a59c640 1 -- 172.21.15.45:0/2868370925 learned_addr learned my addr 172.21.15.45:0/2868370925 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157ad9d640 1 --2- 172.21.15.45:0/2868370925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c14c4e0 0x7f157c0a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157b59e640 1 --2- 172.21.15.45:0/2868370925 >> v2:172.21.15.135:3300/0 conn(0x7f157c0c5440 0x7f157c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f1579d9b640 1 -- 172.21.15.45:0/2868370925 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656436524 0 0) 0x7f157c0a5270 con 0x7f157c0c4fc0 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f1579d9b640 1 -- 172.21.15.45:0/2868370925 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1564003520 con 0x7f157c0c4fc0 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157ad9d640 1 -- 172.21.15.45:0/2868370925 >> v2:172.21.15.135:3300/0 conn(0x7f157c0c5440 msgr2=0x7f157c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157ad9d640 1 --2- 172.21.15.45:0/2868370925 >> v2:172.21.15.135:3300/0 conn(0x7f157c0c5440 0x7f157c152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157ad9d640 1 -- 172.21.15.45:0/2868370925 >> v1:172.21.15.45:6789/0 conn(0x7f157c0c4fc0 legacy=0x7f157c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157ad9d640 1 -- 172.21.15.45:0/2868370925 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c06d5d0 con 0x7f157c14c4e0 2023-11-18T19:06:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.688+0000 7f157b59e640 1 --2- 172.21.15.45:0/2868370925 >> v2:172.21.15.135:3300/0 conn(0x7f157c0c5440 0x7f157c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.690+0000 7f157ad9d640 1 --2- 172.21.15.45:0/2868370925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c14c4e0 0x7f157c0a4d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f156c009d90 tx=0x7f156c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=535874e85b6620cc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.690+0000 7f1579d9b640 1 -- 172.21.15.45:0/2868370925 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c02cc50 con 0x7f157c14c4e0 2023-11-18T19:06:34.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.690+0000 7f1579d9b640 1 -- 172.21.15.45:0/2868370925 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c02cdb0 con 0x7f157c14c4e0 2023-11-18T19:06:34.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.690+0000 7f1579d9b640 1 -- 172.21.15.45:0/2868370925 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c034660 con 0x7f157c14c4e0 2023-11-18T19:06:34.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 -- 172.21.15.45:0/2868370925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c14c4e0 msgr2=0x7f157c0a4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 --2- 172.21.15.45:0/2868370925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c14c4e0 0x7f157c0a4d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f156c009d90 tx=0x7f156c02bea0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 -- 172.21.15.45:0/2868370925 shutdown_connections 2023-11-18T19:06:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 --2- 172.21.15.45:0/2868370925 >> v2:172.21.15.135:3300/0 conn(0x7f157c0c5440 0x7f157c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 --2- 172.21.15.45:0/2868370925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c14c4e0 0x7f157c0a4d30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 -- 172.21.15.45:0/2868370925 >> 172.21.15.45:0/2868370925 conn(0x7f157c06a500 msgr2=0x7f157c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 -- 172.21.15.45:0/2868370925 shutdown_connections 2023-11-18T19:06:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.691+0000 7f15810e7640 1 -- 172.21.15.45:0/2868370925 wait complete. 2023-11-18T19:06:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.693+0000 7f15810e7640 1 Processor -- start 2023-11-18T19:06:34.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.694+0000 7f15810e7640 1 -- start start 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f15810e7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c0c4fc0 0x7f157c0aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f15810e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157c0c5440 0x7f157c0bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f15810e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f157c14c4e0 0x7f157c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f15810e7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c072be0 con 0x7f157c14c4e0 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f15810e7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0aac00 con 0x7f157c0c5440 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f15810e7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c148b00 con 0x7f157c0c4fc0 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f157b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f157c14c4e0 0x7f157c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f157b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f157c14c4e0 0x7f157c06fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34234/0 (socket says 172.21.15.45:34234) 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f157b59e640 1 -- 172.21.15.45:0/1343059165 learned_addr learned my addr 172.21.15.45:0/1343059165 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f157ad9d640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c0c4fc0 0x7f157c0aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.695+0000 7f157a59c640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157c0c5440 0x7f157c0bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f157b59e640 1 -- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c0c4fc0 msgr2=0x7f157c0aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f157b59e640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c0c4fc0 0x7f157c0aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f157b59e640 1 -- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157c0c5440 msgr2=0x7f157c0bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f157b59e640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157c0c5440 0x7f157c0bf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f157b59e640 1 -- 172.21.15.45:0/1343059165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1574009400 con 0x7f157c14c4e0 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f157b59e640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f157c14c4e0 0x7f157c06fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f157400e960 tx=0x7f157400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f15637fe640 1 -- 172.21.15.45:0/1343059165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574009700 con 0x7f157c14c4e0 2023-11-18T19:06:34.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.696+0000 7f15637fe640 1 -- 172.21.15.45:0/1343059165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1574004020 con 0x7f157c14c4e0 2023-11-18T19:06:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.697+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c009a70 con 0x7f157c14c4e0 2023-11-18T19:06:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.697+0000 7f15637fe640 1 -- 172.21.15.45:0/1343059165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15740043b0 con 0x7f157c14c4e0 2023-11-18T19:06:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.697+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c072620 con 0x7f157c14c4e0 2023-11-18T19:06:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.698+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c0747c0 con 0x7f157c14c4e0 2023-11-18T19:06:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.699+0000 7f15637fe640 1 -- 172.21.15.45:0/1343059165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f157400ca00 con 0x7f157c14c4e0 2023-11-18T19:06:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.700+0000 7f15637fe640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f156806ae40 0x7f156806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.700+0000 7f15637fe640 1 -- 172.21.15.45:0/1343059165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1574089200 con 0x7f157c14c4e0 2023-11-18T19:06:34.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.700+0000 7f157ad9d640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f156806ae40 0x7f156806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:34.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.701+0000 7f157ad9d640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f156806ae40 0x7f156806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f156c036000 tx=0x7f156c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:34.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.704+0000 7f15637fe640 1 -- 172.21.15.45:0/1343059165 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1574054610 con 0x7f157c14c4e0 2023-11-18T19:06:34.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:06:34.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.909+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f157c14bc90 con 0x7f157c14c4e0 2023-11-18T19:06:34.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.909+0000 7f15637fe640 1 -- 172.21.15.45:0/1343059165 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1574057c30 con 0x7f157c14c4e0 2023-11-18T19:06:34.911 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:34.911 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-18T19:06:34.912 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-18T19:06:34.912 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-18T19:06:34.912 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-18T19:06:34.912 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-18T19:06:34.912 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-18T19:06:34.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.912+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f156806ae40 msgr2=0x7f156806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.912+0000 7f15810e7640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f156806ae40 0x7f156806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f156c036000 tx=0x7f156c030000 comp rx=0 tx=0).stop 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f157c14c4e0 msgr2=0x7f157c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f157c14c4e0 0x7f157c06fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f157400e960 tx=0x7f157400ee20 comp rx=0 tx=0).stop 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 shutdown_connections 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f157c14c4e0 0x7f157c06fc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f157c0c5440 0x7f157c0bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f156806ae40 0x7f156806d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 --2- 172.21.15.45:0/1343059165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f157c0c4fc0 0x7f157c0aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:34.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 >> 172.21.15.45:0/1343059165 conn(0x7f157c06a500 msgr2=0x7f157c149950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:34.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 shutdown_connections 2023-11-18T19:06:34.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:34.913+0000 7f15810e7640 1 -- 172.21.15.45:0/1343059165 wait complete. 2023-11-18T19:06:34.932 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-18T19:06:34.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-18T19:06:35.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.181+0000 7fa85f26d640 1 Processor -- start 2023-11-18T19:06:35.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.181+0000 7fa85f26d640 1 -- start start 2023-11-18T19:06:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85f26d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa8581585d0 0x7fa8580c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85f26d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa85806c810 0x7fa85815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85f26d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580c1e10 con 0x7fa8580c7880 2023-11-18T19:06:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85f26d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8580c7480 con 0x7fa85806c810 2023-11-18T19:06:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85f26d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8581589b0 con 0x7fa8581585d0 2023-11-18T19:06:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85ea6c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa85806c810 0x7fa85815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85ea6c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa85806c810 0x7fa85815ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34248/0 (socket says 172.21.15.45:34248) 2023-11-18T19:06:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85ea6c640 1 -- 172.21.15.45:0/2899248360 learned_addr learned my addr 172.21.15.45:0/2899248360 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85e26b640 1 --2- 172.21.15.45:0/2899248360 >> v2:172.21.15.135:3300/0 conn(0x7fa8581585d0 0x7fa8580c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85ea6c640 1 -- 172.21.15.45:0/2899248360 >> v2:172.21.15.135:3300/0 conn(0x7fa8581585d0 msgr2=0x7fa8580c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85ea6c640 1 --2- 172.21.15.45:0/2899248360 >> v2:172.21.15.135:3300/0 conn(0x7fa8581585d0 0x7fa8580c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85ea6c640 1 -- 172.21.15.45:0/2899248360 >> v1:172.21.15.135:6789/0 conn(0x7fa8580c7880 legacy=0x7fa85806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.183+0000 7fa85ea6c640 1 -- 172.21.15.45:0/2899248360 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580c2060 con 0x7fa85806c810 2023-11-18T19:06:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.184+0000 7fa85ea6c640 1 --2- 172.21.15.45:0/2899248360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa85815ee10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8580743e0 tx=0x7fa85002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4e45a79046e45e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:35.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.185+0000 7fa85d269640 1 -- 172.21.15.45:0/2899248360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85002cb10 con 0x7fa85806c810 2023-11-18T19:06:35.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.185+0000 7fa85d269640 1 -- 172.21.15.45:0/2899248360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85002cc70 con 0x7fa85806c810 2023-11-18T19:06:35.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.185+0000 7fa85d269640 1 -- 172.21.15.45:0/2899248360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8500343f0 con 0x7fa85806c810 2023-11-18T19:06:35.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.185+0000 7fa85f26d640 1 -- 172.21.15.45:0/2899248360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 msgr2=0x7fa85815ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:35.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.185+0000 7fa85f26d640 1 --2- 172.21.15.45:0/2899248360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa85815ee10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8580743e0 tx=0x7fa85002bf70 comp rx=0 tx=0).stop 2023-11-18T19:06:35.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.186+0000 7fa85f26d640 1 -- 172.21.15.45:0/2899248360 shutdown_connections 2023-11-18T19:06:35.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.186+0000 7fa85f26d640 1 --2- 172.21.15.45:0/2899248360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa85815ee10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:35.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.186+0000 7fa85f26d640 1 --2- 172.21.15.45:0/2899248360 >> v2:172.21.15.135:3300/0 conn(0x7fa8581585d0 0x7fa8580c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:35.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.186+0000 7fa85f26d640 1 -- 172.21.15.45:0/2899248360 >> 172.21.15.45:0/2899248360 conn(0x7fa8580a9aa0 msgr2=0x7fa8580a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:35.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.186+0000 7fa85f26d640 1 -- 172.21.15.45:0/2899248360 shutdown_connections 2023-11-18T19:06:35.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.186+0000 7fa85f26d640 1 -- 172.21.15.45:0/2899248360 wait complete. 2023-11-18T19:06:35.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.187+0000 7fa85f26d640 1 Processor -- start 2023-11-18T19:06:35.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.187+0000 7fa85f26d640 1 -- start start 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.188+0000 7fa85f26d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa8580ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.188+0000 7fa85f26d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8580c7880 0x7fa8581ed590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.188+0000 7fa85f26d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8581585d0 0x7fa8581e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.188+0000 7fa85f26d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580ab560 con 0x7fa85806c810 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.188+0000 7fa85f26d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581ede60 con 0x7fa8581585d0 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.188+0000 7fa85f26d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa858152710 con 0x7fa8580c7880 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa8580ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa8580ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34252/0 (socket says 172.21.15.45:34252) 2023-11-18T19:06:35.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 -- 172.21.15.45:0/3153628382 learned_addr learned my addr 172.21.15.45:0/3153628382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85da6a640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8580c7880 0x7fa8581ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85ea6c640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8581585d0 0x7fa8581e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 -- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8580c7880 msgr2=0x7fa8581ed590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8580c7880 0x7fa8581ed590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 -- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8581585d0 msgr2=0x7fa8581e6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8581585d0 0x7fa8581e6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 -- 172.21.15.45:0/3153628382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850009b30 con 0x7fa85806c810 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85da6a640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8580c7880 0x7fa8581ed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.189+0000 7fa85e26b640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa8580ad840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa85400e870 tx=0x7fa85400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:35.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.190+0000 7fa84effd640 1 -- 172.21.15.45:0/3153628382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540094f0 con 0x7fa85806c810 2023-11-18T19:06:35.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.190+0000 7fa84effd640 1 -- 172.21.15.45:0/3153628382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400c940 con 0x7fa85806c810 2023-11-18T19:06:35.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.190+0000 7fa84effd640 1 -- 172.21.15.45:0/3153628382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400ccf0 con 0x7fa85806c810 2023-11-18T19:06:35.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.190+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8581529f0 con 0x7fa85806c810 2023-11-18T19:06:35.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.190+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85806fcd0 con 0x7fa85806c810 2023-11-18T19:06:35.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.191+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85806cf40 con 0x7fa85806c810 2023-11-18T19:06:35.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.192+0000 7fa84effd640 1 -- 172.21.15.45:0/3153628382 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa854013470 con 0x7fa85806c810 2023-11-18T19:06:35.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.194+0000 7fa84effd640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:35.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.194+0000 7fa84effd640 1 -- 172.21.15.45:0/3153628382 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa8540892d0 con 0x7fa85806c810 2023-11-18T19:06:35.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.194+0000 7fa85da6a640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:35.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.194+0000 7fa85da6a640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa83c06ae40 0x7fa83c06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa848007fd0 tx=0x7fa848009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.198+0000 7fa84effd640 1 -- 172.21.15.45:0/3153628382 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa854054770 con 0x7fa85806c810 2023-11-18T19:06:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:35.396+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa858152570 con 0x7fa85806c810 2023-11-18T19:06:36.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.008+0000 7fa84effd640 1 -- 172.21.15.45:0/3153628382 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa858152570 con 0x7fa85806c810 2023-11-18T19:06:36.010 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-18T19:06:36.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa83c06ae40 msgr2=0x7fa83c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:36.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa83c06ae40 0x7fa83c06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa848007fd0 tx=0x7fa848009040 comp rx=0 tx=0).stop 2023-11-18T19:06:36.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 msgr2=0x7fa8580ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:36.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa8580ad840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa85400e870 tx=0x7fa85400ed30 comp rx=0 tx=0).stop 2023-11-18T19:06:36.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 shutdown_connections 2023-11-18T19:06:36.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8581585d0 0x7fa8581e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8580c7880 0x7fa8581ed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 --2- 172.21.15.45:0/3153628382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa85806c810 0x7fa8580ad840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.011+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 >> 172.21.15.45:0/3153628382 conn(0x7fa8580a9aa0 msgr2=0x7fa8580c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:36.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.012+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 shutdown_connections 2023-11-18T19:06:36.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.012+0000 7fa85f26d640 1 -- 172.21.15.45:0/3153628382 wait complete. 2023-11-18T19:06:36.037 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-18T19:06:36.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.257+0000 7f714e933640 1 Processor -- start 2023-11-18T19:06:36.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.258+0000 7f714e933640 1 -- start start 2023-11-18T19:06:36.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.259+0000 7f714e933640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f714814fc40 0x7f7148152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:36.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.259+0000 7f714e933640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71480c07d0 con 0x7f71480ab740 2023-11-18T19:06:36.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.259+0000 7f714e933640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714806e3b0 con 0x7f71480c1d50 2023-11-18T19:06:36.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.259+0000 7f714e933640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7148072070 con 0x7f714814fc40 2023-11-18T19:06:36.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f713ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f71480ab740 0x7f714806dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52684/0 (socket says 172.21.15.45:52684) 2023-11-18T19:06:36.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f713ffff640 1 -- 172.21.15.45:0/603771007 learned_addr learned my addr 172.21.15.45:0/603771007 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:36.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f7147fff640 1 --2- 172.21.15.45:0/603771007 >> v2:172.21.15.45:3300/0 conn(0x7f714814fc40 0x7f7148152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:36.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f71477fe640 1 -- 172.21.15.45:0/603771007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461367836 0 0) 0x7f71480c07d0 con 0x7f71480ab740 2023-11-18T19:06:36.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f71477fe640 1 -- 172.21.15.45:0/603771007 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7134003520 con 0x7f71480ab740 2023-11-18T19:06:36.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f7147fff640 1 -- 172.21.15.45:0/603771007 >> v1:172.21.15.135:6789/0 conn(0x7f71480c1d50 legacy=0x7f71480c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:36.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f7147fff640 1 -- 172.21.15.45:0/603771007 >> v1:172.21.15.45:6789/0 conn(0x7f71480ab740 legacy=0x7f714806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:36.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.260+0000 7f7147fff640 1 -- 172.21.15.45:0/603771007 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71480c21a0 con 0x7f714814fc40 2023-11-18T19:06:36.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.261+0000 7f7147fff640 1 --2- 172.21.15.45:0/603771007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714814fc40 0x7f7148152490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71380097a0 tx=0x7f713802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03233b77efc4968 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:36.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.262+0000 7f71477fe640 1 -- 172.21.15.45:0/603771007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713802f050 con 0x7f714814fc40 2023-11-18T19:06:36.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.262+0000 7f71477fe640 1 -- 172.21.15.45:0/603771007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138031700 con 0x7f714814fc40 2023-11-18T19:06:36.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.262+0000 7f71477fe640 1 -- 172.21.15.45:0/603771007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138031a90 con 0x7f714814fc40 2023-11-18T19:06:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.262+0000 7f714e933640 1 -- 172.21.15.45:0/603771007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714814fc40 msgr2=0x7f7148152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.262+0000 7f714e933640 1 --2- 172.21.15.45:0/603771007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714814fc40 0x7f7148152490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71380097a0 tx=0x7f713802b7a0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.263+0000 7f714e933640 1 -- 172.21.15.45:0/603771007 shutdown_connections 2023-11-18T19:06:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.263+0000 7f714e933640 1 --2- 172.21.15.45:0/603771007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714814fc40 0x7f7148152490 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.263+0000 7f714e933640 1 -- 172.21.15.45:0/603771007 >> 172.21.15.45:0/603771007 conn(0x7f71480a7980 msgr2=0x7f71480a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.263+0000 7f714e933640 1 -- 172.21.15.45:0/603771007 shutdown_connections 2023-11-18T19:06:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.263+0000 7f714e933640 1 -- 172.21.15.45:0/603771007 wait complete. 2023-11-18T19:06:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.264+0000 7f714e933640 1 Processor -- start 2023-11-18T19:06:36.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.265+0000 7f714e933640 1 -- start start 2023-11-18T19:06:36.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.265+0000 7f714e933640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71480ab740 0x7f714814cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f714e933640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71480c1d50 0x7f71480bf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f714e933640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f714814fc40 0x7f71481ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f714e933640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71481ed2e0 con 0x7f71480ab740 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f714e933640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480a9220 con 0x7f71480c1d50 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f714e933640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480a9500 con 0x7f714814fc40 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71480ab740 0x7f714814cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71480ab740 0x7f714814cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34268/0 (socket says 172.21.15.45:34268) 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 -- 172.21.15.45:0/1546620820 learned_addr learned my addr 172.21.15.45:0/1546620820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f714ced0640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f714814fc40 0x7f71481ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f713ffff640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71480c1d50 0x7f71480bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 -- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f714814fc40 msgr2=0x7f71481ea450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f714814fc40 0x7f71481ea450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 -- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71480c1d50 msgr2=0x7f71480bf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71480c1d50 0x7f71480bf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.266+0000 7f7147fff640 1 -- 172.21.15.45:0/1546620820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138009400 con 0x7f71480ab740 2023-11-18T19:06:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.267+0000 7f7147fff640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71480ab740 0x7f714814cfd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7138000c00 tx=0x7f71380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.267+0000 7f71457fa640 1 -- 172.21.15.45:0/1546620820 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71380339b0 con 0x7f71480ab740 2023-11-18T19:06:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.267+0000 7f71457fa640 1 -- 172.21.15.45:0/1546620820 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138033b10 con 0x7f71480ab740 2023-11-18T19:06:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.267+0000 7f71457fa640 1 -- 172.21.15.45:0/1546620820 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713803c400 con 0x7f71480ab740 2023-11-18T19:06:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.267+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71481e9d70 con 0x7f71480ab740 2023-11-18T19:06:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.267+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7148156660 con 0x7f71480ab740 2023-11-18T19:06:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.268+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7148066b80 con 0x7f71480ab740 2023-11-18T19:06:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.271+0000 7f71457fa640 1 -- 172.21.15.45:0/1546620820 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f713803a040 con 0x7f71480ab740 2023-11-18T19:06:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.272+0000 7f71457fa640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f712806aec0 0x7f712806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.272+0000 7f71457fa640 1 -- 172.21.15.45:0/1546620820 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f71380ab1a0 con 0x7f71480ab740 2023-11-18T19:06:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.273+0000 7f713ffff640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f712806aec0 0x7f712806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.274+0000 7f713ffff640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f712806aec0 0x7f712806d380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71480a9110 tx=0x7f7130007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:36.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.278+0000 7f71457fa640 1 -- 172.21.15.45:0/1546620820 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7138076690 con 0x7f71480ab740 2023-11-18T19:06:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:36.472+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f71481ed420 con 0x7f71480ab740 2023-11-18T19:06:37.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.015+0000 7f71457fa640 1 -- 172.21.15.45:0/1546620820 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7138079c70 con 0x7f71480ab740 2023-11-18T19:06:37.017 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-18T19:06:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.019+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f712806aec0 msgr2=0x7f712806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.019+0000 7f714e933640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f712806aec0 0x7f712806d380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71480a9110 tx=0x7f7130007d30 comp rx=0 tx=0).stop 2023-11-18T19:06:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.019+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71480ab740 msgr2=0x7f714814cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.019+0000 7f714e933640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71480ab740 0x7f714814cfd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7138000c00 tx=0x7f71380046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.020+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 shutdown_connections 2023-11-18T19:06:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.020+0000 7f714e933640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f712806aec0 0x7f712806d380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.020+0000 7f714e933640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f714814fc40 0x7f71481ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.020+0000 7f714e933640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71480c1d50 0x7f71480bf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.020+0000 7f714e933640 1 --2- 172.21.15.45:0/1546620820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71480ab740 0x7f714814cfd0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7138000c00 tx=0x7f71380046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.020+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 >> 172.21.15.45:0/1546620820 conn(0x7f71480a7980 msgr2=0x7f714814dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.021+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 shutdown_connections 2023-11-18T19:06:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.021+0000 7f714e933640 1 -- 172.21.15.45:0/1546620820 wait complete. 2023-11-18T19:06:37.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-18T19:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.253+0000 7f0ed08c9640 1 Processor -- start 2023-11-18T19:06:37.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.253+0000 7f0ed08c9640 1 -- start start 2023-11-18T19:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.254+0000 7f0ed08c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ecc152490 0x7f0ecc0c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.254+0000 7f0ed08c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc0c07d0 con 0x7f0ecc14fc40 2023-11-18T19:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.254+0000 7f0ed08c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc06e3b0 con 0x7f0ecc0ab740 2023-11-18T19:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.254+0000 7f0ed08c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc1528e0 con 0x7f0ecc152490 2023-11-18T19:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.255+0000 7f0eca59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0ecc14fc40 0x7f0ecc06dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52690/0 (socket says 172.21.15.45:52690) 2023-11-18T19:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.255+0000 7f0eca59c640 1 -- 172.21.15.45:0/2875767359 learned_addr learned my addr 172.21.15.45:0/2875767359 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.255+0000 7f0ecad9d640 1 --2- 172.21.15.45:0/2875767359 >> v2:172.21.15.135:3300/0 conn(0x7f0ecc152490 0x7f0ecc0c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.255+0000 7f0ec9d9b640 1 -- 172.21.15.45:0/2875767359 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973764736 0 0) 0x7f0ecc0c07d0 con 0x7f0ecc14fc40 2023-11-18T19:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.256+0000 7f0ec9d9b640 1 -- 172.21.15.45:0/2875767359 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb8003520 con 0x7f0ecc14fc40 2023-11-18T19:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.256+0000 7f0ecad9d640 1 -- 172.21.15.45:0/2875767359 >> v1:172.21.15.135:6789/0 conn(0x7f0ecc0ab740 legacy=0x7f0ecc0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.256+0000 7f0ecad9d640 1 -- 172.21.15.45:0/2875767359 >> v1:172.21.15.45:6789/0 conn(0x7f0ecc14fc40 legacy=0x7f0ecc06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.256+0000 7f0ecad9d640 1 -- 172.21.15.45:0/2875767359 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc072070 con 0x7f0ecc152490 2023-11-18T19:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.257+0000 7f0ecad9d640 1 --2- 172.21.15.45:0/2875767359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc152490 0x7f0ecc0c1d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009d90 tx=0x7f0ec402bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1987c8cbdd39fa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:37.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.258+0000 7f0ec9d9b640 1 -- 172.21.15.45:0/2875767359 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec402cc70 con 0x7f0ecc152490 2023-11-18T19:06:37.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.258+0000 7f0ec9d9b640 1 -- 172.21.15.45:0/2875767359 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec402cdd0 con 0x7f0ecc152490 2023-11-18T19:06:37.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.258+0000 7f0ec9d9b640 1 -- 172.21.15.45:0/2875767359 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4034660 con 0x7f0ecc152490 2023-11-18T19:06:37.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.259+0000 7f0ed08c9640 1 -- 172.21.15.45:0/2875767359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc152490 msgr2=0x7f0ecc0c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:37.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.259+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/2875767359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc152490 0x7f0ecc0c1d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009d90 tx=0x7f0ec402bec0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.259+0000 7f0ed08c9640 1 -- 172.21.15.45:0/2875767359 shutdown_connections 2023-11-18T19:06:37.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.259+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/2875767359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc152490 0x7f0ecc0c1d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.259+0000 7f0ed08c9640 1 -- 172.21.15.45:0/2875767359 >> 172.21.15.45:0/2875767359 conn(0x7f0ecc0a7980 msgr2=0x7f0ecc0a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:37.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.259+0000 7f0ed08c9640 1 -- 172.21.15.45:0/2875767359 shutdown_connections 2023-11-18T19:06:37.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.259+0000 7f0ed08c9640 1 -- 172.21.15.45:0/2875767359 wait complete. 2023-11-18T19:06:37.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.261+0000 7f0ed08c9640 1 Processor -- start 2023-11-18T19:06:37.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.261+0000 7f0ed08c9640 1 -- start start 2023-11-18T19:06:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ed08c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ecc0ab740 0x7f0ecc156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ed08c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc14fc40 0x7f0ecc0c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ed08c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ecc152490 0x7f0ecc1e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ed08c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc0a99a0 con 0x7f0ecc152490 2023-11-18T19:06:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ed08c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc0aa790 con 0x7f0ecc14fc40 2023-11-18T19:06:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ed08c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc1eb900 con 0x7f0ecc0ab740 2023-11-18T19:06:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ecad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ecc152490 0x7f0ecc1e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ecad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ecc152490 0x7f0ecc1e4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34280/0 (socket says 172.21.15.45:34280) 2023-11-18T19:06:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0ecad9d640 1 -- 172.21.15.45:0/1215298645 learned_addr learned my addr 172.21.15.45:0/1215298645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.262+0000 7f0eca59c640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ecc0ab740 0x7f0ecc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ec3fff640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc14fc40 0x7f0ecc0c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ecad9d640 1 -- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ecc0ab740 msgr2=0x7f0ecc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ecad9d640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ecc0ab740 0x7f0ecc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ecad9d640 1 -- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc14fc40 msgr2=0x7f0ecc0c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:37.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ecad9d640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc14fc40 0x7f0ecc0c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:37.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ecad9d640 1 -- 172.21.15.45:0/1215298645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009a70 con 0x7f0ecc152490 2023-11-18T19:06:37.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ec3fff640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc14fc40 0x7f0ecc0c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:37.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ecad9d640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ecc152490 0x7f0ecc1e4aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009eb0 tx=0x7f0ec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:37.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ec2ffd640 1 -- 172.21.15.45:0/1215298645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec403e610 con 0x7f0ecc152490 2023-11-18T19:06:37.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ec2ffd640 1 -- 172.21.15.45:0/1215298645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec403e770 con 0x7f0ecc152490 2023-11-18T19:06:37.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc1ebbe0 con 0x7f0ecc152490 2023-11-18T19:06:37.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.263+0000 7f0ec2ffd640 1 -- 172.21.15.45:0/1215298645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec403eb20 con 0x7f0ecc152490 2023-11-18T19:06:37.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.264+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc0c33f0 con 0x7f0ecc152490 2023-11-18T19:06:37.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.265+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc066b80 con 0x7f0ecc152490 2023-11-18T19:06:37.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.266+0000 7f0ec2ffd640 1 -- 172.21.15.45:0/1215298645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ec403b050 con 0x7f0ecc152490 2023-11-18T19:06:37.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.267+0000 7f0ec2ffd640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0eac06ae40 0x7f0eac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:37.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.267+0000 7f0ec2ffd640 1 -- 172.21.15.45:0/1215298645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0ec40abda0 con 0x7f0ecc152490 2023-11-18T19:06:37.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.267+0000 7f0eca59c640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0eac06ae40 0x7f0eac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:37.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.268+0000 7f0eca59c640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0eac06ae40 0x7f0eac06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0011e0 tx=0x7f0ebc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:37.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.272+0000 7f0ec2ffd640 1 -- 172.21.15.45:0/1215298645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ec4076ea0 con 0x7f0ecc152490 2023-11-18T19:06:37.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:37.507+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0ecc0c0450 con 0x7f0ecc152490 2023-11-18T19:06:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.026+0000 7f0ec2ffd640 1 -- 172.21.15.45:0/1215298645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0ec407a4c0 con 0x7f0ecc152490 2023-11-18T19:06:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2023-11-18T19:06:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0eac06ae40 msgr2=0x7f0eac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0eac06ae40 0x7f0eac06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0011e0 tx=0x7f0ebc009040 comp rx=0 tx=0).stop 2023-11-18T19:06:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ecc152490 msgr2=0x7f0ecc1e4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ecc152490 0x7f0ecc1e4aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009eb0 tx=0x7f0ec4004a40 comp rx=0 tx=0).stop 2023-11-18T19:06:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 shutdown_connections 2023-11-18T19:06:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ecc152490 0x7f0ecc1e4aa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ecc14fc40 0x7f0ecc0c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0eac06ae40 0x7f0eac06d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 --2- 172.21.15.45:0/1215298645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ecc0ab740 0x7f0ecc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 >> 172.21.15.45:0/1215298645 conn(0x7f0ecc0a7980 msgr2=0x7f0ecc14f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 shutdown_connections 2023-11-18T19:06:38.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.030+0000 7f0ed08c9640 1 -- 172.21.15.45:0/1215298645 wait complete. 2023-11-18T19:06:38.058 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-18T19:06:38.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-18T19:06:38.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.262+0000 7f1cacccf640 1 Processor -- start 2023-11-18T19:06:38.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.262+0000 7f1cacccf640 1 -- start start 2023-11-18T19:06:38.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.263+0000 7f1cacccf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca80bf1e0 0x7f1ca80bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.263+0000 7f1cacccf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1ca80c32b0 0x7f1ca8155d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1cacccf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ca8156280 0x7f1ca80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1cacccf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca80bfb00 con 0x7f1ca8156280 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1cacccf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca806d950 con 0x7f1ca80c32b0 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1cacccf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca806de80 con 0x7f1ca80bf1e0 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1ca6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ca8156280 0x7f1ca80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1ca6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ca8156280 0x7f1ca80a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34292/0 (socket says 172.21.15.45:34292) 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1ca6d9d640 1 -- 172.21.15.45:0/2338677635 learned_addr learned my addr 172.21.15.45:0/2338677635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1ca659c640 1 --2- 172.21.15.45:0/2338677635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca80bf1e0 0x7f1ca80bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.264+0000 7f1ca5d9b640 1 --2- 172.21.15.45:0/2338677635 >> v2:172.21.15.135:3300/0 conn(0x7f1ca80c32b0 0x7f1ca8155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.265+0000 7f1ca6d9d640 1 -- 172.21.15.45:0/2338677635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca80bf1e0 msgr2=0x7f1ca80bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:38.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.265+0000 7f1ca6d9d640 1 --2- 172.21.15.45:0/2338677635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca80bf1e0 0x7f1ca80bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.265+0000 7f1ca6d9d640 1 -- 172.21.15.45:0/2338677635 >> v2:172.21.15.135:3300/0 conn(0x7f1ca80c32b0 msgr2=0x7f1ca8155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:38.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.265+0000 7f1ca6d9d640 1 --2- 172.21.15.45:0/2338677635 >> v2:172.21.15.135:3300/0 conn(0x7f1ca80c32b0 0x7f1ca8155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.265+0000 7f1ca6d9d640 1 -- 172.21.15.45:0/2338677635 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80bfcf0 con 0x7f1ca8156280 2023-11-18T19:06:38.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.265+0000 7f1ca5d9b640 1 --2- 172.21.15.45:0/2338677635 >> v2:172.21.15.135:3300/0 conn(0x7f1ca80c32b0 0x7f1ca8155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:38.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.266+0000 7f1ca6d9d640 1 --2- 172.21.15.45:0/2338677635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca8156280 0x7f1ca80a4d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ca806e580 tx=0x7f1ca002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bee7f23fe0180e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:38.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.266+0000 7f1ca559a640 1 -- 172.21.15.45:0/2338677635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca002c9e0 con 0x7f1ca8156280 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.266+0000 7f1ca559a640 1 -- 172.21.15.45:0/2338677635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca002cb40 con 0x7f1ca8156280 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.266+0000 7f1ca559a640 1 -- 172.21.15.45:0/2338677635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca00343f0 con 0x7f1ca8156280 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 -- 172.21.15.45:0/2338677635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca8156280 msgr2=0x7f1ca80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 --2- 172.21.15.45:0/2338677635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca8156280 0x7f1ca80a4d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ca806e580 tx=0x7f1ca002be40 comp rx=0 tx=0).stop 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 -- 172.21.15.45:0/2338677635 shutdown_connections 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 --2- 172.21.15.45:0/2338677635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca8156280 0x7f1ca80a4d50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 --2- 172.21.15.45:0/2338677635 >> v2:172.21.15.135:3300/0 conn(0x7f1ca80c32b0 0x7f1ca8155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 --2- 172.21.15.45:0/2338677635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca80bf1e0 0x7f1ca80bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 -- 172.21.15.45:0/2338677635 >> 172.21.15.45:0/2338677635 conn(0x7f1ca80c5bd0 msgr2=0x7f1ca80c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 -- 172.21.15.45:0/2338677635 shutdown_connections 2023-11-18T19:06:38.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.267+0000 7f1cacccf640 1 -- 172.21.15.45:0/2338677635 wait complete. 2023-11-18T19:06:38.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.268+0000 7f1cacccf640 1 Processor -- start 2023-11-18T19:06:38.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.269+0000 7f1cacccf640 1 -- start start 2023-11-18T19:06:38.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1cacccf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca80bf1e0 0x7f1ca80a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1cacccf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80c32b0 0x7f1ca80c0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1cacccf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8156280 0x7f1ca8153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1cacccf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca81ede40 con 0x7f1ca80c32b0 2023-11-18T19:06:38.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1cacccf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80a7290 con 0x7f1ca80bf1e0 2023-11-18T19:06:38.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1cacccf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca81ed080 con 0x7f1ca8156280 2023-11-18T19:06:38.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80c32b0 0x7f1ca80c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80c32b0 0x7f1ca80c0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34304/0 (socket says 172.21.15.45:34304) 2023-11-18T19:06:38.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 -- 172.21.15.45:0/3372437278 learned_addr learned my addr 172.21.15.45:0/3372437278 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:38.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca6d9d640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8156280 0x7f1ca8153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca659c640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca80bf1e0 0x7f1ca80a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 -- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8156280 msgr2=0x7f1ca8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8156280 0x7f1ca8153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 -- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca80bf1e0 msgr2=0x7f1ca80a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca80bf1e0 0x7f1ca80a6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.270+0000 7f1ca5d9b640 1 -- 172.21.15.45:0/3372437278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0009b30 con 0x7f1ca80c32b0 2023-11-18T19:06:38.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.271+0000 7f1ca5d9b640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80c32b0 0x7f1ca80c0740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000d7d0 tx=0x7f1c9000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:38.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.271+0000 7f1c9effd640 1 -- 172.21.15.45:0/3372437278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90004030 con 0x7f1ca80c32b0 2023-11-18T19:06:38.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.271+0000 7f1c9effd640 1 -- 172.21.15.45:0/3372437278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90004190 con 0x7f1ca80c32b0 2023-11-18T19:06:38.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.271+0000 7f1c9effd640 1 -- 172.21.15.45:0/3372437278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90004520 con 0x7f1ca80c32b0 2023-11-18T19:06:38.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.271+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca81ed360 con 0x7f1ca80c32b0 2023-11-18T19:06:38.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.271+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca81ed920 con 0x7f1ca80c32b0 2023-11-18T19:06:38.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.272+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca81edae0 con 0x7f1ca80c32b0 2023-11-18T19:06:38.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.273+0000 7f1c9effd640 1 -- 172.21.15.45:0/3372437278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c9000b6c0 con 0x7f1ca80c32b0 2023-11-18T19:06:38.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.274+0000 7f1c9effd640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f1c8806ae70 0x7f1c8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.274+0000 7f1c9effd640 1 -- 172.21.15.45:0/3372437278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c90089710 con 0x7f1ca80c32b0 2023-11-18T19:06:38.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.275+0000 7f1ca659c640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f1c8806ae70 0x7f1c8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.275+0000 7f1ca659c640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f1c8806ae70 0x7f1c8806d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009970 tx=0x7f1c98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:38.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.279+0000 7f1c9effd640 1 -- 172.21.15.45:0/3372437278 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c90054720 con 0x7f1ca80c32b0 2023-11-18T19:06:38.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.485+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f1ca80747c0 con 0x7f1ca80c32b0 2023-11-18T19:06:38.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.543+0000 7f1c9effd640 1 -- 172.21.15.45:0/3372437278 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f1c90057d40 con 0x7f1ca80c32b0 2023-11-18T19:06:38.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.547+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f1c8806ae70 msgr2=0x7f1c8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.547+0000 7f1cacccf640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f1c8806ae70 0x7f1c8806d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009970 tx=0x7f1c98008040 comp rx=0 tx=0).stop 2023-11-18T19:06:38.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.547+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80c32b0 msgr2=0x7f1ca80c0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.547+0000 7f1cacccf640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80c32b0 0x7f1ca80c0740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000d7d0 tx=0x7f1c9000dc90 comp rx=0 tx=0).stop 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 shutdown_connections 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f1c8806ae70 0x7f1c8806d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1ca8156280 0x7f1ca8153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80c32b0 0x7f1ca80c0740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 --2- 172.21.15.45:0/3372437278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca80bf1e0 0x7f1ca80a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 >> 172.21.15.45:0/3372437278 conn(0x7f1ca80c5bd0 msgr2=0x7f1ca8157210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 shutdown_connections 2023-11-18T19:06:38.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.548+0000 7f1cacccf640 1 -- 172.21.15.45:0/3372437278 wait complete. 2023-11-18T19:06:38.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-18T19:06:38.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.806+0000 7f42d3fff640 1 Processor -- start 2023-11-18T19:06:38.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.806+0000 7f42d3fff640 1 -- start start 2023-11-18T19:06:38.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.808+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 0x7f42d40727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.808+0000 7f42d3fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42d4155880 0x7f42d406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.808+0000 7f42d3fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40c1f20 con 0x7f42d40c55b0 2023-11-18T19:06:38.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.808+0000 7f42d3fff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40c1d10 con 0x7f42d4155880 2023-11-18T19:06:38.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.808+0000 7f42d3fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4071d90 con 0x7f42d40a5100 2023-11-18T19:06:38.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.808+0000 7f42cbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f42d40c55b0 0x7f42d40702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52700/0 (socket says 172.21.15.45:52700) 2023-11-18T19:06:38.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.808+0000 7f42cbfff640 1 -- 172.21.15.45:0/1836112375 learned_addr learned my addr 172.21.15.45:0/1836112375 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d37fe640 1 --2- 172.21.15.45:0/1836112375 >> v2:172.21.15.135:3300/0 conn(0x7f42d4155880 0x7f42d406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 0x7f42d40727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247890193 0 0) 0x7f42d40c1f20 con 0x7f42d40c55b0 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c0003520 con 0x7f42d40c55b0 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3989258948 0 0) 0x7f42c0003520 con 0x7f42d40c55b0 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 msgr2=0x7f42d40727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 0x7f42d40727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 >> v2:172.21.15.135:3300/0 conn(0x7f42d4155880 msgr2=0x7f42d406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:38.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 --2- 172.21.15.45:0/1836112375 >> v2:172.21.15.135:3300/0 conn(0x7f42d4155880 0x7f42d406daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40c2200 con 0x7f42d40c55b0 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.809+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f42bc001670 con 0x7f42d40c55b0 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 >> v1:172.21.15.45:6789/0 conn(0x7f42d40c55b0 legacy=0x7f42d40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d27fc640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d27fc640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42c00047c0 0x7f42c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d27fc640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 0x7f42c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40c1d10 con 0x7f42c0003970 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4071d90 con 0x7f42c00047c0 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c000b9d0 con 0x7f42d40a5100 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42cbfff640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42c00047c0 0x7f42c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d37fe640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 0x7f42c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d2ffd640 1 -- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 msgr2=0x7f42c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 0x7f42c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d2ffd640 1 -- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42c00047c0 msgr2=0x7f42c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42c00047c0 0x7f42c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d2ffd640 1 -- 172.21.15.45:0/1836112375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0003520 con 0x7f42c0003970 2023-11-18T19:06:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.810+0000 7f42d37fe640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d40a5100 0x7f42c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.811+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42c0003d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009af0 tx=0x7f42c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1c42698c29fc1d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c402c6b0 con 0x7f42c0003970 2023-11-18T19:06:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c402c810 con 0x7f42c0003970 2023-11-18T19:06:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d27fc640 1 -- 172.21.15.45:0/1836112375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c402cba0 con 0x7f42c0003970 2023-11-18T19:06:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d3fff640 1 -- 172.21.15.45:0/1836112375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 msgr2=0x7f42c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d3fff640 1 --2- 172.21.15.45:0/1836112375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42c0003d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009af0 tx=0x7f42c00057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d37fe640 1 -- 172.21.15.45:0/1836112375 reap_dead start 2023-11-18T19:06:38.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d3fff640 1 -- 172.21.15.45:0/1836112375 shutdown_connections 2023-11-18T19:06:38.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.812+0000 7f42d3fff640 1 -- 172.21.15.45:0/1836112375 >> 172.21.15.45:0/1836112375 conn(0x7f42d40a78a0 msgr2=0x7f42d40a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:38.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.813+0000 7f42d3fff640 1 -- 172.21.15.45:0/1836112375 shutdown_connections 2023-11-18T19:06:38.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.813+0000 7f42d3fff640 1 -- 172.21.15.45:0/1836112375 wait complete. 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.814+0000 7f42d3fff640 1 Processor -- start 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.815+0000 7f42d3fff640 1 -- start start 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.815+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42d414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.815+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40ab760 0x7f42d406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.815+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d406cf50 0x7f42d41ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.815+0000 7f42d3fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4150120 con 0x7f42c0003970 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.815+0000 7f42d3fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4072ae0 con 0x7f42d40ab760 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.815+0000 7f42d3fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4150a40 con 0x7f42d406cf50 2023-11-18T19:06:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42d414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42d414c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34312/0 (socket says 172.21.15.45:34312) 2023-11-18T19:06:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 -- 172.21.15.45:0/2929345604 learned_addr learned my addr 172.21.15.45:0/2929345604 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42cbfff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40ab760 0x7f42d406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d37fe640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d406cf50 0x7f42d41ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 -- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d406cf50 msgr2=0x7f42d41ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d406cf50 0x7f42d41ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 -- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40ab760 msgr2=0x7f42d406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40ab760 0x7f42d406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42d2ffd640 1 -- 172.21.15.45:0/2929345604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4150d20 con 0x7f42c0003970 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.816+0000 7f42cbfff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40ab760 0x7f42d406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.817+0000 7f42d2ffd640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42d414c3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42c4037040 tx=0x7f42c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.817+0000 7f42cb7fe640 1 -- 172.21.15.45:0/2929345604 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4003810 con 0x7f42c0003970 2023-11-18T19:06:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.817+0000 7f42cb7fe640 1 -- 172.21.15.45:0/2929345604 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4003970 con 0x7f42c0003970 2023-11-18T19:06:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.817+0000 7f42cb7fe640 1 -- 172.21.15.45:0/2929345604 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4003d20 con 0x7f42c0003970 2023-11-18T19:06:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.817+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d4150120 con 0x7f42c0003970 2023-11-18T19:06:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.817+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d41ed2a0 con 0x7f42c0003970 2023-11-18T19:06:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.818+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4067940 con 0x7f42c0003970 2023-11-18T19:06:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.819+0000 7f42cb7fe640 1 -- 172.21.15.45:0/2929345604 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42c4047450 con 0x7f42c0003970 2023-11-18T19:06:38.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.820+0000 7f42cb7fe640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f42b406ae40 0x7f42b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:38.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.820+0000 7f42cb7fe640 1 -- 172.21.15.45:0/2929345604 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f42c40aba20 con 0x7f42c0003970 2023-11-18T19:06:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.820+0000 7f42cbfff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f42b406ae40 0x7f42b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.821+0000 7f42cbfff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f42b406ae40 0x7f42b406d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42bc001eb0 tx=0x7f42bc000fb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:38.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:38.825+0000 7f42cb7fe640 1 -- 172.21.15.45:0/2929345604 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42c4076a00 con 0x7f42c0003970 2023-11-18T19:06:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:39.025+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f42d40683a0 con 0x7f42c0003970 2023-11-18T19:06:40.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.560+0000 7f42cb7fe640 1 -- 172.21.15.45:0/2929345604 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f42c407a020 con 0x7f42c0003970 2023-11-18T19:06:40.562 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' created 2023-11-18T19:06:40.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.565+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f42b406ae40 msgr2=0x7f42b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:40.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.565+0000 7f42d3fff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f42b406ae40 0x7f42b406d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42bc001eb0 tx=0x7f42bc000fb0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.565+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 msgr2=0x7f42d414c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:40.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.565+0000 7f42d3fff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42d414c3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42c4037040 tx=0x7f42c4004730 comp rx=0 tx=0).stop 2023-11-18T19:06:40.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.566+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 shutdown_connections 2023-11-18T19:06:40.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.566+0000 7f42d3fff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f42b406ae40 0x7f42b406d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.566+0000 7f42d3fff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42d406cf50 0x7f42d41ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.566+0000 7f42d3fff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40ab760 0x7f42d406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.566+0000 7f42d3fff640 1 --2- 172.21.15.45:0/2929345604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42c0003970 0x7f42d414c3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.566+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 >> 172.21.15.45:0/2929345604 conn(0x7f42d40a78a0 msgr2=0x7f42d4070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:40.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.567+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 shutdown_connections 2023-11-18T19:06:40.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.567+0000 7f42d3fff640 1 -- 172.21.15.45:0/2929345604 wait complete. 2023-11-18T19:06:40.597 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-18T19:06:40.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.793+0000 7f6be3547640 1 Processor -- start 2023-11-18T19:06:40.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.793+0000 7f6be3547640 1 -- start start 2023-11-18T19:06:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.794+0000 7f6be3547640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6bdc0c8190 0x7f6bdc154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.794+0000 7f6be3547640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0c47a0 con 0x7f6bdc158490 2023-11-18T19:06:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.794+0000 7f6be3547640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0c4a10 con 0x7f6bdc151c80 2023-11-18T19:06:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.794+0000 7f6be3547640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc1554c0 con 0x7f6bdc0c8190 2023-11-18T19:06:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.795+0000 7f6be1d44640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6bdc158490 0x7f6bdc154870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52702/0 (socket says 172.21.15.45:52702) 2023-11-18T19:06:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.795+0000 7f6be1d44640 1 -- 172.21.15.45:0/3920343498 learned_addr learned my addr 172.21.15.45:0/3920343498 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.795+0000 7f6be2d46640 1 --2- 172.21.15.45:0/3920343498 >> v2:172.21.15.45:3300/0 conn(0x7f6bdc0c8190 0x7f6bdc154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.795+0000 7f6be1543640 1 -- 172.21.15.45:0/3920343498 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302909411 0 0) 0x7f6bdc0c47a0 con 0x7f6bdc158490 2023-11-18T19:06:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.795+0000 7f6be1543640 1 -- 172.21.15.45:0/3920343498 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc8003520 con 0x7f6bdc158490 2023-11-18T19:06:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.796+0000 7f6be2d46640 1 -- 172.21.15.45:0/3920343498 >> v1:172.21.15.135:6789/0 conn(0x7f6bdc151c80 legacy=0x7f6bdc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.796+0000 7f6be2d46640 1 -- 172.21.15.45:0/3920343498 >> v1:172.21.15.45:6789/0 conn(0x7f6bdc158490 legacy=0x7f6bdc154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.796+0000 7f6be2d46640 1 -- 172.21.15.45:0/3920343498 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0c4cf0 con 0x7f6bdc0c8190 2023-11-18T19:06:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.797+0000 7f6be2d46640 1 --2- 172.21.15.45:0/3920343498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc0c8190 0x7f6bdc154f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009d90 tx=0x7f6bd402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd3b7a6622da7d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.797+0000 7f6be1543640 1 -- 172.21.15.45:0/3920343498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd402cbd0 con 0x7f6bdc0c8190 2023-11-18T19:06:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.797+0000 7f6be1543640 1 -- 172.21.15.45:0/3920343498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd402cd30 con 0x7f6bdc0c8190 2023-11-18T19:06:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.797+0000 7f6be1543640 1 -- 172.21.15.45:0/3920343498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd402cea0 con 0x7f6bdc0c8190 2023-11-18T19:06:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.798+0000 7f6be3547640 1 -- 172.21.15.45:0/3920343498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc0c8190 msgr2=0x7f6bdc154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.798+0000 7f6be3547640 1 --2- 172.21.15.45:0/3920343498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc0c8190 0x7f6bdc154f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009d90 tx=0x7f6bd402be20 comp rx=0 tx=0).stop 2023-11-18T19:06:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.798+0000 7f6be3547640 1 -- 172.21.15.45:0/3920343498 shutdown_connections 2023-11-18T19:06:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.798+0000 7f6be3547640 1 --2- 172.21.15.45:0/3920343498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc0c8190 0x7f6bdc154f80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.798+0000 7f6be3547640 1 -- 172.21.15.45:0/3920343498 >> 172.21.15.45:0/3920343498 conn(0x7f6bdc066820 msgr2=0x7f6bdc0c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:40.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.798+0000 7f6be3547640 1 -- 172.21.15.45:0/3920343498 shutdown_connections 2023-11-18T19:06:40.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.798+0000 7f6be3547640 1 -- 172.21.15.45:0/3920343498 wait complete. 2023-11-18T19:06:40.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.800+0000 7f6be3547640 1 Processor -- start 2023-11-18T19:06:40.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.800+0000 7f6be3547640 1 -- start start 2023-11-18T19:06:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be3547640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bdc0c8190 0x7f6bdc14a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be3547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc151c80 0x7f6bdc148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be3547640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bdc0c4090 0x7f6bdc148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be3547640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc157430 con 0x7f6bdc151c80 2023-11-18T19:06:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be3547640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc157950 con 0x7f6bdc0c4090 2023-11-18T19:06:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be3547640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc148b90 con 0x7f6bdc0c8190 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be1d44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc151c80 0x7f6bdc148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be1d44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc151c80 0x7f6bdc148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34332/0 (socket says 172.21.15.45:34332) 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be1d44640 1 -- 172.21.15.45:0/3457094469 learned_addr learned my addr 172.21.15.45:0/3457094469 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.801+0000 7f6be2545640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bdc0c8190 0x7f6bdc14a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be2d46640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bdc0c4090 0x7f6bdc148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be1d44640 1 -- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bdc0c8190 msgr2=0x7f6bdc14a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be1d44640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bdc0c8190 0x7f6bdc14a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be1d44640 1 -- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bdc0c4090 msgr2=0x7f6bdc148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be1d44640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bdc0c4090 0x7f6bdc148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be1d44640 1 -- 172.21.15.45:0/3457094469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009a70 con 0x7f6bdc151c80 2023-11-18T19:06:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be1d44640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc151c80 0x7f6bdc148110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00c3e0 tx=0x7f6bcc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:40.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6bd2ffd640 1 -- 172.21.15.45:0/3457094469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc005ce0 con 0x7f6bdc151c80 2023-11-18T19:06:40.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6bd2ffd640 1 -- 172.21.15.45:0/3457094469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc005e40 con 0x7f6bdc151c80 2023-11-18T19:06:40.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6bd2ffd640 1 -- 172.21.15.45:0/3457094469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0072d0 con 0x7f6bdc151c80 2023-11-18T19:06:40.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc0cad20 con 0x7f6bdc151c80 2023-11-18T19:06:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.802+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc156de0 con 0x7f6bdc151c80 2023-11-18T19:06:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.804+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc068410 con 0x7f6bdc151c80 2023-11-18T19:06:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.805+0000 7f6bd2ffd640 1 -- 172.21.15.45:0/3457094469 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6bcc0074f0 con 0x7f6bdc151c80 2023-11-18T19:06:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.806+0000 7f6bd2ffd640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6bc006ae90 0x7f6bc006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.806+0000 7f6bd2ffd640 1 -- 172.21.15.45:0/3457094469 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6bcc088d00 con 0x7f6bdc151c80 2023-11-18T19:06:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.806+0000 7f6be2545640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6bc006ae90 0x7f6bc006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.807+0000 7f6be2545640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6bc006ae90 0x7f6bc006d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007fd0 tx=0x7f6bd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:40.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:40.811+0000 7f6bd2ffd640 1 -- 172.21.15.45:0/3457094469 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6bcc08c030 con 0x7f6bdc151c80 2023-11-18T19:06:41.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.005+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f6bdc1ecd90 con 0x7f6bdc151c80 2023-11-18T19:06:41.345 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-11-18T19:06:41.344+0000 7ff9b8dd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-18T19:06:41.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.564+0000 7f6bd2ffd640 1 -- 172.21.15.45:0/3457094469 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6bcc053d00 con 0x7f6bdc151c80 2023-11-18T19:06:41.566 INFO:teuthology.orchestra.run.smithi045.stderr:set pool 4 allow_ec_overwrites to true 2023-11-18T19:06:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.568+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6bc006ae90 msgr2=0x7f6bc006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.568+0000 7f6be3547640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6bc006ae90 0x7f6bc006d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007fd0 tx=0x7f6bd8009040 comp rx=0 tx=0).stop 2023-11-18T19:06:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.568+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc151c80 msgr2=0x7f6bdc148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.568+0000 7f6be3547640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc151c80 0x7f6bdc148110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00c3e0 tx=0x7f6bcc00c8a0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 shutdown_connections 2023-11-18T19:06:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bdc0c4090 0x7f6bdc148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bdc151c80 0x7f6bdc148110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6bc006ae90 0x7f6bc006d350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 --2- 172.21.15.45:0/3457094469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6bdc0c8190 0x7f6bdc14a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 >> 172.21.15.45:0/3457094469 conn(0x7f6bdc066820 msgr2=0x7f6bdc14ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 shutdown_connections 2023-11-18T19:06:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.569+0000 7f6be3547640 1 -- 172.21.15.45:0/3457094469 wait complete. 2023-11-18T19:06:41.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-18T19:06:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.803+0000 7fa083aaf640 1 Processor -- start 2023-11-18T19:06:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.803+0000 7fa083aaf640 1 -- start start 2023-11-18T19:06:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.805+0000 7fa083aaf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa07c14fc40 0x7fa07c152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.805+0000 7fa083aaf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0c07d0 con 0x7fa07c0c1d50 2023-11-18T19:06:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.805+0000 7fa083aaf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c06e3b0 con 0x7fa07c0ab740 2023-11-18T19:06:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.805+0000 7fa083aaf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c072070 con 0x7fa07c14fc40 2023-11-18T19:06:41.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.805+0000 7fa08204c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa07c0c1d50 0x7fa07c0c4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52706/0 (socket says 172.21.15.45:52706) 2023-11-18T19:06:41.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.805+0000 7fa08204c640 1 -- 172.21.15.45:0/753886575 learned_addr learned my addr 172.21.15.45:0/753886575 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:41.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.805+0000 7fa08184b640 1 --2- 172.21.15.45:0/753886575 >> v2:172.21.15.45:3300/0 conn(0x7fa07c14fc40 0x7fa07c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:41.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.806+0000 7fa080849640 1 -- 172.21.15.45:0/753886575 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063301437 0 0) 0x7fa07c0c07d0 con 0x7fa07c0c1d50 2023-11-18T19:06:41.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.806+0000 7fa080849640 1 -- 172.21.15.45:0/753886575 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa068003520 con 0x7fa07c0c1d50 2023-11-18T19:06:41.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.806+0000 7fa08184b640 1 -- 172.21.15.45:0/753886575 >> v1:172.21.15.135:6789/0 conn(0x7fa07c0ab740 legacy=0x7fa07c06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:41.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.806+0000 7fa08184b640 1 -- 172.21.15.45:0/753886575 >> v1:172.21.15.45:6789/0 conn(0x7fa07c0c1d50 legacy=0x7fa07c0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:41.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.806+0000 7fa08184b640 1 -- 172.21.15.45:0/753886575 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0c21a0 con 0x7fa07c14fc40 2023-11-18T19:06:41.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.808+0000 7fa08184b640 1 --2- 172.21.15.45:0/753886575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c14fc40 0x7fa07c152490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0780097a0 tx=0x7fa07802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d800f3a6ee9ce1 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:41.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.808+0000 7fa080849640 1 -- 172.21.15.45:0/753886575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07802e070 con 0x7fa07c14fc40 2023-11-18T19:06:41.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.808+0000 7fa080849640 1 -- 172.21.15.45:0/753886575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0780315a0 con 0x7fa07c14fc40 2023-11-18T19:06:41.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.808+0000 7fa080849640 1 -- 172.21.15.45:0/753886575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078031930 con 0x7fa07c14fc40 2023-11-18T19:06:41.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.809+0000 7fa083aaf640 1 -- 172.21.15.45:0/753886575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c14fc40 msgr2=0x7fa07c152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:41.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.809+0000 7fa083aaf640 1 --2- 172.21.15.45:0/753886575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c14fc40 0x7fa07c152490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0780097a0 tx=0x7fa07802b840 comp rx=0 tx=0).stop 2023-11-18T19:06:41.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.809+0000 7fa083aaf640 1 -- 172.21.15.45:0/753886575 shutdown_connections 2023-11-18T19:06:41.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.809+0000 7fa083aaf640 1 --2- 172.21.15.45:0/753886575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c14fc40 0x7fa07c152490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.809+0000 7fa083aaf640 1 -- 172.21.15.45:0/753886575 >> 172.21.15.45:0/753886575 conn(0x7fa07c0a7980 msgr2=0x7fa07c0a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:41.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.809+0000 7fa083aaf640 1 -- 172.21.15.45:0/753886575 shutdown_connections 2023-11-18T19:06:41.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.809+0000 7fa083aaf640 1 -- 172.21.15.45:0/753886575 wait complete. 2023-11-18T19:06:41.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.811+0000 7fa083aaf640 1 Processor -- start 2023-11-18T19:06:41.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.811+0000 7fa083aaf640 1 -- start start 2023-11-18T19:06:41.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa083aaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c0ab740 0x7fa07c0aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:41.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa083aaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa07c0c1d50 0x7fa07c0a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:41.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa083aaf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa07c06fdc0 0x7fa07c0c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:41.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa083aaf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c071240 con 0x7fa07c0ab740 2023-11-18T19:06:41.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa083aaf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c070780 con 0x7fa07c06fdc0 2023-11-18T19:06:41.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa083aaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0a9e60 con 0x7fa07c0c1d50 2023-11-18T19:06:41.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa08184b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c0ab740 0x7fa07c0aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:41.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa08184b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c0ab740 0x7fa07c0aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34346/0 (socket says 172.21.15.45:34346) 2023-11-18T19:06:41.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa08184b640 1 -- 172.21.15.45:0/1911635057 learned_addr learned my addr 172.21.15.45:0/1911635057 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:41.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa08104a640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa07c0c1d50 0x7fa07c0a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:41.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.812+0000 7fa08204c640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa07c06fdc0 0x7fa07c0c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:41.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa08184b640 1 -- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa07c0c1d50 msgr2=0x7fa07c0a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:41.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa08184b640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa07c0c1d50 0x7fa07c0a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa08184b640 1 -- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa07c06fdc0 msgr2=0x7fa07c0c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa08184b640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa07c06fdc0 0x7fa07c0c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa08184b640 1 -- 172.21.15.45:0/1911635057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078009400 con 0x7fa07c0ab740 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa08184b640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c0ab740 0x7fa07c0aa2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa078034040 tx=0x7fa0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa0727fc640 1 -- 172.21.15.45:0/1911635057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078032840 con 0x7fa07c0ab740 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa0727fc640 1 -- 172.21.15.45:0/1911635057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0780329c0 con 0x7fa07c0ab740 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa0727fc640 1 -- 172.21.15.45:0/1911635057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078032d70 con 0x7fa07c0ab740 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.813+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c1ede50 con 0x7fa07c0ab740 2023-11-18T19:06:41.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.814+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0709d0 con 0x7fa07c0ab740 2023-11-18T19:06:41.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.815+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c066b80 con 0x7fa07c0ab740 2023-11-18T19:06:41.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.816+0000 7fa0727fc640 1 -- 172.21.15.45:0/1911635057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa07804e430 con 0x7fa07c0ab740 2023-11-18T19:06:41.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.816+0000 7fa0727fc640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa06006ae70 0x7fa06006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:41.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.817+0000 7fa0727fc640 1 -- 172.21.15.45:0/1911635057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fa0780ab8b0 con 0x7fa07c0ab740 2023-11-18T19:06:41.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.817+0000 7fa08104a640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa06006ae70 0x7fa06006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:41.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.817+0000 7fa08104a640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa06006ae70 0x7fa06006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa07c14e3d0 tx=0x7fa06c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:41.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:41.821+0000 7fa0727fc640 1 -- 172.21.15.45:0/1911635057 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa078076680 con 0x7fa07c0ab740 2023-11-18T19:06:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.050+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fa07c0747c0 con 0x7fa07c0ab740 2023-11-18T19:06:42.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.610+0000 7fa0727fc640 1 -- 172.21.15.45:0/1911635057 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa078079ca0 con 0x7fa07c0ab740 2023-11-18T19:06:42.612 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 4 to fsmap 2023-11-18T19:06:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa06006ae70 msgr2=0x7fa06006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa06006ae70 0x7fa06006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa07c14e3d0 tx=0x7fa06c009040 comp rx=0 tx=0).stop 2023-11-18T19:06:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c0ab740 msgr2=0x7fa07c0aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c0ab740 0x7fa07c0aa2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa078034040 tx=0x7fa0780046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 shutdown_connections 2023-11-18T19:06:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa07c06fdc0 0x7fa07c0c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa06006ae70 0x7fa06006d330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa07c0c1d50 0x7fa07c0a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.614+0000 7fa083aaf640 1 --2- 172.21.15.45:0/1911635057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa07c0ab740 0x7fa07c0aa2b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.615+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 >> 172.21.15.45:0/1911635057 conn(0x7fa07c0a7980 msgr2=0x7fa07c151120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.615+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 shutdown_connections 2023-11-18T19:06:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.615+0000 7fa083aaf640 1 -- 172.21.15.45:0/1911635057 wait complete. 2023-11-18T19:06:42.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:06:42.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.851+0000 7f60c8a60640 1 Processor -- start 2023-11-18T19:06:42.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.851+0000 7f60c8a60640 1 -- start start 2023-11-18T19:06:42.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.853+0000 7f60c8a60640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60c40c2fb0 0x7f60c40c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:42.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.853+0000 7f60c8a60640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c40a5540 con 0x7f60c40722c0 2023-11-18T19:06:42.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.853+0000 7f60c8a60640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c4156780 con 0x7f60c4155890 2023-11-18T19:06:42.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.853+0000 7f60c8a60640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c406b9a0 con 0x7f60c40c2fb0 2023-11-18T19:06:42.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.853+0000 7f60c37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60c40c2fb0 0x7f60c40c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:42.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.853+0000 7f60baffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f60c40722c0 0x7f60c40a4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52716/0 (socket says 172.21.15.45:52716) 2023-11-18T19:06:42.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.853+0000 7f60baffd640 1 -- 172.21.15.45:0/1408740442 learned_addr learned my addr 172.21.15.45:0/1408740442 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:42.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.854+0000 7f60c2ffd640 1 -- 172.21.15.45:0/1408740442 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390737397 0 0) 0x7f60c40a5540 con 0x7f60c40722c0 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.854+0000 7f60c2ffd640 1 -- 172.21.15.45:0/1408740442 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b0003520 con 0x7f60c40722c0 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.854+0000 7f60c37fe640 1 -- 172.21.15.45:0/1408740442 >> v1:172.21.15.135:6789/0 conn(0x7f60c4155890 legacy=0x7f60c4155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.854+0000 7f60c37fe640 1 -- 172.21.15.45:0/1408740442 >> v1:172.21.15.45:6789/0 conn(0x7f60c40722c0 legacy=0x7f60c40a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.854+0000 7f60c37fe640 1 -- 172.21.15.45:0/1408740442 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c406bc80 con 0x7f60c40c2fb0 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.855+0000 7f60c37fe640 1 --2- 172.21.15.45:0/1408740442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c40c2fb0 0x7f60c40c39f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009d90 tx=0x7f60b402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabe4e3d3d0e90f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.855+0000 7f60c2ffd640 1 -- 172.21.15.45:0/1408740442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b402cbd0 con 0x7f60c40c2fb0 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.855+0000 7f60c2ffd640 1 -- 172.21.15.45:0/1408740442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b402cd30 con 0x7f60c40c2fb0 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.855+0000 7f60c2ffd640 1 -- 172.21.15.45:0/1408740442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b402cea0 con 0x7f60c40c2fb0 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.856+0000 7f60c8a60640 1 -- 172.21.15.45:0/1408740442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c40c2fb0 msgr2=0x7f60c40c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.856+0000 7f60c8a60640 1 --2- 172.21.15.45:0/1408740442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c40c2fb0 0x7f60c40c39f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009d90 tx=0x7f60b402be20 comp rx=0 tx=0).stop 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.856+0000 7f60c8a60640 1 -- 172.21.15.45:0/1408740442 shutdown_connections 2023-11-18T19:06:42.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.856+0000 7f60c8a60640 1 --2- 172.21.15.45:0/1408740442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c40c2fb0 0x7f60c40c39f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.856+0000 7f60c8a60640 1 -- 172.21.15.45:0/1408740442 >> 172.21.15.45:0/1408740442 conn(0x7f60c40c5af0 msgr2=0x7f60c40c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.856+0000 7f60c8a60640 1 -- 172.21.15.45:0/1408740442 shutdown_connections 2023-11-18T19:06:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.856+0000 7f60c8a60640 1 -- 172.21.15.45:0/1408740442 wait complete. 2023-11-18T19:06:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.858+0000 7f60c8a60640 1 Processor -- start 2023-11-18T19:06:42.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.858+0000 7f60c8a60640 1 -- start start 2023-11-18T19:06:42.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c8a60640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60c40722c0 0x7f60c4071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:42.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c8a60640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60c40c2fb0 0x7f60c4149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:42.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c8a60640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c4155890 0x7f60c414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:42.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c8a60640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4152610 con 0x7f60c4155890 2023-11-18T19:06:42.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c8a60640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4152f50 con 0x7f60c40c2fb0 2023-11-18T19:06:42.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c8a60640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4152c70 con 0x7f60c40722c0 2023-11-18T19:06:42.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c4155890 0x7f60c414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c4155890 0x7f60c414a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34362/0 (socket says 172.21.15.45:34362) 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c3fff640 1 -- 172.21.15.45:0/118912356 learned_addr learned my addr 172.21.15.45:0/118912356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60baffd640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60c40c2fb0 0x7f60c4149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c3fff640 1 -- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60c40722c0 msgr2=0x7f60c4071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.859+0000 7f60c37fe640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60c40722c0 0x7f60c4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c3fff640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60c40722c0 0x7f60c4071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c3fff640 1 -- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60c40c2fb0 msgr2=0x7f60c4149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c3fff640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60c40c2fb0 0x7f60c4149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c3fff640 1 -- 172.21.15.45:0/118912356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009a70 con 0x7f60c4155890 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60baffd640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60c40c2fb0 0x7f60c4149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c3fff640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c4155890 0x7f60c414a000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60bc001eb0 tx=0x7f60bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:42.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c0ff9640 1 -- 172.21.15.45:0/118912356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0052d0 con 0x7f60c4155890 2023-11-18T19:06:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c0ff9640 1 -- 172.21.15.45:0/118912356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc005430 con 0x7f60c4155890 2023-11-18T19:06:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c0ff9640 1 -- 172.21.15.45:0/118912356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc003810 con 0x7f60c4155890 2023-11-18T19:06:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c4151310 con 0x7f60c4155890 2023-11-18T19:06:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.860+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c40a8880 con 0x7f60c4155890 2023-11-18T19:06:42.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.862+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c4067fc0 con 0x7f60c4155890 2023-11-18T19:06:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.862+0000 7f60c0ff9640 1 -- 172.21.15.45:0/118912356 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60bc003970 con 0x7f60c4155890 2023-11-18T19:06:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.863+0000 7f60c0ff9640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f60a406ae40 0x7f60a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.863+0000 7f60c0ff9640 1 -- 172.21.15.45:0/118912356 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60bc088e20 con 0x7f60c4155890 2023-11-18T19:06:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.864+0000 7f60c37fe640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f60a406ae40 0x7f60a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:42.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.864+0000 7f60c37fe640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f60a406ae40 0x7f60a406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60b4036000 tx=0x7f60b4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:42.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:42.867+0000 7f60c0ff9640 1 -- 172.21.15.45:0/118912356 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60bc053c70 con 0x7f60c4155890 2023-11-18T19:06:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.098+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60c4152100 con 0x7f60c4155890 2023-11-18T19:06:43.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.099+0000 7f60c0ff9640 1 -- 172.21.15.45:0/118912356 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f60c4152100 con 0x7f60c4155890 2023-11-18T19:06:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:43.100 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:06:42.052413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-18T19:06:43.101 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-11-18T19:06:43.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.101+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f60a406ae40 msgr2=0x7f60a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.101+0000 7f60c8a60640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f60a406ae40 0x7f60a406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60b4036000 tx=0x7f60b4030000 comp rx=0 tx=0).stop 2023-11-18T19:06:43.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.101+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c4155890 msgr2=0x7f60c414a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.101+0000 7f60c8a60640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c4155890 0x7f60c414a000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60bc001eb0 tx=0x7f60bc00c890 comp rx=0 tx=0).stop 2023-11-18T19:06:43.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 shutdown_connections 2023-11-18T19:06:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60c4155890 0x7f60c414a000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60c40c2fb0 0x7f60c4149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f60a406ae40 0x7f60a406d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 --2- 172.21.15.45:0/118912356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60c40722c0 0x7f60c4071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 >> 172.21.15.45:0/118912356 conn(0x7f60c40c5af0 msgr2=0x7f60c40c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 shutdown_connections 2023-11-18T19:06:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.102+0000 7f60c8a60640 1 -- 172.21.15.45:0/118912356 wait complete. 2023-11-18T19:06:43.121 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.338+0000 7fcc17978640 1 Processor -- start 2023-11-18T19:06:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.338+0000 7fcc17978640 1 -- start start 2023-11-18T19:06:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc17978640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc1006fb80 0x7fcc101547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc17978640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc1006f1b0 0x7fcc100c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc17978640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100c5830 con 0x7fcc10151f20 2023-11-18T19:06:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc17978640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc100c6a80 con 0x7fcc1006f1b0 2023-11-18T19:06:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc17978640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc100c75f0 con 0x7fcc1006fb80 2023-11-18T19:06:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc15f15640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc1006f1b0 0x7fcc100c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc15f15640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc1006f1b0 0x7fcc100c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51164/0 (socket says 172.21.15.45:51164) 2023-11-18T19:06:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc15f15640 1 -- 172.21.15.45:0/1145492541 learned_addr learned my addr 172.21.15.45:0/1145492541 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.340+0000 7fcc14f13640 1 --2- 172.21.15.45:0/1145492541 >> v2:172.21.15.135:3300/0 conn(0x7fcc1006fb80 0x7fcc101547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.341+0000 7fcc15f15640 1 -- 172.21.15.45:0/1145492541 >> v2:172.21.15.135:3300/0 conn(0x7fcc1006fb80 msgr2=0x7fcc101547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.341+0000 7fcc15f15640 1 --2- 172.21.15.45:0/1145492541 >> v2:172.21.15.135:3300/0 conn(0x7fcc1006fb80 0x7fcc101547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.341+0000 7fcc15f15640 1 -- 172.21.15.45:0/1145492541 >> v1:172.21.15.135:6789/0 conn(0x7fcc10151f20 legacy=0x7fcc100c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.341+0000 7fcc15f15640 1 -- 172.21.15.45:0/1145492541 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100a70c0 con 0x7fcc1006f1b0 2023-11-18T19:06:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.342+0000 7fcc15f15640 1 --2- 172.21.15.45:0/1145492541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc1006f1b0 0x7fcc100c7d70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc100c5a50 tx=0x7fcc0802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac7a2c72604f78b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.343+0000 7fcc0ffff640 1 -- 172.21.15.45:0/1145492541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080317e0 con 0x7fcc1006f1b0 2023-11-18T19:06:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.343+0000 7fcc0ffff640 1 -- 172.21.15.45:0/1145492541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc08031940 con 0x7fcc1006f1b0 2023-11-18T19:06:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.343+0000 7fcc0ffff640 1 -- 172.21.15.45:0/1145492541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08031cd0 con 0x7fcc1006f1b0 2023-11-18T19:06:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.343+0000 7fcc17978640 1 -- 172.21.15.45:0/1145492541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc1006f1b0 msgr2=0x7fcc100c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.343+0000 7fcc17978640 1 --2- 172.21.15.45:0/1145492541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc1006f1b0 0x7fcc100c7d70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc100c5a50 tx=0x7fcc0802b880 comp rx=0 tx=0).stop 2023-11-18T19:06:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.343+0000 7fcc17978640 1 -- 172.21.15.45:0/1145492541 shutdown_connections 2023-11-18T19:06:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.343+0000 7fcc17978640 1 --2- 172.21.15.45:0/1145492541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc1006f1b0 0x7fcc100c7d70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.344+0000 7fcc17978640 1 --2- 172.21.15.45:0/1145492541 >> v2:172.21.15.135:3300/0 conn(0x7fcc1006fb80 0x7fcc101547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.344+0000 7fcc17978640 1 -- 172.21.15.45:0/1145492541 >> 172.21.15.45:0/1145492541 conn(0x7fcc100661f0 msgr2=0x7fcc100665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.344+0000 7fcc17978640 1 -- 172.21.15.45:0/1145492541 shutdown_connections 2023-11-18T19:06:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.344+0000 7fcc17978640 1 -- 172.21.15.45:0/1145492541 wait complete. 2023-11-18T19:06:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.345+0000 7fcc17978640 1 Processor -- start 2023-11-18T19:06:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.346+0000 7fcc17978640 1 -- start start 2023-11-18T19:06:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.346+0000 7fcc17978640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc1006f1b0 0x7fcc100ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.346+0000 7fcc17978640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc1006fb80 0x7fcc100ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.346+0000 7fcc17978640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc10151f20 0x7fcc100ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.346+0000 7fcc17978640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1014a360 con 0x7fcc10151f20 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.346+0000 7fcc17978640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc101ee2d0 con 0x7fcc1006f1b0 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.346+0000 7fcc17978640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100acd50 con 0x7fcc1006fb80 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc10151f20 0x7fcc100ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc10151f20 0x7fcc100ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51170/0 (socket says 172.21.15.45:51170) 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 -- 172.21.15.45:0/4157180023 learned_addr learned my addr 172.21.15.45:0/4157180023 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15714640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc1006f1b0 0x7fcc100ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 -- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc1006fb80 msgr2=0x7fcc100ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc1006fb80 0x7fcc100ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 -- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc1006f1b0 msgr2=0x7fcc100ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc1006f1b0 0x7fcc100ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 -- 172.21.15.45:0/4157180023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080094d0 con 0x7fcc10151f20 2023-11-18T19:06:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15714640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc1006f1b0 0x7fcc100ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.347+0000 7fcc15f15640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc10151f20 0x7fcc100ac810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc080090b0 tx=0x7fcc080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.348+0000 7fcc0dffb640 1 -- 172.21.15.45:0/4157180023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08032880 con 0x7fcc10151f20 2023-11-18T19:06:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.348+0000 7fcc0dffb640 1 -- 172.21.15.45:0/4157180023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc08032a00 con 0x7fcc10151f20 2023-11-18T19:06:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.348+0000 7fcc0dffb640 1 -- 172.21.15.45:0/4157180023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08032db0 con 0x7fcc10151f20 2023-11-18T19:06:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.348+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc101ed510 con 0x7fcc10151f20 2023-11-18T19:06:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.348+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc101edad0 con 0x7fcc10151f20 2023-11-18T19:06:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.349+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc100c8b60 con 0x7fcc10151f20 2023-11-18T19:06:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.350+0000 7fcc0dffb640 1 -- 172.21.15.45:0/4157180023 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc0804d3f0 con 0x7fcc10151f20 2023-11-18T19:06:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.351+0000 7fcc0dffb640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbfc06ae70 0x7fcbfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.351+0000 7fcc0dffb640 1 -- 172.21.15.45:0/4157180023 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc080ab550 con 0x7fcc10151f20 2023-11-18T19:06:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.351+0000 7fcc15714640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbfc06ae70 0x7fcbfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.352+0000 7fcc15714640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbfc06ae70 0x7fcbfc06d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc00007e90 tx=0x7fcc000073a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:43.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.356+0000 7fcc0dffb640 1 -- 172.21.15.45:0/4157180023 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc08076300 con 0x7fcc10151f20 2023-11-18T19:06:43.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.542+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc101edff0 con 0x7fcc10151f20 2023-11-18T19:06:43.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.544+0000 7fcc0dffb640 1 -- 172.21.15.45:0/4157180023 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7fcc101edff0 con 0x7fcc10151f20 2023-11-18T19:06:43.546 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:43.546 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:43.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.546+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbfc06ae70 msgr2=0x7fcbfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.546+0000 7fcc17978640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbfc06ae70 0x7fcbfc06d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc00007e90 tx=0x7fcc000073a0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.546+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc10151f20 msgr2=0x7fcc100ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.546+0000 7fcc17978640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc10151f20 0x7fcc100ac810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcc080090b0 tx=0x7fcc080046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.546+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 shutdown_connections 2023-11-18T19:06:43.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.547+0000 7fcc17978640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc10151f20 0x7fcc100ac810 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.547+0000 7fcc17978640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbfc06ae70 0x7fcbfc06d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.547+0000 7fcc17978640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc1006fb80 0x7fcc100ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.547+0000 7fcc17978640 1 --2- 172.21.15.45:0/4157180023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc1006f1b0 0x7fcc100ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.547+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 >> 172.21.15.45:0/4157180023 conn(0x7fcc100661f0 msgr2=0x7fcc10150830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.547+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 shutdown_connections 2023-11-18T19:06:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.547+0000 7fcc17978640 1 -- 172.21.15.45:0/4157180023 wait complete. 2023-11-18T19:06:43.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.778+0000 7f25cea7e640 1 Processor -- start 2023-11-18T19:06:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.778+0000 7f25cea7e640 1 -- start start 2023-11-18T19:06:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.779+0000 7f25cea7e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25c814e580 0x7f25c80c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.779+0000 7f25cea7e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25c80bd520 0x7f25c8157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.779+0000 7f25cea7e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c8158190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.779+0000 7f25cea7e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c8155510 con 0x7f25c814e580 2023-11-18T19:06:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.779+0000 7f25cea7e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c8154f90 con 0x7f25c80bd520 2023-11-18T19:06:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.779+0000 7f25cea7e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80ca4d0 con 0x7f25c80c7d90 2023-11-18T19:06:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25c814e580 0x7f25c80c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25c814e580 0x7f25c80c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51186/0 (socket says 172.21.15.45:51186) 2023-11-18T19:06:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 -- 172.21.15.45:0/3758779996 learned_addr learned my addr 172.21.15.45:0/3758779996 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25ce27d640 1 --2- 172.21.15.45:0/3758779996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c8158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cd27b640 1 --2- 172.21.15.45:0/3758779996 >> v2:172.21.15.135:3300/0 conn(0x7f25c80bd520 0x7f25c8157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 -- 172.21.15.45:0/3758779996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 msgr2=0x7f25c8158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 --2- 172.21.15.45:0/3758779996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c8158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 -- 172.21.15.45:0/3758779996 >> v2:172.21.15.135:3300/0 conn(0x7f25c80bd520 msgr2=0x7f25c8157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 --2- 172.21.15.45:0/3758779996 >> v2:172.21.15.135:3300/0 conn(0x7f25c80bd520 0x7f25c8157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.780+0000 7f25cda7c640 1 -- 172.21.15.45:0/3758779996 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c806cbb0 con 0x7f25c814e580 2023-11-18T19:06:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.781+0000 7f25cda7c640 1 --2- 172.21.15.45:0/3758779996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c80c4810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25c806c860 tx=0x7f25c402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8136abb4d3ad4fc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cca7a640 1 -- 172.21.15.45:0/3758779996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c402c9e0 con 0x7f25c814e580 2023-11-18T19:06:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cca7a640 1 -- 172.21.15.45:0/3758779996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c402cb40 con 0x7f25c814e580 2023-11-18T19:06:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cca7a640 1 -- 172.21.15.45:0/3758779996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40343f0 con 0x7f25c814e580 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cea7e640 1 -- 172.21.15.45:0/3758779996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 msgr2=0x7f25c80c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cea7e640 1 --2- 172.21.15.45:0/3758779996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c80c4810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25c806c860 tx=0x7f25c402be40 comp rx=0 tx=0).stop 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cea7e640 1 -- 172.21.15.45:0/3758779996 shutdown_connections 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cea7e640 1 --2- 172.21.15.45:0/3758779996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c8158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cea7e640 1 --2- 172.21.15.45:0/3758779996 >> v2:172.21.15.135:3300/0 conn(0x7f25c80bd520 0x7f25c8157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cea7e640 1 --2- 172.21.15.45:0/3758779996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c80c4810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.782+0000 7f25cea7e640 1 -- 172.21.15.45:0/3758779996 >> 172.21.15.45:0/3758779996 conn(0x7f25c8066610 msgr2=0x7f25c8066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.783+0000 7f25cea7e640 1 -- 172.21.15.45:0/3758779996 shutdown_connections 2023-11-18T19:06:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.783+0000 7f25cea7e640 1 -- 172.21.15.45:0/3758779996 wait complete. 2023-11-18T19:06:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.784+0000 7f25cea7e640 1 Processor -- start 2023-11-18T19:06:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.784+0000 7f25cea7e640 1 -- start start 2023-11-18T19:06:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.785+0000 7f25cea7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80bd520 0x7f25c81ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.785+0000 7f25cea7e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c80c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.785+0000 7f25cea7e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c814a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.785+0000 7f25cea7e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c814ebe0 con 0x7f25c814e580 2023-11-18T19:06:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.785+0000 7f25cea7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81eaea0 con 0x7f25c80bd520 2023-11-18T19:06:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.785+0000 7f25cea7e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c814ee30 con 0x7f25c80c7d90 2023-11-18T19:06:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c814a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c814a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51200/0 (socket says 172.21.15.45:51200) 2023-11-18T19:06:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 -- 172.21.15.45:0/2677711484 learned_addr learned my addr 172.21.15.45:0/2677711484 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25cda7c640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80bd520 0x7f25c81ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25cd27b640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c80c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 -- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 msgr2=0x7f25c80c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c80c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 -- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80bd520 msgr2=0x7f25c81ea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80bd520 0x7f25c81ea960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 -- 172.21.15.45:0/2677711484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4009b30 con 0x7f25c814e580 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.786+0000 7f25ce27d640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c814a180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25c000d600 tx=0x7f25c000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.787+0000 7f25be7fc640 1 -- 172.21.15.45:0/2677711484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00125f0 con 0x7f25c814e580 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.787+0000 7f25be7fc640 1 -- 172.21.15.45:0/2677711484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0012770 con 0x7f25c814e580 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.787+0000 7f25be7fc640 1 -- 172.21.15.45:0/2677711484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0012b20 con 0x7f25c814e580 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.787+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c814f110 con 0x7f25c814e580 2023-11-18T19:06:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.787+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c8154330 con 0x7f25c814e580 2023-11-18T19:06:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.788+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c80c2c90 con 0x7f25c814e580 2023-11-18T19:06:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.789+0000 7f25be7fc640 1 -- 172.21.15.45:0/2677711484 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25c0012c80 con 0x7f25c814e580 2023-11-18T19:06:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.790+0000 7f25be7fc640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f25ac06ae70 0x7f25ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.790+0000 7f25be7fc640 1 -- 172.21.15.45:0/2677711484 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25c0089df0 con 0x7f25c814e580 2023-11-18T19:06:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.790+0000 7f25cda7c640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f25ac06ae70 0x7f25ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.790+0000 7f25cda7c640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f25ac06ae70 0x7f25ac06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25c4035000 tx=0x7f25c4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.794+0000 7f25be7fc640 1 -- 172.21.15.45:0/2677711484 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25c0054b20 con 0x7f25c814e580 2023-11-18T19:06:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.990+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25c8067910 con 0x7f25c814e580 2023-11-18T19:06:43.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.993+0000 7f25be7fc640 1 -- 172.21.15.45:0/2677711484 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f25c0058140 con 0x7f25c814e580 2023-11-18T19:06:43.995 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:43.995 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f25ac06ae70 msgr2=0x7f25ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f25ac06ae70 0x7f25ac06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25c4035000 tx=0x7f25c4030000 comp rx=0 tx=0).stop 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 msgr2=0x7f25c814a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c814a180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25c000d600 tx=0x7f25c000dac0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 shutdown_connections 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c814e580 0x7f25c814a180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f25ac06ae70 0x7f25ac06d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25c80c7d90 0x7f25c80c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 --2- 172.21.15.45:0/2677711484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c80bd520 0x7f25c81ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:43.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.996+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 >> 172.21.15.45:0/2677711484 conn(0x7f25c8066610 msgr2=0x7f25c80c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:43.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.997+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 shutdown_connections 2023-11-18T19:06:43.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:43.997+0000 7f25cea7e640 1 -- 172.21.15.45:0/2677711484 wait complete. 2023-11-18T19:06:44.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:06:44.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.259+0000 7f33408c5640 1 Processor -- start 2023-11-18T19:06:44.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.260+0000 7f33408c5640 1 -- start start 2023-11-18T19:06:44.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.261+0000 7f33408c5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f333c0bd520 0x7f333c157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.261+0000 7f33408c5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c0c7d90 0x7f333c158190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.261+0000 7f33408c5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c155510 con 0x7f333c14e580 2023-11-18T19:06:44.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.261+0000 7f33408c5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c154f90 con 0x7f333c0bd520 2023-11-18T19:06:44.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.261+0000 7f33408c5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0ca4d0 con 0x7f333c0c7d90 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333a59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f333c0bd520 0x7f333c157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333b59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c0c7d90 0x7f333c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333b59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c0c7d90 0x7f333c158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:46088/0 (socket says 172.21.15.45:46088) 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333a59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f333c0bd520 0x7f333c157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:32860/0 (socket says 172.21.15.45:32860) 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333b59e640 1 -- 172.21.15.45:0/502909147 learned_addr learned my addr 172.21.15.45:0/502909147 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333ad9d640 1 --1- 172.21.15.45:0/502909147 >> v1:172.21.15.135:6789/0 conn(0x7f333c14e580 0x7f333c0c4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:46968/0 (socket says 172.21.15.45:46968) 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333a59c640 1 -- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c0c7d90 msgr2=0x7f333c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333a59c640 1 --2- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c0c7d90 0x7f333c158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.262+0000 7f333a59c640 1 -- 172.21.15.45:0/502909147 >> v1:172.21.15.135:6789/0 conn(0x7f333c14e580 legacy=0x7f333c0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.263+0000 7f333a59c640 1 -- 172.21.15.45:0/502909147 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c06cbb0 con 0x7f333c0bd520 2023-11-18T19:06:44.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.263+0000 7f333b59e640 1 --2- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c0c7d90 0x7f333c158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:44.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.264+0000 7f333a59c640 1 --2- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 0x7f333c157c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33240097a0 tx=0x7f332402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3588f4d20edef4ea server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:44.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.264+0000 7f3339d9b640 1 -- 172.21.15.45:0/502909147 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324031780 con 0x7f333c0bd520 2023-11-18T19:06:44.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.264+0000 7f3339d9b640 1 -- 172.21.15.45:0/502909147 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33240318e0 con 0x7f333c0bd520 2023-11-18T19:06:44.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.264+0000 7f3339d9b640 1 -- 172.21.15.45:0/502909147 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324031c70 con 0x7f333c0bd520 2023-11-18T19:06:44.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 -- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 msgr2=0x7f333c157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 --2- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 0x7f333c157c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33240097a0 tx=0x7f332402b820 comp rx=0 tx=0).stop 2023-11-18T19:06:44.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 -- 172.21.15.45:0/502909147 shutdown_connections 2023-11-18T19:06:44.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 --2- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c0c7d90 0x7f333c158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 --2- 172.21.15.45:0/502909147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 0x7f333c157c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 -- 172.21.15.45:0/502909147 >> 172.21.15.45:0/502909147 conn(0x7f333c066610 msgr2=0x7f333c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:44.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 -- 172.21.15.45:0/502909147 shutdown_connections 2023-11-18T19:06:44.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.265+0000 7f33408c5640 1 -- 172.21.15.45:0/502909147 wait complete. 2023-11-18T19:06:44.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.267+0000 7f33408c5640 1 Processor -- start 2023-11-18T19:06:44.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.267+0000 7f33408c5640 1 -- start start 2023-11-18T19:06:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f33408c5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 0x7f333c151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f33408c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c0c7d90 0x7f333c14fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f33408c5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c14e580 0x7f333c0c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f33408c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c14ec20 con 0x7f333c0c7d90 2023-11-18T19:06:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f33408c5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0c34f0 con 0x7f333c0bd520 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f33408c5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0c37d0 con 0x7f333c14e580 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f333a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c0c7d90 0x7f333c14fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f333a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c0c7d90 0x7f333c14fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51216/0 (socket says 172.21.15.45:51216) 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f333a59c640 1 -- 172.21.15.45:0/3216310119 learned_addr learned my addr 172.21.15.45:0/3216310119 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.268+0000 7f333ad9d640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 0x7f333c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.269+0000 7f333b59e640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c14e580 0x7f333c0c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.269+0000 7f333a59c640 1 -- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c14e580 msgr2=0x7f333c0c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.269+0000 7f333a59c640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c14e580 0x7f333c0c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.269+0000 7f333a59c640 1 -- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 msgr2=0x7f333c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.269+0000 7f333a59c640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 0x7f333c151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.269+0000 7f333a59c640 1 -- 172.21.15.45:0/3216310119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340094d0 con 0x7f333c0c7d90 2023-11-18T19:06:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.269+0000 7f333a59c640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c0c7d90 0x7f333c14fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3324034040 tx=0x7f33240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.270+0000 7f33337fe640 1 -- 172.21.15.45:0/3216310119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324032820 con 0x7f333c0c7d90 2023-11-18T19:06:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.270+0000 7f33337fe640 1 -- 172.21.15.45:0/3216310119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324032980 con 0x7f333c0c7d90 2023-11-18T19:06:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.270+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3324009400 con 0x7f333c0c7d90 2023-11-18T19:06:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.270+0000 7f33337fe640 1 -- 172.21.15.45:0/3216310119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324032d30 con 0x7f333c0c7d90 2023-11-18T19:06:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.270+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c0c3d90 con 0x7f333c0c7d90 2023-11-18T19:06:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.271+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c067910 con 0x7f333c0c7d90 2023-11-18T19:06:44.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.272+0000 7f33337fe640 1 -- 172.21.15.45:0/3216310119 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f332404e440 con 0x7f333c0c7d90 2023-11-18T19:06:44.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.274+0000 7f33337fe640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f331c06ae40 0x7f331c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.274+0000 7f33337fe640 1 -- 172.21.15.45:0/3216310119 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33240ab8d0 con 0x7f333c0c7d90 2023-11-18T19:06:44.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.274+0000 7f333ad9d640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f331c06ae40 0x7f331c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.275+0000 7f333ad9d640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f331c06ae40 0x7f331c06d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f332c007fd0 tx=0x7f332c001630 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:44.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.278+0000 7f33337fe640 1 -- 172.21.15.45:0/3216310119 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3324076730 con 0x7f333c0c7d90 2023-11-18T19:06:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.507+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f333c14ed60 con 0x7f333c0c7d90 2023-11-18T19:06:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.508+0000 7f33337fe640 1 -- 172.21.15.45:0/3216310119 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f3324079d50 con 0x7f333c0c7d90 2023-11-18T19:06:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:44.509 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:06:42.052413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-18T19:06:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-11-18T19:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.510+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f331c06ae40 msgr2=0x7f331c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.510+0000 7f33408c5640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f331c06ae40 0x7f331c06d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f332c007fd0 tx=0x7f332c001630 comp rx=0 tx=0).stop 2023-11-18T19:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.510+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c0c7d90 msgr2=0x7f333c14fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.510+0000 7f33408c5640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c0c7d90 0x7f333c14fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3324034040 tx=0x7f33240046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 shutdown_connections 2023-11-18T19:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f331c06ae40 0x7f331c06d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f333c14e580 0x7f333c0c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c0c7d90 0x7f333c14fd60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 --2- 172.21.15.45:0/3216310119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333c0bd520 0x7f333c151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 >> 172.21.15.45:0/3216310119 conn(0x7f333c066610 msgr2=0x7f333c0c68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 shutdown_connections 2023-11-18T19:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.511+0000 7f33408c5640 1 -- 172.21.15.45:0/3216310119 wait complete. 2023-11-18T19:06:44.532 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.756+0000 7fd69366f640 1 Processor -- start 2023-11-18T19:06:44.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.756+0000 7fd69366f640 1 -- start start 2023-11-18T19:06:44.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd69366f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd68c0a4d30 0x7fd68c152320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd69366f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd68c152860 0x7fd68c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd69366f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c0a54a0 con 0x7fd68c14c4e0 2023-11-18T19:06:44.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd69366f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c06d5d0 con 0x7fd68c152860 2023-11-18T19:06:44.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd69366f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c06d8b0 con 0x7fd68c0a4d30 2023-11-18T19:06:44.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd691c0c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd68c152860 0x7fd68c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd691c0c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd68c152860 0x7fd68c15cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51222/0 (socket says 172.21.15.45:51222) 2023-11-18T19:06:44.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd691c0c640 1 -- 172.21.15.45:0/656347721 learned_addr learned my addr 172.21.15.45:0/656347721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:44.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.758+0000 7fd690c0a640 1 --2- 172.21.15.45:0/656347721 >> v2:172.21.15.135:3300/0 conn(0x7fd68c0a4d30 0x7fd68c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.759+0000 7fd691c0c640 1 -- 172.21.15.45:0/656347721 >> v2:172.21.15.135:3300/0 conn(0x7fd68c0a4d30 msgr2=0x7fd68c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:44.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.759+0000 7fd691c0c640 1 --2- 172.21.15.45:0/656347721 >> v2:172.21.15.135:3300/0 conn(0x7fd68c0a4d30 0x7fd68c152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.759+0000 7fd691c0c640 1 -- 172.21.15.45:0/656347721 >> v1:172.21.15.135:6789/0 conn(0x7fd68c14c4e0 legacy=0x7fd68c0c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:44.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.759+0000 7fd691c0c640 1 -- 172.21.15.45:0/656347721 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c06db90 con 0x7fd68c152860 2023-11-18T19:06:44.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.760+0000 7fd691c0c640 1 --2- 172.21.15.45:0/656347721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c152860 0x7fd68c15cca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd68c06b200 tx=0x7fd68402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6932d9446de28f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:44.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.760+0000 7fd683fff640 1 -- 172.21.15.45:0/656347721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68402ca80 con 0x7fd68c152860 2023-11-18T19:06:44.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.760+0000 7fd683fff640 1 -- 172.21.15.45:0/656347721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68402cbe0 con 0x7fd68c152860 2023-11-18T19:06:44.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.760+0000 7fd683fff640 1 -- 172.21.15.45:0/656347721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840343f0 con 0x7fd68c152860 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 -- 172.21.15.45:0/656347721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c152860 msgr2=0x7fd68c15cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 --2- 172.21.15.45:0/656347721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c152860 0x7fd68c15cca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd68c06b200 tx=0x7fd68402bee0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 -- 172.21.15.45:0/656347721 shutdown_connections 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 --2- 172.21.15.45:0/656347721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c152860 0x7fd68c15cca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 --2- 172.21.15.45:0/656347721 >> v2:172.21.15.135:3300/0 conn(0x7fd68c0a4d30 0x7fd68c152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 -- 172.21.15.45:0/656347721 >> 172.21.15.45:0/656347721 conn(0x7fd68c06a500 msgr2=0x7fd68c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 -- 172.21.15.45:0/656347721 shutdown_connections 2023-11-18T19:06:44.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.761+0000 7fd69366f640 1 -- 172.21.15.45:0/656347721 wait complete. 2023-11-18T19:06:44.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.763+0000 7fd69366f640 1 Processor -- start 2023-11-18T19:06:44.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.763+0000 7fd69366f640 1 -- start start 2023-11-18T19:06:44.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69366f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c0a4d30 0x7fd68c13dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69366f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68c14c4e0 0x7fd68c151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69366f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68c152860 0x7fd68c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69366f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1424a0 con 0x7fd68c0a4d30 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69366f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1ea970 con 0x7fd68c14c4e0 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69366f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c13e740 con 0x7fd68c152860 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69140b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c0a4d30 0x7fd68c13dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69140b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c0a4d30 0x7fd68c13dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51238/0 (socket says 172.21.15.45:51238) 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd69140b640 1 -- 172.21.15.45:0/1427107786 learned_addr learned my addr 172.21.15.45:0/1427107786 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:44.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.764+0000 7fd690c0a640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68c14c4e0 0x7fd68c151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd691c0c640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68c152860 0x7fd68c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69140b640 1 -- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68c152860 msgr2=0x7fd68c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69140b640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68c152860 0x7fd68c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69140b640 1 -- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68c14c4e0 msgr2=0x7fd68c151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69140b640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68c14c4e0 0x7fd68c151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69140b640 1 -- 172.21.15.45:0/1427107786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684009b30 con 0x7fd68c0a4d30 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69140b640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c0a4d30 0x7fd68c13dc40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c430 tx=0x7fd68800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd681ffb640 1 -- 172.21.15.45:0/1427107786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011790 con 0x7fd68c0a4d30 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd681ffb640 1 -- 172.21.15.45:0/1427107786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6880118f0 con 0x7fd68c0a4d30 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd681ffb640 1 -- 172.21.15.45:0/1427107786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011ce0 con 0x7fd68c0a4d30 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c13e460 con 0x7fd68c0a4d30 2023-11-18T19:06:44.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.765+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c1ea320 con 0x7fd68c0a4d30 2023-11-18T19:06:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.767+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c06c5c0 con 0x7fd68c0a4d30 2023-11-18T19:06:44.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.767+0000 7fd681ffb640 1 -- 172.21.15.45:0/1427107786 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd68801c460 con 0x7fd68c0a4d30 2023-11-18T19:06:44.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.769+0000 7fd681ffb640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd67006ae40 0x7fd67006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.769+0000 7fd681ffb640 1 -- 172.21.15.45:0/1427107786 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6880898b0 con 0x7fd68c0a4d30 2023-11-18T19:06:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.769+0000 7fd690c0a640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd67006ae40 0x7fd67006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:44.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.770+0000 7fd690c0a640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd67006ae40 0x7fd67006d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd68c140430 tx=0x7fd67c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:44.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.774+0000 7fd681ffb640 1 -- 172.21.15.45:0/1427107786 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd688054660 con 0x7fd68c0a4d30 2023-11-18T19:06:44.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.968+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd68c0747c0 con 0x7fd68c0a4d30 2023-11-18T19:06:44.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.972+0000 7fd681ffb640 1 -- 172.21.15.45:0/1427107786 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7fd688057c80 con 0x7fd68c0a4d30 2023-11-18T19:06:44.973 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:44.974 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:44.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd67006ae40 msgr2=0x7fd67006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd67006ae40 0x7fd67006d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd68c140430 tx=0x7fd67c008040 comp rx=0 tx=0).stop 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c0a4d30 msgr2=0x7fd68c13dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c0a4d30 0x7fd68c13dc40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c430 tx=0x7fd68800c8f0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 shutdown_connections 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd67006ae40 0x7fd67006d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd68c152860 0x7fd68c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd68c14c4e0 0x7fd68c151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 --2- 172.21.15.45:0/1427107786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68c0a4d30 0x7fd68c13dc40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 >> 172.21.15.45:0/1427107786 conn(0x7fd68c06a500 msgr2=0x7fd68c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 shutdown_connections 2023-11-18T19:06:44.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:44.975+0000 7fd69366f640 1 -- 172.21.15.45:0/1427107786 wait complete. 2023-11-18T19:06:45.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T19:06:37.510166+0000', 'modified': '2023-11-18T19:06:42.052413+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6835/2364227676', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2364227676}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 2364227676}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-18T19:06:45.400 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T19:06:45.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-18T19:06:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.642+0000 7f68fb9ce640 1 Processor -- start 2023-11-18T19:06:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.643+0000 7f68fb9ce640 1 -- start start 2023-11-18T19:06:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.644+0000 7f68fb9ce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 0x7f68f4152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.644+0000 7f68fb9ce640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f40c07d0 con 0x7f68f40c1d50 2023-11-18T19:06:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.644+0000 7f68fb9ce640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f406e3b0 con 0x7f68f414fc40 2023-11-18T19:06:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.644+0000 7f68fb9ce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40c21e0 con 0x7f68f40ab740 2023-11-18T19:06:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.644+0000 7f68f9f6b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f68f40c1d50 0x7f68f40c4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36420/0 (socket says 172.21.15.45:36420) 2023-11-18T19:06:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.644+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1061119414 learned_addr learned my addr 172.21.15.45:0/1061119414 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f8f69640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 0x7f68f4152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151613097 0 0) 0x7f68f40c07d0 con 0x7f68f40c1d50 2023-11-18T19:06:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68dc003520 con 0x7f68f40c1d50 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1633756529 0 0) 0x7f68dc003520 con 0x7f68f40c1d50 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 msgr2=0x7f68f4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 0x7f68f4152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 >> v1:172.21.15.135:6789/0 conn(0x7f68f414fc40 legacy=0x7f68f406dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4072070 con 0x7f68f40c1d50 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f68ec001670 con 0x7f68f40c1d50 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 >> v1:172.21.15.45:6789/0 conn(0x7f68f40c1d50 legacy=0x7f68f40c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 0x7f68dc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.645+0000 7f68f3fff640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68dc003f20 0x7f68dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f3fff640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40c21e0 con 0x7f68dc004d00 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc00bbc0 con 0x7f68dc003f20 2023-11-18T19:06:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc00bd80 con 0x7f68f40ab740 2023-11-18T19:06:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f976a640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 0x7f68dc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f8f69640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68dc003f20 0x7f68dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 msgr2=0x7f68dc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 0x7f68dc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68dc003f20 msgr2=0x7f68dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68dc003f20 0x7f68dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.646+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1061119414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc003520 con 0x7f68dc004d00 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.647+0000 7f68f976a640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40ab740 0x7f68dc0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.648+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68dc005180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c240 tx=0x7f68dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961d680ef0c226dc server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.648+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec005ad0 con 0x7f68dc004d00 2023-11-18T19:06:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.648+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec005c50 con 0x7f68dc004d00 2023-11-18T19:06:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.648+0000 7f68f3fff640 1 -- 172.21.15.45:0/1061119414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec02c8b0 con 0x7f68dc004d00 2023-11-18T19:06:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.649+0000 7f68fb9ce640 1 -- 172.21.15.45:0/1061119414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 msgr2=0x7f68dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.649+0000 7f68fb9ce640 1 --2- 172.21.15.45:0/1061119414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68dc005180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c240 tx=0x7f68dc0057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.649+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1061119414 reap_dead start 2023-11-18T19:06:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.649+0000 7f68fb9ce640 1 -- 172.21.15.45:0/1061119414 shutdown_connections 2023-11-18T19:06:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.649+0000 7f68fb9ce640 1 -- 172.21.15.45:0/1061119414 >> 172.21.15.45:0/1061119414 conn(0x7f68f40a7980 msgr2=0x7f68f40a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.649+0000 7f68fb9ce640 1 -- 172.21.15.45:0/1061119414 shutdown_connections 2023-11-18T19:06:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.649+0000 7f68fb9ce640 1 -- 172.21.15.45:0/1061119414 wait complete. 2023-11-18T19:06:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.651+0000 7f68fb9ce640 1 Processor -- start 2023-11-18T19:06:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.651+0000 7f68fb9ce640 1 -- start start 2023-11-18T19:06:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68fb9ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68f40aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68fb9ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f4153ff0 0x7f68f40a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68fb9ce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40a6250 0x7f68f4149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68fb9ce640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4156020 con 0x7f68dc004d00 2023-11-18T19:06:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68fb9ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f41e8e40 con 0x7f68f4153ff0 2023-11-18T19:06:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68fb9ce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40a55a0 con 0x7f68f40a6250 2023-11-18T19:06:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68f976a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68f40aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68f976a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68f40aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51252/0 (socket says 172.21.15.45:51252) 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.652+0000 7f68f976a640 1 -- 172.21.15.45:0/3035763635 learned_addr learned my addr 172.21.15.45:0/3035763635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40a6250 0x7f68f4149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f8f69640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f4153ff0 0x7f68f40a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f976a640 1 -- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40a6250 msgr2=0x7f68f4149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f976a640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40a6250 0x7f68f4149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f976a640 1 -- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f4153ff0 msgr2=0x7f68f40a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f976a640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f4153ff0 0x7f68f40a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f976a640 1 -- 172.21.15.45:0/3035763635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40c00e0 con 0x7f68dc004d00 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f8f69640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f4153ff0 0x7f68f40a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f976a640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68f40aa100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68e400eaf0 tx=0x7f68e40020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f1ffb640 1 -- 172.21.15.45:0/3035763635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4003b80 con 0x7f68dc004d00 2023-11-18T19:06:45.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f1ffb640 1 -- 172.21.15.45:0/3035763635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4003ce0 con 0x7f68dc004d00 2023-11-18T19:06:45.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68f1ffb640 1 -- 172.21.15.45:0/3035763635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e400c9a0 con 0x7f68dc004d00 2023-11-18T19:06:45.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f40a71c0 con 0x7f68dc004d00 2023-11-18T19:06:45.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.653+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f40a57f0 con 0x7f68dc004d00 2023-11-18T19:06:45.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.655+0000 7f68f1ffb640 1 -- 172.21.15.45:0/3035763635 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68e400cb00 con 0x7f68dc004d00 2023-11-18T19:06:45.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.657+0000 7f68f1ffb640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f68e006ae70 0x7f68e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.657+0000 7f68f1ffb640 1 -- 172.21.15.45:0/3035763635 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68e4089a70 con 0x7f68dc004d00 2023-11-18T19:06:45.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.657+0000 7f68f8f69640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f68e006ae70 0x7f68e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.658+0000 7f68fe565740 1 Processor -- start 2023-11-18T19:06:45.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.658+0000 7f68f8f69640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f68e006ae70 0x7f68e006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68f4152800 tx=0x7f68e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.658+0000 7f68fe565740 1 -- start start 2023-11-18T19:06:45.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68fe565740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991a988a0 0x562991a98c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a7d1c0 0x562991a9bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991a99a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68fe565740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629919bc880 con 0x562991a988a0 2023-11-18T19:06:45.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629919cbae0 con 0x562991a7d1c0 2023-11-18T19:06:45.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629919c91d0 con 0x562991a5f5f0 2023-11-18T19:06:45.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68f976a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991a988a0 0x562991a98c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68f976a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991a988a0 0x562991a98c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51266/0 (socket says 172.21.15.45:51266) 2023-11-18T19:06:45.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.659+0000 7f68f976a640 1 -- 172.21.15.45:0/226166507 learned_addr learned my addr 172.21.15.45:0/226166507 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f8f69640 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a7d1c0 0x562991a9bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f976a640 1 -- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 msgr2=0x562991a99a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991a99a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f976a640 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991a99a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f976a640 1 -- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a7d1c0 msgr2=0x562991a9bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f976a640 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a7d1c0 0x562991a9bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f976a640 1 -- 172.21.15.45:0/226166507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56299198c860 con 0x562991a988a0 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f8f69640 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a7d1c0 0x562991a9bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68f976a640 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991a988a0 0x562991a98c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f68e4060350 tx=0x7f68e40581f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa4738dbaad2928 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68daffd640 1 -- 172.21.15.45:0/226166507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e405c6d0 con 0x562991a988a0 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68daffd640 1 -- 172.21.15.45:0/226166507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4060880 con 0x562991a988a0 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.660+0000 7f68daffd640 1 -- 172.21.15.45:0/226166507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4054c90 con 0x562991a988a0 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 -- 172.21.15.45:0/226166507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991a988a0 msgr2=0x562991a98c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991a988a0 0x562991a98c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f68e4060350 tx=0x7f68e40581f0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 -- 172.21.15.45:0/226166507 shutdown_connections 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991a99a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a7d1c0 0x562991a9bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 --2- 172.21.15.45:0/226166507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991a988a0 0x562991a98c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 -- 172.21.15.45:0/226166507 >> 172.21.15.45:0/226166507 conn(0x562991a1fbb0 msgr2=0x562991a7f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 -- 172.21.15.45:0/226166507 shutdown_connections 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.661+0000 7f68fe565740 1 -- 172.21.15.45:0/226166507 wait complete. 2023-11-18T19:06:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.662+0000 7f68fe565740 1 -- start start 2023-11-18T19:06:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.662+0000 7f68fe565740 1 Processor -- start 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a9ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991a7c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68fe565740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991aafd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68fe565740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629919c4ac0 con 0x562991aaf890 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629919612f0 con 0x562991a5f5f0 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56299197ec70 con 0x562991a988a0 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68fe565740 10 client.0 _ll_register_callbacks cb 0x5629919833b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T19:06:45.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68f9f6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991aafd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68f9f6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991aafd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51282/0 (socket says 172.21.15.45:51282) 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1269189345 learned_addr learned my addr 172.21.15.45:0/1269189345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.663+0000 7f68f976a640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a9ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f8f69640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991a7c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 msgr2=0x562991a7c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991a7c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 msgr2=0x562991a9ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a9ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f9f6b640 1 -- 172.21.15.45:0/1269189345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f40a57f0 con 0x562991aaf890 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f8f69640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991a7c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991aafd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c360 tx=0x7f68ec02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e224907e149ed87 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68cffff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68cffff640 1 -- 172.21.15.45:0/1269189345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec039030 con 0x562991aaf890 2023-11-18T19:06:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68cffff640 1 -- 172.21.15.45:0/1269189345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68ec042da0 con 0x562991aaf890 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.664+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629919bdaa0 con 0x562991aaf890 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68cffff640 1 -- 172.21.15.45:0/1269189345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68ec03c040 con 0x562991aaf890 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 10 client.4416 fetch_fsmap learned FSMap version 7 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5629919c3140 con 0x562991aaf890 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68cffff640 1 -- 172.21.15.45:0/1269189345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629919bdaa0 con 0x562991aaf890 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68cffff640 1 -- 172.21.15.45:0/1269189345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f68ec03f070 con 0x562991aaf890 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 10 client.4416 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 20 client.4416 populate_metadata read hostname 'smithi045' 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991ab02d0 0x562991a5c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 4 client.4416 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T19:06:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.665+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 --> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629919bd7c0 con 0x562991ab02d0 2023-11-18T19:06:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.666+0000 7f68f976a640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991ab02d0 0x562991a5c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.667+0000 7f68f976a640 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991ab02d0 0x562991a5c330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2874aaea65301415 server_cookie=13449c86adee67cb in_seq=0 out_seq=0 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.667+0000 7f68cffff640 10 client.4416 ms_handle_connect on v2:172.21.15.135:6834/2364227676 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68cffff640 1 -- 172.21.15.45:0/1269189345 <== mds.0 v2:172.21.15.135:6834/2364227676 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629919bd7c0 con 0x562991ab02d0 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68cffff640 10 client.4416 handle_command_reply: tid=0 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 client.4416 shutdown 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 msgr2=0x562991aafd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991aafd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c360 tx=0x7f68ec02e070 comp rx=0 tx=0).stop 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 shutdown_connections 2023-11-18T19:06:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991ab02d0 0x562991a5c330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991aafd10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991a7c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 --2- 172.21.15.45:0/1269189345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a9ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68cffff640 0 client.4416 ms_handle_reset on v2:172.21.15.135:6834/2364227676 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 >> 172.21.15.45:0/1269189345 conn(0x562991a1fbb0 msgr2=0x562991a581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 shutdown_connections 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 1 -- 172.21.15.45:0/1269189345 wait complete. 2023-11-18T19:06:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.669+0000 7f68fe565740 20 client.4416 trim_cache size 0 max 16384 2023-11-18T19:06:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.686+0000 7f68fe565740 1 Processor -- start 2023-11-18T19:06:45.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.686+0000 7f68fe565740 1 -- start start 2023-11-18T19:06:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.687+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a97600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.687+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991ab08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.687+0000 7f68fe565740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991a9d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.687+0000 7f68fe565740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562991727f20 con 0x562991aaf890 2023-11-18T19:06:45.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.687+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562991a7b540 con 0x562991a5f5f0 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.687+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x562991ab1540 con 0x562991a988a0 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991a9d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991a9d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51290/0 (socket says 172.21.15.45:51290) 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 -- 172.21.15.45:0/809072367 learned_addr learned my addr 172.21.15.45:0/809072367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 -- 172.21.15.45:0/809072367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 msgr2=0x562991ab08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991ab08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 -- 172.21.15.45:0/809072367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 msgr2=0x562991a97600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f976a640 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a97600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a97600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 -- 172.21.15.45:0/809072367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562991960b80 con 0x562991aaf890 2023-11-18T19:06:45.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.688+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991a9d9e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68ec001e40 tx=0x7f68ec03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2be71e8ff59dc7a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68db7fe640 1 -- 172.21.15.45:0/809072367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec039040 con 0x562991aaf890 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68db7fe640 1 -- 172.21.15.45:0/809072367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec02c970 con 0x562991aaf890 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68db7fe640 1 -- 172.21.15.45:0/809072367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0049e0 con 0x562991aaf890 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 -- 172.21.15.45:0/809072367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 msgr2=0x562991a9d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991a9d9e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68ec001e40 tx=0x7f68ec03e000 comp rx=0 tx=0).stop 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 -- 172.21.15.45:0/809072367 shutdown_connections 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991a9d9e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a988a0 0x562991ab08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 --2- 172.21.15.45:0/809072367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a5f5f0 0x562991a97600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 -- 172.21.15.45:0/809072367 >> 172.21.15.45:0/809072367 conn(0x562991a1fbb0 msgr2=0x562991a9c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 -- 172.21.15.45:0/809072367 shutdown_connections 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.689+0000 7f68fe565740 1 -- 172.21.15.45:0/809072367 wait complete. 2023-11-18T19:06:45.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.690+0000 7f68fe565740 1 -- start start 2023-11-18T19:06:45.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.690+0000 7f68fe565740 1 Processor -- start 2023-11-18T19:06:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991aa43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68fe565740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a988a0 0x562991b0c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68fe565740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991b05da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68fe565740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562991b0c270 con 0x562991aaf890 2023-11-18T19:06:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562991a5cd30 con 0x562991a988a0 2023-11-18T19:06:45.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68fe565740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x562991b08e20 con 0x562991a5f5f0 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68fe565740 10 client.0 _ll_register_callbacks cb 0x7f68dc0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68f9f6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991b05da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68f9f6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991b05da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51292/0 (socket says 172.21.15.45:51292) 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.691+0000 7f68f9f6b640 1 -- 172.21.15.45:0/455381081 learned_addr learned my addr 172.21.15.45:0/455381081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f8f69640 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a988a0 0x562991b0c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f976a640 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991aa43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f9f6b640 1 -- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 msgr2=0x562991aa43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991aa43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f9f6b640 1 -- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a988a0 msgr2=0x562991b0c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a988a0 0x562991b0c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f9f6b640 1 -- 172.21.15.45:0/455381081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629919c3140 con 0x562991aaf890 2023-11-18T19:06:45.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68f9f6b640 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991b05da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68ec02c520 tx=0x7f68ec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2072881d7cc2d3f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68cffff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68cffff640 1 -- 172.21.15.45:0/455381081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec039070 con 0x562991aaf890 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68cffff640 1 -- 172.21.15.45:0/455381081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68ec005a80 con 0x562991aaf890 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.692+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68e4060880 con 0x562991aaf890 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68cffff640 1 -- 172.21.15.45:0/455381081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68ec007270 con 0x562991aaf890 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 10 client.4422 fetch_fsmap learned FSMap version 7 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562991986170 con 0x562991aaf890 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68cffff640 1 -- 172.21.15.45:0/455381081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4060880 con 0x562991aaf890 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68cffff640 1 -- 172.21.15.45:0/455381081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f68ec03f040 con 0x562991aaf890 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 10 client.4422 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 20 client.4422 populate_metadata read hostname 'smithi045' 2023-11-18T19:06:45.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991b062e0 0x562991a81a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 4 client.4422 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T19:06:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.693+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 --> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5629916c56c0 con 0x562991b062e0 2023-11-18T19:06:45.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.694+0000 7f68f976a640 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991b062e0 0x562991a81a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.695+0000 7f68f976a640 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991b062e0 0x562991a81a30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa5293997d8b0e1 server_cookie=f0d6ec921932e161 in_seq=0 out_seq=0 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.695+0000 7f68cffff640 10 client.4422 ms_handle_connect on v2:172.21.15.135:6834/2364227676 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.695+0000 7f68cffff640 1 -- 172.21.15.45:0/455381081 <== mds.0 v2:172.21.15.135:6834/2364227676 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5629916c56c0 con 0x562991b062e0 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.695+0000 7f68cffff640 10 client.4422 handle_command_reply: tid=0 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.695+0000 7f68fe565740 1 client.4422 shutdown 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.695+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 msgr2=0x562991b05da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.695+0000 7f68fe565740 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991b05da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68ec02c520 tx=0x7f68ec001e70 comp rx=0 tx=0).stop 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 shutdown_connections 2023-11-18T19:06:45.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x562991b062e0 0x562991a81a30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562991aaf890 0x562991b05da0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562991a988a0 0x562991b0c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 --2- 172.21.15.45:0/455381081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562991a5f5f0 0x562991aa43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68cffff640 0 client.4422 ms_handle_reset on v2:172.21.15.135:6834/2364227676 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 >> 172.21.15.45:0/455381081 conn(0x562991a1fbb0 msgr2=0x562991ab08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 shutdown_connections 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 1 -- 172.21.15.45:0/455381081 wait complete. 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fe565740 20 client.4422 trim_cache size 0 max 16384 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:06:45.700 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "b96c09c0-a884-4d0b-a1ec-074e421eff36", 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4270, 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 7.6661287659999999, 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 7, 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 27, 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 27, 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 15.340887993000001 2023-11-18T19:06:45.701 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f68e006ae70 msgr2=0x7f68e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fb9ce640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f68e006ae70 0x7f68e006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68f4152800 tx=0x7f68e8008040 comp rx=0 tx=0).stop 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 msgr2=0x7f68f40aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.696+0000 7f68fb9ce640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68f40aa100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68e400eaf0 tx=0x7f68e40020b0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 shutdown_connections 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f68e006ae70 0x7f68e006d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68f40a6250 0x7f68f4149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68f4153ff0 0x7f68f40a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 --2- 172.21.15.45:0/3035763635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d00 0x7f68f40aa100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 >> 172.21.15.45:0/3035763635 conn(0x7f68f40a7980 msgr2=0x7f68f40c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:45.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 shutdown_connections 2023-11-18T19:06:45.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.697+0000 7f68fb9ce640 1 -- 172.21.15.45:0/3035763635 wait complete. 2023-11-18T19:06:45.715 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T19:06:45.715 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:45.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T19:06:45.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.925+0000 7f7ba6f90640 1 Processor -- start 2023-11-18T19:06:45.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.925+0000 7f7ba6f90640 1 -- start start 2023-11-18T19:06:45.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7ba6f90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba014c4e0 0x7f7ba00a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7ba6f90640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7ba00c4fc0 0x7f7ba00c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7ba6f90640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00a5270 con 0x7f7ba0152320 2023-11-18T19:06:45.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7ba6f90640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba00a54a0 con 0x7f7ba00c4fc0 2023-11-18T19:06:45.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7ba6f90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba006d5d0 con 0x7f7ba014c4e0 2023-11-18T19:06:45.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7b9ffff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7ba00c4fc0 0x7f7ba00c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7b9ffff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7ba00c4fc0 0x7f7ba00c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:32946/0 (socket says 172.21.15.45:32946) 2023-11-18T19:06:45.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.927+0000 7f7b9ffff640 1 -- 172.21.15.45:0/3813612573 learned_addr learned my addr 172.21.15.45:0/3813612573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:45.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.928+0000 7f7ba4d2c640 1 --2- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba014c4e0 0x7f7ba00a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.928+0000 7f7b9ffff640 1 -- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba014c4e0 msgr2=0x7f7ba00a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:45.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.928+0000 7f7b9ffff640 1 --2- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba014c4e0 0x7f7ba00a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.928+0000 7f7b9ffff640 1 -- 172.21.15.45:0/3813612573 >> v1:172.21.15.135:6789/0 conn(0x7f7ba0152320 legacy=0x7f7ba01527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.928+0000 7f7b9ffff640 1 -- 172.21.15.45:0/3813612573 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba006d8b0 con 0x7f7ba00c4fc0 2023-11-18T19:06:45.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.930+0000 7f7b9ffff640 1 --2- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba00c4fc0 0x7f7ba00c5440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009870 tx=0x7f7b8802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f9a77bc4decc61e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.930+0000 7f7b9f7fe640 1 -- 172.21.15.45:0/3813612573 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88030840 con 0x7f7ba00c4fc0 2023-11-18T19:06:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.930+0000 7f7b9f7fe640 1 -- 172.21.15.45:0/3813612573 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b880309a0 con 0x7f7ba00c4fc0 2023-11-18T19:06:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.930+0000 7f7b9f7fe640 1 -- 172.21.15.45:0/3813612573 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88030d30 con 0x7f7ba00c4fc0 2023-11-18T19:06:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 -- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba00c4fc0 msgr2=0x7f7ba00c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba00c4fc0 0x7f7ba00c5440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009870 tx=0x7f7b8802b980 comp rx=0 tx=0).stop 2023-11-18T19:06:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 -- 172.21.15.45:0/3813612573 shutdown_connections 2023-11-18T19:06:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba00c4fc0 0x7f7ba00c5440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/3813612573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba014c4e0 0x7f7ba00a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 -- 172.21.15.45:0/3813612573 >> 172.21.15.45:0/3813612573 conn(0x7f7ba006a500 msgr2=0x7f7ba006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 -- 172.21.15.45:0/3813612573 shutdown_connections 2023-11-18T19:06:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.931+0000 7f7ba6f90640 1 -- 172.21.15.45:0/3813612573 wait complete. 2023-11-18T19:06:45.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.933+0000 7f7ba6f90640 1 Processor -- start 2023-11-18T19:06:45.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.933+0000 7f7ba6f90640 1 -- start start 2023-11-18T19:06:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7ba6f90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba00c4fc0 0x7f7ba00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7ba6f90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba014c4e0 0x7f7ba0071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7ba6f90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0152320 0x7f7ba013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7ba6f90640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00a5dd0 con 0x7f7ba014c4e0 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7ba6f90640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01e6e20 con 0x7f7ba0152320 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7ba6f90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01e7100 con 0x7f7ba00c4fc0 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7b9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba014c4e0 0x7f7ba0071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7b9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba014c4e0 0x7f7ba0071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51306/0 (socket says 172.21.15.45:51306) 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.934+0000 7f7b9ffff640 1 -- 172.21.15.45:0/4136640609 learned_addr learned my addr 172.21.15.45:0/4136640609 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7ba4d2c640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba00c4fc0 0x7f7ba00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7ba552d640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0152320 0x7f7ba013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9ffff640 1 -- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba00c4fc0 msgr2=0x7f7ba00a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9ffff640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba00c4fc0 0x7f7ba00a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9ffff640 1 -- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0152320 msgr2=0x7f7ba013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9ffff640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0152320 0x7f7ba013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9ffff640 1 -- 172.21.15.45:0/4136640609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880094d0 con 0x7f7ba014c4e0 2023-11-18T19:06:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9ffff640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba014c4e0 0x7f7ba0071350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000c00 tx=0x7f7b88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9d7fa640 1 -- 172.21.15.45:0/4136640609 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88039a90 con 0x7f7ba014c4e0 2023-11-18T19:06:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9d7fa640 1 -- 172.21.15.45:0/4136640609 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88039c10 con 0x7f7ba014c4e0 2023-11-18T19:06:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.935+0000 7f7b9d7fa640 1 -- 172.21.15.45:0/4136640609 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88043410 con 0x7f7ba014c4e0 2023-11-18T19:06:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.936+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba00a5780 con 0x7f7ba014c4e0 2023-11-18T19:06:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.936+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba006fd00 con 0x7f7ba014c4e0 2023-11-18T19:06:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.937+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba006de30 con 0x7f7ba014c4e0 2023-11-18T19:06:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.938+0000 7f7b9d7fa640 1 -- 172.21.15.45:0/4136640609 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b8802f390 con 0x7f7ba014c4e0 2023-11-18T19:06:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.939+0000 7f7b9d7fa640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7b8006ae40 0x7f7b8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:45.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.939+0000 7f7b9d7fa640 1 -- 172.21.15.45:0/4136640609 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b880ab990 con 0x7f7ba014c4e0 2023-11-18T19:06:45.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.939+0000 7f7ba4d2c640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7b8006ae40 0x7f7b8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:45.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.940+0000 7f7ba4d2c640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7b8006ae40 0x7f7b8006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b900074a0 tx=0x7f7b9000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:45.944+0000 7f7b9d7fa640 1 -- 172.21.15.45:0/4136640609 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b880767e0 con 0x7f7ba014c4e0 2023-11-18T19:06:46.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.182+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ba00747c0 con 0x7f7ba014c4e0 2023-11-18T19:06:46.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.183+0000 7f7b9d7fa640 1 -- 172.21.15.45:0/4136640609 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7b88048020 con 0x7f7ba014c4e0 2023-11-18T19:06:46.184 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-18T19:06:46.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7b8006ae40 msgr2=0x7f7b8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:46.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7b8006ae40 0x7f7b8006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b900074a0 tx=0x7f7b9000b040 comp rx=0 tx=0).stop 2023-11-18T19:06:46.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba014c4e0 msgr2=0x7f7ba0071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:46.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba014c4e0 0x7f7ba0071350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000c00 tx=0x7f7b88004730 comp rx=0 tx=0).stop 2023-11-18T19:06:46.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 shutdown_connections 2023-11-18T19:06:46.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ba0152320 0x7f7ba013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:46.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba014c4e0 0x7f7ba0071350 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000c00 tx=0x7f7b88004730 comp rx=0 tx=0).stop 2023-11-18T19:06:46.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7b8006ae40 0x7f7b8006d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:46.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 --2- 172.21.15.45:0/4136640609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ba00c4fc0 0x7f7ba00a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:46.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.186+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 >> 172.21.15.45:0/4136640609 conn(0x7f7ba006a500 msgr2=0x7f7ba01516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:46.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.187+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 shutdown_connections 2023-11-18T19:06:46.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:46.187+0000 7f7ba6f90640 1 -- 172.21.15.45:0/4136640609 wait complete. 2023-11-18T19:06:46.214 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-18T19:06:46.214 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T19:06:46.214 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-18T19:06:46.214 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-18T19:06:46.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:46.215 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-18T19:06:46.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T19:06:46.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T19:06:46.215 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-18T19:06:46.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:46.215 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:06:46.270 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-18T19:06:46.271 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-18T19:06:46.272 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T19:06:46.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:46.272 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:06:46.272 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:06:46.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-11-18T19:06:46.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-11-18T19:06:46.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-11-18T19:06:46.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T19:06:46.272 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:06:47.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:47.388 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T19:06:47.478 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-18T19:06:47.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:47.482 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-18T19:06:47.556 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-18T19:06:47.556 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T19:06:47.556 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-18T19:06:47.556 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-18T19:06:47.556 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T19:06:47.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:47.557 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:06:47.557 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:06:47.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-18T19:06:47.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-18T19:06:47.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-18T19:06:47.557 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:06:48.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:48.401 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-18T19:06:48.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:48.462 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-11-18T19:06:48.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:48.520 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:06:48.520 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:06:48.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:06:48.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-18T19:06:48.520 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:06:48.675 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-18T19:06:48.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-18T19:06:48.676 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:06:48.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:48.971 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:06:48.971 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:06:48.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-18T19:06:48.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T19:06:48.971 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:06:49.142 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-18T19:06:49.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T19:06:49.142 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:49.193 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-18T19:06:49.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T19:06:49.194 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:49.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-18T19:06:49.340 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T19:06:49.395 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-18T19:06:49.395 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-18T19:06:49.395 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-18T19:06:49.395 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-18T19:06:49.395 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-18T19:06:49.396 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-18T19:06:49.396 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-18T19:06:49.396 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-18T19:06:49.396 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-18T19:06:49.396 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-18T19:06:49.396 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-11-18T19:06:49.397 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T19:06:49.397 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-18T19:06:49.397 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-18T19:06:49.397 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-18T19:06:49.397 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-18T19:06:49.397 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-18T19:06:49.397 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-18T19:06:49.398 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T19:06:49.398 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T19:06:49.398 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T19:06:49.398 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T19:06:49.398 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-18T19:06:49.398 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-18T19:06:49.398 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T19:06:49.399 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T19:06:49.399 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T19:06:49.399 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T19:06:49.399 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-18T19:06:49.399 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:06:49.399 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:06:49.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:49.400 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-18T19:06:49.454 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-18T19:06:49.454 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-18T19:06:49.460 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-18T19:06:49.537 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T19:06:49.580 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-18T19:06:49.580 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-18T19:06:49.580 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-18T19:06:49.581 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-18T19:06:49.581 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-18T19:06:49.581 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-18T19:06:49.581 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-18T19:06:49.581 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-18T19:06:49.581 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-18T19:06:49.582 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-18T19:06:49.582 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-11-18T19:06:49.582 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T19:06:49.582 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-18T19:06:49.582 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-18T19:06:49.582 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-18T19:06:49.582 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-18T19:06:49.583 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-18T19:06:49.583 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-18T19:06:49.583 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T19:06:49.583 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T19:06:49.583 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T19:06:49.583 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T19:06:49.583 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-18T19:06:49.584 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-18T19:06:49.584 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T19:06:49.584 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T19:06:49.584 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T19:06:49.584 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T19:06:49.584 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-18T19:06:49.584 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:06:49.585 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:06:49.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:49.586 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-18T19:06:49.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:2023-11-18T19:06:49.664+0000 7f5c9acda480 -1 init, newargv = 0x55bdb70ef1b0 newargc=15 2023-11-18T19:06:49.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[91810]: starting ceph client 2023-11-18T19:06:49.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[91810]: starting fuse 2023-11-18T19:06:50.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-18T19:06:50.890 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T19:06:50.952 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-18T19:06:50.953 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-18T19:06:50.953 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-18T19:06:50.953 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-18T19:06:50.953 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-18T19:06:50.954 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-18T19:06:50.954 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-18T19:06:50.954 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-18T19:06:50.954 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-18T19:06:50.954 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-18T19:06:50.954 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-11-18T19:06:50.955 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T19:06:50.955 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-18T19:06:50.955 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-18T19:06:50.955 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-18T19:06:50.955 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-18T19:06:50.955 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-18T19:06:50.956 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:06:50.957 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:06:50.957 INFO:teuthology.orchestra.run.smithi045.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:50.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:50.958 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-18T19:06:51.017 INFO:teuthology.orchestra.run.smithi045.stdout:41 2023-11-18T19:06:51.017 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-18T19:06:51.018 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-18T19:06:51.019 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-18T19:06:51.020 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T19:06:51.020 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:06:51.020 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.admin")) 2023-11-18T19:06:51.020 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-18T19:06:51.212 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.admin.91810.asok 2023-11-18T19:06:51.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T19:06:51.231 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.91810.asok 2023-11-18T19:06:51.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:51.231 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.91810.asok status 2023-11-18T19:06:51.487 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:06:51.487 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-18T19:06:51.488 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T19:06:51.488 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T19:06:51.488 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "admin", 2023-11-18T19:06:51.488 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-18T19:06:51.488 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-18T19:06:51.488 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "91810", 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4431, 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-18T19:06:51.489 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4431 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 753852068 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-18T19:06:51.490 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 753852068 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4431 192.168.0.1:0/753852068", 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/753852068", 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 7, 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 27, 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-18T19:06:51.491 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:06:51.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:51.503 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-18T19:06:51.503 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:51.557 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-18T19:06:51.557 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:51.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:51.558 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:51.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:51.662 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-18T19:06:51.764 INFO:teuthology.orchestra.run.smithi045.stdout:# file: . 2023-11-18T19:06:51.764 INFO:teuthology.orchestra.run.smithi045.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-18T19:06:51.765 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:51.765 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:51.766 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:06:51.825 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.052+0000 7fbe1357a640 1 Processor -- start 2023-11-18T19:06:52.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.052+0000 7fbe1357a640 1 -- start start 2023-11-18T19:06:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.054+0000 7fbe1357a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbe0c0c2fb0 0x7fbe0c0c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.054+0000 7fbe1357a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c0722c0 0x7fbe0c0a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.054+0000 7fbe1357a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c156780 con 0x7fbe0c155890 2023-11-18T19:06:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.054+0000 7fbe1357a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c06b9a0 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.054+0000 7fbe1357a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c06bc80 con 0x7fbe0c0722c0 2023-11-18T19:06:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.054+0000 7fbe12578640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbe0c0c2fb0 0x7fbe0c0c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.054+0000 7fbe11d77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c0722c0 0x7fbe0c0a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.055+0000 7fbe11d77640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c0722c0 0x7fbe0c0a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:46178/0 (socket says 172.21.15.45:46178) 2023-11-18T19:06:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.055+0000 7fbe11d77640 1 -- 172.21.15.45:0/25995158 learned_addr learned my addr 172.21.15.45:0/25995158 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.055+0000 7fbe11d77640 1 -- 172.21.15.45:0/25995158 >> v2:172.21.15.135:3300/0 conn(0x7fbe0c0c2fb0 msgr2=0x7fbe0c0c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.055+0000 7fbe11d77640 1 --2- 172.21.15.45:0/25995158 >> v2:172.21.15.135:3300/0 conn(0x7fbe0c0c2fb0 0x7fbe0c0c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.055+0000 7fbe11d77640 1 -- 172.21.15.45:0/25995158 >> v1:172.21.15.135:6789/0 conn(0x7fbe0c155890 legacy=0x7fbe0c155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.055+0000 7fbe11d77640 1 -- 172.21.15.45:0/25995158 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c06e070 con 0x7fbe0c0722c0 2023-11-18T19:06:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.055+0000 7fbe12578640 1 --2- 172.21.15.45:0/25995158 >> v2:172.21.15.135:3300/0 conn(0x7fbe0c0c2fb0 0x7fbe0c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:52.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.057+0000 7fbe11d77640 1 --2- 172.21.15.45:0/25995158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c0722c0 0x7fbe0c0a4e30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009870 tx=0x7fbdfc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ebc68fc6c36eca server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.057+0000 7fbe11576640 1 -- 172.21.15.45:0/25995158 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0317c0 con 0x7fbe0c0722c0 2023-11-18T19:06:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.057+0000 7fbe11576640 1 -- 172.21.15.45:0/25995158 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc031920 con 0x7fbe0c0722c0 2023-11-18T19:06:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.057+0000 7fbe11576640 1 -- 172.21.15.45:0/25995158 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc031cb0 con 0x7fbe0c0722c0 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 -- 172.21.15.45:0/25995158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c0722c0 msgr2=0x7fbe0c0a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 --2- 172.21.15.45:0/25995158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c0722c0 0x7fbe0c0a4e30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009870 tx=0x7fbdfc02b860 comp rx=0 tx=0).stop 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 -- 172.21.15.45:0/25995158 shutdown_connections 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 --2- 172.21.15.45:0/25995158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c0722c0 0x7fbe0c0a4e30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 --2- 172.21.15.45:0/25995158 >> v2:172.21.15.135:3300/0 conn(0x7fbe0c0c2fb0 0x7fbe0c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 -- 172.21.15.45:0/25995158 >> 172.21.15.45:0/25995158 conn(0x7fbe0c0c5af0 msgr2=0x7fbe0c0c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 -- 172.21.15.45:0/25995158 shutdown_connections 2023-11-18T19:06:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.058+0000 7fbe1357a640 1 -- 172.21.15.45:0/25995158 wait complete. 2023-11-18T19:06:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.060+0000 7fbe1357a640 1 Processor -- start 2023-11-18T19:06:52.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.060+0000 7fbe1357a640 1 -- start start 2023-11-18T19:06:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.061+0000 7fbe1357a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe0c0722c0 0x7fbe0c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.061+0000 7fbe1357a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe0c0c2fb0 0x7fbe0c150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.061+0000 7fbe1357a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c155890 0x7fbe0c1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.061+0000 7fbe1357a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0a86a0 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.061+0000 7fbe1357a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1ed7e0 con 0x7fbe0c0722c0 2023-11-18T19:06:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.061+0000 7fbe1357a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0a88f0 con 0x7fbe0c155890 2023-11-18T19:06:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe0c0c2fb0 0x7fbe0c150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe0c0c2fb0 0x7fbe0c150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51314/0 (socket says 172.21.15.45:51314) 2023-11-18T19:06:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 -- 172.21.15.45:0/4253081649 learned_addr learned my addr 172.21.15.45:0/4253081649 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe12578640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe0c0722c0 0x7fbe0c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe12d79640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c155890 0x7fbe0c1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 -- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c155890 msgr2=0x7fbe0c1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c155890 0x7fbe0c1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 -- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe0c0722c0 msgr2=0x7fbe0c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe0c0722c0 0x7fbe0c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.062+0000 7fbe11d77640 1 -- 172.21.15.45:0/4253081649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08009400 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.063+0000 7fbe11d77640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe0c0c2fb0 0x7fbe0c150810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0090b0 tx=0x7fbdfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.063+0000 7fbe02ffd640 1 -- 172.21.15.45:0/4253081649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc032860 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.063+0000 7fbe02ffd640 1 -- 172.21.15.45:0/4253081649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc0329c0 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.063+0000 7fbe02ffd640 1 -- 172.21.15.45:0/4253081649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc032d70 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.063+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc0094d0 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.063+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c1ed190 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.064+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c067fc0 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.065+0000 7fbe02ffd640 1 -- 172.21.15.45:0/4253081649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdfc04e450 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.066+0000 7fbe02ffd640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdf006ae70 0x7fbdf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.066+0000 7fbe02ffd640 1 -- 172.21.15.45:0/4253081649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbdfc0ab9c0 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.067+0000 7fbe12578640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdf006ae70 0x7fbdf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.067+0000 7fbe12578640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdf006ae70 0x7fbdf006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0a8320 tx=0x7fbe08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.071+0000 7fbe02ffd640 1 -- 172.21.15.45:0/4253081649 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbdfc076770 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.268+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe0c1ed950 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.271+0000 7fbe02ffd640 1 -- 172.21.15.45:0/4253081649 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7fbdfc079d90 con 0x7fbe0c0c2fb0 2023-11-18T19:06:52.273 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:52.274 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:52.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.274+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdf006ae70 msgr2=0x7fbdf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.274+0000 7fbe1357a640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdf006ae70 0x7fbdf006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0a8320 tx=0x7fbe08008040 comp rx=0 tx=0).stop 2023-11-18T19:06:52.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.274+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe0c0c2fb0 msgr2=0x7fbe0c150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.274+0000 7fbe1357a640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe0c0c2fb0 0x7fbe0c150810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0090b0 tx=0x7fbdfc0046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 shutdown_connections 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdf006ae70 0x7fbdf006d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe0c155890 0x7fbe0c1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe0c0c2fb0 0x7fbe0c150810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 --2- 172.21.15.45:0/4253081649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe0c0722c0 0x7fbe0c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 >> 172.21.15.45:0/4253081649 conn(0x7fbe0c0c5af0 msgr2=0x7fbe0c155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 shutdown_connections 2023-11-18T19:06:52.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.275+0000 7fbe1357a640 1 -- 172.21.15.45:0/4253081649 wait complete. 2023-11-18T19:06:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T19:06:35.454808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T19:06:36.526298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T19:06:39.617712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T19:06:52.298 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:06:52.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.526+0000 7fa7ae747640 1 Processor -- start 2023-11-18T19:06:52.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.526+0000 7fa7ae747640 1 -- start start 2023-11-18T19:06:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.528+0000 7fa7ae747640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7a80c54d0 0x7fa7a8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.528+0000 7fa7ae747640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80c04c0 con 0x7fa7a8155270 2023-11-18T19:06:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.528+0000 7fa7ae747640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80c09f0 con 0x7fa7a8157c50 2023-11-18T19:06:52.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.528+0000 7fa7ae747640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a80c0710 con 0x7fa7a80c54d0 2023-11-18T19:06:52.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.528+0000 7fa7ad745640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa7a8155270 0x7fa7a806a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36436/0 (socket says 172.21.15.45:36436) 2023-11-18T19:06:52.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.528+0000 7fa7ad745640 1 -- 172.21.15.45:0/1434291707 learned_addr learned my addr 172.21.15.45:0/1434291707 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa7acf44640 1 --2- 172.21.15.45:0/1434291707 >> v2:172.21.15.135:3300/0 conn(0x7fa7a80c54d0 0x7fa7a8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438683083 0 0) 0x7fa7a80c04c0 con 0x7fa7a8155270 2023-11-18T19:06:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa794003520 con 0x7fa7a8155270 2023-11-18T19:06:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2611463098 0 0) 0x7fa794003520 con 0x7fa7a8155270 2023-11-18T19:06:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 >> v2:172.21.15.135:3300/0 conn(0x7fa7a80c54d0 msgr2=0x7fa7a8071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 --2- 172.21.15.45:0/1434291707 >> v2:172.21.15.135:3300/0 conn(0x7fa7a80c54d0 0x7fa7a8071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 >> v1:172.21.15.135:6789/0 conn(0x7fa7a8157c50 legacy=0x7fa7a8158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80c0e90 con 0x7fa7a8155270 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fa7a40019f0 con 0x7fa7a8155270 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 >> v1:172.21.15.45:6789/0 conn(0x7fa7a8155270 legacy=0x7fa7a806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.529+0000 7fa79ffff640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa794003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa79ffff640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940047c0 0x7fa794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa79ffff640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940052a0 0x7fa79400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c0710 con 0x7fa7940039c0 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79400c1a0 con 0x7fa7940047c0 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79400c360 con 0x7fa7940052a0 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7ad745640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa794003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7acf44640 1 --2- 172.21.15.45:0/1434291707 >> v2:172.21.15.135:3300/0 conn(0x7fa7a80c54d0 0x7fa7a8071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7ad745640 1 -- 172.21.15.45:0/1434291707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940052a0 msgr2=0x7fa79400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7ad745640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940052a0 0x7fa79400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7ad745640 1 -- 172.21.15.45:0/1434291707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940047c0 msgr2=0x7fa794004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7ad745640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940047c0 0x7fa794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7ad745640 1 -- 172.21.15.45:0/1434291707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794003520 con 0x7fa7940039c0 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.530+0000 7fa7adf46640 1 -- 172.21.15.45:0/1434291707 reap_dead start 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.531+0000 7fa7ad745640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa794003de0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400a750 tx=0x7fa7940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f283463746f670e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4034630 con 0x7fa7940039c0 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a402f070 con 0x7fa7940039c0 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa79ffff640 1 -- 172.21.15.45:0/1434291707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40349d0 con 0x7fa7940039c0 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa7ae747640 1 -- 172.21.15.45:0/1434291707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 msgr2=0x7fa794003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa7ae747640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa794003de0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400a750 tx=0x7fa7940057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa7ae747640 1 -- 172.21.15.45:0/1434291707 shutdown_connections 2023-11-18T19:06:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa7ae747640 1 --2- 172.21.15.45:0/1434291707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa794003de0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa7ae747640 1 -- 172.21.15.45:0/1434291707 >> 172.21.15.45:0/1434291707 conn(0x7fa7a80a7870 msgr2=0x7fa7a80a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa7ae747640 1 -- 172.21.15.45:0/1434291707 shutdown_connections 2023-11-18T19:06:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.532+0000 7fa7ae747640 1 -- 172.21.15.45:0/1434291707 wait complete. 2023-11-18T19:06:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.534+0000 7fa7ae747640 1 Processor -- start 2023-11-18T19:06:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.534+0000 7fa7ae747640 1 -- start start 2023-11-18T19:06:52.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ae747640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa7a814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ae747640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7a80a9750 0x7fa7a814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ae747640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a80a9200 0x7fa7a81ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ae747640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a814caf0 con 0x7fa7940039c0 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ae747640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80aa820 con 0x7fa7a80a9200 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ae747640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a806a990 con 0x7fa7a80a9750 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ad745640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa7a814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ad745640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa7a814d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51336/0 (socket says 172.21.15.45:51336) 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.535+0000 7fa7ad745640 1 -- 172.21.15.45:0/2410729135 learned_addr learned my addr 172.21.15.45:0/2410729135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7adf46640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a80a9200 0x7fa7a81ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7ad745640 1 -- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7a80a9750 msgr2=0x7fa7a814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7acf44640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7a80a9750 0x7fa7a814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7ad745640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7a80a9750 0x7fa7a814ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7ad745640 1 -- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a80a9200 msgr2=0x7fa7a81ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7ad745640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a80a9200 0x7fa7a81ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7ad745640 1 -- 172.21.15.45:0/2410729135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a814c2e0 con 0x7fa7940039c0 2023-11-18T19:06:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7adf46640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a80a9200 0x7fa7a81ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa7ad745640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa7a814d810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa7a402cb70 tx=0x7fa7a80728a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.536+0000 7fa79dffb640 1 -- 172.21.15.45:0/2410729135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4034900 con 0x7fa7940039c0 2023-11-18T19:06:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.537+0000 7fa79dffb640 1 -- 172.21.15.45:0/2410729135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4034a60 con 0x7fa7940039c0 2023-11-18T19:06:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.537+0000 7fa79dffb640 1 -- 172.21.15.45:0/2410729135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4034df0 con 0x7fa7940039c0 2023-11-18T19:06:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.537+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a814d380 con 0x7fa7940039c0 2023-11-18T19:06:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.537+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a814c810 con 0x7fa7940039c0 2023-11-18T19:06:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.538+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a80733e0 con 0x7fa7940039c0 2023-11-18T19:06:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.539+0000 7fa79dffb640 1 -- 172.21.15.45:0/2410729135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7a4031030 con 0x7fa7940039c0 2023-11-18T19:06:52.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.540+0000 7fa79dffb640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa78c06ae70 0x7fa78c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.540+0000 7fa79dffb640 1 -- 172.21.15.45:0/2410729135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7a40abf50 con 0x7fa7940039c0 2023-11-18T19:06:52.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.540+0000 7fa7acf44640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa78c06ae70 0x7fa78c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.541+0000 7fa7acf44640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa78c06ae70 0x7fa78c06d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8151cf0 tx=0x7fa798008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.545+0000 7fa79dffb640 1 -- 172.21.15.45:0/2410729135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7a4076d90 con 0x7fa7940039c0 2023-11-18T19:06:52.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.740+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7a80733e0 con 0x7fa7940039c0 2023-11-18T19:06:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.741+0000 7fa79dffb640 1 -- 172.21.15.45:0/2410729135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7a407a3b0 con 0x7fa7940039c0 2023-11-18T19:06:52.743 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:06:52.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa78c06ae70 msgr2=0x7fa78c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa78c06ae70 0x7fa78c06d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8151cf0 tx=0x7fa798008040 comp rx=0 tx=0).stop 2023-11-18T19:06:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 msgr2=0x7fa7a814d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa7a814d810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa7a402cb70 tx=0x7fa7a80728a0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 shutdown_connections 2023-11-18T19:06:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a80a9200 0x7fa7a81ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa78c06ae70 0x7fa78c06d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7a80a9750 0x7fa7a814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 --2- 172.21.15.45:0/2410729135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7940039c0 0x7fa7a814d810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 >> 172.21.15.45:0/2410729135 conn(0x7fa7a80a7870 msgr2=0x7fa7a8152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 shutdown_connections 2023-11-18T19:06:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.744+0000 7fa7ae747640 1 -- 172.21.15.45:0/2410729135 wait complete. 2023-11-18T19:06:52.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T19:06:52.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.988+0000 7fef57fff640 1 Processor -- start 2023-11-18T19:06:52.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.988+0000 7fef57fff640 1 -- start start 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef57fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef580c4690 0x7fef580c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef57fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef580c8330 0x7fef581550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef57fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c6620 0x7fef5806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef57fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5806baf0 con 0x7fef580c4690 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef57fff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580c5f10 con 0x7fef580c8330 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef57fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5806b7e0 con 0x7fef580c6620 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef580c4690 0x7fef580c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef580c4690 0x7fef580c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44476/0 (socket says 172.21.15.45:44476) 2023-11-18T19:06:52.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef56ffd640 1 -- 172.21.15.45:0/419150360 learned_addr learned my addr 172.21.15.45:0/419150360 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef567fc640 1 --2- 172.21.15.45:0/419150360 >> v2:172.21.15.135:3300/0 conn(0x7fef580c8330 0x7fef581550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef577fe640 1 --2- 172.21.15.45:0/419150360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c6620 0x7fef5806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.990+0000 7fef56ffd640 1 -- 172.21.15.45:0/419150360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c6620 msgr2=0x7fef5806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.991+0000 7fef56ffd640 1 --2- 172.21.15.45:0/419150360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c6620 0x7fef5806bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.991+0000 7fef56ffd640 1 -- 172.21.15.45:0/419150360 >> v2:172.21.15.135:3300/0 conn(0x7fef580c8330 msgr2=0x7fef581550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.991+0000 7fef56ffd640 1 --2- 172.21.15.45:0/419150360 >> v2:172.21.15.135:3300/0 conn(0x7fef580c8330 0x7fef581550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.991+0000 7fef56ffd640 1 -- 172.21.15.45:0/419150360 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580c51f0 con 0x7fef580c4690 2023-11-18T19:06:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.991+0000 7fef577fe640 1 --2- 172.21.15.45:0/419150360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c6620 0x7fef5806bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:52.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.992+0000 7fef56ffd640 1 --2- 172.21.15.45:0/419150360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c4a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef580c7890 tx=0x7fef4802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54a0f584d4686d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:52.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.992+0000 7fef55ffb640 1 -- 172.21.15.45:0/419150360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4802ca80 con 0x7fef580c4690 2023-11-18T19:06:52.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.992+0000 7fef55ffb640 1 -- 172.21.15.45:0/419150360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4802cbe0 con 0x7fef580c4690 2023-11-18T19:06:52.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.992+0000 7fef55ffb640 1 -- 172.21.15.45:0/419150360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480343f0 con 0x7fef580c4690 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 -- 172.21.15.45:0/419150360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 msgr2=0x7fef580c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 --2- 172.21.15.45:0/419150360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c4a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef580c7890 tx=0x7fef4802bee0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 -- 172.21.15.45:0/419150360 shutdown_connections 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 --2- 172.21.15.45:0/419150360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c6620 0x7fef5806bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 --2- 172.21.15.45:0/419150360 >> v2:172.21.15.135:3300/0 conn(0x7fef580c8330 0x7fef581550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 --2- 172.21.15.45:0/419150360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c4a70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 -- 172.21.15.45:0/419150360 >> 172.21.15.45:0/419150360 conn(0x7fef580ab8a0 msgr2=0x7fef580abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 -- 172.21.15.45:0/419150360 shutdown_connections 2023-11-18T19:06:52.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.993+0000 7fef57fff640 1 -- 172.21.15.45:0/419150360 wait complete. 2023-11-18T19:06:52.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.995+0000 7fef57fff640 1 Processor -- start 2023-11-18T19:06:53.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.998+0000 7fef57fff640 1 -- start start 2023-11-18T19:06:53.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.999+0000 7fef57fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.999+0000 7fef57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef580c6620 0x7fef580c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.999+0000 7fef57fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c8330 0x7fef580c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.999+0000 7fef57fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c3f00 con 0x7fef580c4690 2023-11-18T19:06:53.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.999+0000 7fef57fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c1110 con 0x7fef580c6620 2023-11-18T19:06:53.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:52.999+0000 7fef57fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef58148c70 con 0x7fef580c8330 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.000+0000 7fef56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.000+0000 7fef56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44484/0 (socket says 172.21.15.45:44484) 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.000+0000 7fef56ffd640 1 -- 172.21.15.45:0/81470295 learned_addr learned my addr 172.21.15.45:0/81470295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.000+0000 7fef567fc640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef580c6620 0x7fef580c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.000+0000 7fef577fe640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c8330 0x7fef580c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef56ffd640 1 -- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c8330 msgr2=0x7fef580c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef56ffd640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c8330 0x7fef580c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef56ffd640 1 -- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef580c6620 msgr2=0x7fef580c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef56ffd640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef580c6620 0x7fef580c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef56ffd640 1 -- 172.21.15.45:0/81470295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009b30 con 0x7fef580c4690 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef56ffd640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c8a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef48000f80 tx=0x7fef48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef4f7fe640 1 -- 172.21.15.45:0/81470295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48009510 con 0x7fef580c4690 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef4f7fe640 1 -- 172.21.15.45:0/81470295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4803e450 con 0x7fef580c4690 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef4f7fe640 1 -- 172.21.15.45:0/81470295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4803e800 con 0x7fef580c4690 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.001+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef58148340 con 0x7fef580c4690 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.002+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58148900 con 0x7fef580c4690 2023-11-18T19:06:53.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.003+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5808ba90 con 0x7fef580c4690 2023-11-18T19:06:53.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.004+0000 7fef4f7fe640 1 -- 172.21.15.45:0/81470295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef4802cd50 con 0x7fef580c4690 2023-11-18T19:06:53.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.005+0000 7fef4f7fe640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.005+0000 7fef4f7fe640 1 -- 172.21.15.45:0/81470295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef480ac3c0 con 0x7fef580c4690 2023-11-18T19:06:53.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.005+0000 7fef567fc640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.006+0000 7fef567fc640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef3806ae40 0x7fef3806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef580ab870 tx=0x7fef40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.009+0000 7fef4f7fe640 1 -- 172.21.15.45:0/81470295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef48077170 con 0x7fef580c4690 2023-11-18T19:06:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.208+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef580683a0 con 0x7fef580c4690 2023-11-18T19:06:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.209+0000 7fef4f7fe640 1 -- 172.21.15.45:0/81470295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef4807a790 con 0x7fef580c4690 2023-11-18T19:06:53.211 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef3806ae40 msgr2=0x7fef3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef3806ae40 0x7fef3806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef580ab870 tx=0x7fef40008040 comp rx=0 tx=0).stop 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 msgr2=0x7fef580c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c8a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef48000f80 tx=0x7fef48004a40 comp rx=0 tx=0).stop 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 shutdown_connections 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef580c8330 0x7fef580c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef580c6620 0x7fef580c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 --2- 172.21.15.45:0/81470295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef580c4690 0x7fef580c8a60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 >> 172.21.15.45:0/81470295 conn(0x7fef580ab8a0 msgr2=0x7fef5814bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 shutdown_connections 2023-11-18T19:06:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.212+0000 7fef57fff640 1 -- 172.21.15.45:0/81470295 wait complete. 2023-11-18T19:06:53.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T19:06:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.456+0000 7f8caa17c640 1 Processor -- start 2023-11-18T19:06:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.456+0000 7f8caa17c640 1 -- start start 2023-11-18T19:06:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8caa17c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8ca4151e30 0x7f8ca40ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8caa17c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ca40c7fc0 0x7f8ca40c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8caa17c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca41552f0 con 0x7f8ca40ca940 2023-11-18T19:06:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8caa17c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca40c5e00 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8caa17c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca406c8d0 con 0x7f8ca4151e30 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8ca2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ca40c7fc0 0x7f8ca40c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8ca2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ca40c7fc0 0x7f8ca40c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44498/0 (socket says 172.21.15.45:44498) 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.457+0000 7f8ca2ffd640 1 -- 172.21.15.45:0/250385866 learned_addr learned my addr 172.21.15.45:0/250385866 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.458+0000 7f8ca37fe640 1 --2- 172.21.15.45:0/250385866 >> v2:172.21.15.135:3300/0 conn(0x7f8ca4151e30 0x7f8ca40ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.458+0000 7f8ca2ffd640 1 -- 172.21.15.45:0/250385866 >> v2:172.21.15.135:3300/0 conn(0x7f8ca4151e30 msgr2=0x7f8ca40ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.458+0000 7f8ca2ffd640 1 --2- 172.21.15.45:0/250385866 >> v2:172.21.15.135:3300/0 conn(0x7f8ca4151e30 0x7f8ca40ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.458+0000 7f8ca2ffd640 1 -- 172.21.15.45:0/250385866 >> v1:172.21.15.135:6789/0 conn(0x7f8ca40ca940 legacy=0x7f8ca40c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.458+0000 7f8ca2ffd640 1 -- 172.21.15.45:0/250385866 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40c8a90 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.458+0000 7f8ca37fe640 1 --2- 172.21.15.45:0/250385866 >> v2:172.21.15.135:3300/0 conn(0x7f8ca4151e30 0x7f8ca40ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.459+0000 7f8ca2ffd640 1 --2- 172.21.15.45:0/250385866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca40c6920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40accb0 tx=0x7f8c8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f592ed6babfab341 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.459+0000 7f8ca27fc640 1 -- 172.21.15.45:0/250385866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c031870 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8ca27fc640 1 -- 172.21.15.45:0/250385866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0319d0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8ca27fc640 1 -- 172.21.15.45:0/250385866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c031d60 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 -- 172.21.15.45:0/250385866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 msgr2=0x7f8ca40c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 --2- 172.21.15.45:0/250385866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca40c6920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40accb0 tx=0x7f8c8c02b910 comp rx=0 tx=0).stop 2023-11-18T19:06:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 -- 172.21.15.45:0/250385866 shutdown_connections 2023-11-18T19:06:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 --2- 172.21.15.45:0/250385866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca40c6920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 --2- 172.21.15.45:0/250385866 >> v2:172.21.15.135:3300/0 conn(0x7f8ca4151e30 0x7f8ca40ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 -- 172.21.15.45:0/250385866 >> 172.21.15.45:0/250385866 conn(0x7f8ca40663d0 msgr2=0x7f8ca40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 -- 172.21.15.45:0/250385866 shutdown_connections 2023-11-18T19:06:53.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.460+0000 7f8caa17c640 1 -- 172.21.15.45:0/250385866 wait complete. 2023-11-18T19:06:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.463+0000 7f8caa17c640 1 Processor -- start 2023-11-18T19:06:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.463+0000 7f8caa17c640 1 -- start start 2023-11-18T19:06:53.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8caa17c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca41ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8caa17c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca40ca940 0x7f8ca40beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8caa17c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ca4151e30 0x7f8ca40befe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8caa17c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40c0190 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8caa17c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40bf520 con 0x7f8ca40ca940 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8caa17c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40be610 con 0x7f8ca4151e30 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca41ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca41ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44510/0 (socket says 172.21.15.45:44510) 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.464+0000 7f8ca37fe640 1 -- 172.21.15.45:0/3558664452 learned_addr learned my addr 172.21.15.45:0/3558664452 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca2ffd640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca40ca940 0x7f8ca40beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca3fff640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ca4151e30 0x7f8ca40befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca37fe640 1 -- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ca4151e30 msgr2=0x7f8ca40befe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca37fe640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ca4151e30 0x7f8ca40befe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca37fe640 1 -- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca40ca940 msgr2=0x7f8ca40beaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca37fe640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca40ca940 0x7f8ca40beaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca37fe640 1 -- 172.21.15.45:0/3558664452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0094d0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.465+0000 7f8ca37fe640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca41ed450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ce00 tx=0x7f8c9400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.466+0000 7f8c9bfff640 1 -- 172.21.15.45:0/3558664452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400f890 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.466+0000 7f8c9bfff640 1 -- 172.21.15.45:0/3558664452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9400f9f0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.466+0000 7f8c9bfff640 1 -- 172.21.15.45:0/3558664452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400fdc0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.466+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca41edf40 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.466+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca40bdfc0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.467+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca40747c0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.468+0000 7f8c9bfff640 1 -- 172.21.15.45:0/3558664452 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c9400b040 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.470+0000 7f8c9bfff640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c8406ae70 0x7f8c8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.470+0000 7f8c9bfff640 1 -- 172.21.15.45:0/3558664452 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c9408a2f0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.470+0000 7f8ca2ffd640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c8406ae70 0x7f8c8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.471+0000 7f8ca2ffd640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c8406ae70 0x7f8c8406d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c036000 tx=0x7f8c8c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.475+0000 7f8c9bfff640 1 -- 172.21.15.45:0/3558664452 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c940550a0 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.675+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ca4151650 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.676+0000 7f8c9bfff640 1 -- 172.21.15.45:0/3558664452 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c9401d020 con 0x7f8ca40c7fc0 2023-11-18T19:06:53.677 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c8406ae70 msgr2=0x7f8c8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c8406ae70 0x7f8c8406d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c036000 tx=0x7f8c8c03c040 comp rx=0 tx=0).stop 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 msgr2=0x7f8ca41ed450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca41ed450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ce00 tx=0x7f8c9400a650 comp rx=0 tx=0).stop 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 shutdown_connections 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c8406ae70 0x7f8c8406d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ca4151e30 0x7f8ca40befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca40ca940 0x7f8ca40beaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 --2- 172.21.15.45:0/3558664452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca40c7fc0 0x7f8ca41ed450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.678+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 >> 172.21.15.45:0/3558664452 conn(0x7f8ca40663d0 msgr2=0x7f8ca40667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.679+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 shutdown_connections 2023-11-18T19:06:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.679+0000 7f8caa17c640 1 -- 172.21.15.45:0/3558664452 wait complete. 2023-11-18T19:06:53.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T19:06:53.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.925+0000 7fefada6f640 1 Processor -- start 2023-11-18T19:06:53.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.925+0000 7fefada6f640 1 -- start start 2023-11-18T19:06:53.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefada6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa8152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefada6f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefa80c1d50 0x7fefa80c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefada6f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa80c07d0 con 0x7fefa80ab740 2023-11-18T19:06:53.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefada6f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa806e3b0 con 0x7fefa80c1d50 2023-11-18T19:06:53.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefada6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80c21e0 con 0x7fefa814fc40 2023-11-18T19:06:53.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefa7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefa80c1d50 0x7fefa80c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefa7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefa80c1d50 0x7fefa80c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44512/0 (socket says 172.21.15.45:44512) 2023-11-18T19:06:53.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefa7fff640 1 -- 172.21.15.45:0/1515729512 learned_addr learned my addr 172.21.15.45:0/1515729512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:53.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.927+0000 7fefa77fe640 1 --2- 172.21.15.45:0/1515729512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.928+0000 7fefa7fff640 1 -- 172.21.15.45:0/1515729512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 msgr2=0x7fefa8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:53.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.928+0000 7fefa7fff640 1 --2- 172.21.15.45:0/1515729512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa8152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.928+0000 7fefa7fff640 1 -- 172.21.15.45:0/1515729512 >> v1:172.21.15.135:6789/0 conn(0x7fefa80ab740 legacy=0x7fefa806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.928+0000 7fefa7fff640 1 -- 172.21.15.45:0/1515729512 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8072070 con 0x7fefa80c1d50 2023-11-18T19:06:53.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.929+0000 7fefa7fff640 1 --2- 172.21.15.45:0/1515729512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80c1d50 0x7fefa80c4f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009870 tx=0x7fefa002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98571c6c9ce31f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefa67fc640 1 -- 172.21.15.45:0/1515729512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa00317c0 con 0x7fefa80c1d50 2023-11-18T19:06:53.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefa67fc640 1 -- 172.21.15.45:0/1515729512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0031920 con 0x7fefa80c1d50 2023-11-18T19:06:53.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefa67fc640 1 -- 172.21.15.45:0/1515729512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0031cb0 con 0x7fefa80c1d50 2023-11-18T19:06:53.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefada6f640 1 -- 172.21.15.45:0/1515729512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80c1d50 msgr2=0x7fefa80c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefada6f640 1 --2- 172.21.15.45:0/1515729512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80c1d50 0x7fefa80c4f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009870 tx=0x7fefa002b860 comp rx=0 tx=0).stop 2023-11-18T19:06:53.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefada6f640 1 -- 172.21.15.45:0/1515729512 shutdown_connections 2023-11-18T19:06:53.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefada6f640 1 --2- 172.21.15.45:0/1515729512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80c1d50 0x7fefa80c4f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefada6f640 1 --2- 172.21.15.45:0/1515729512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.930+0000 7fefada6f640 1 -- 172.21.15.45:0/1515729512 >> 172.21.15.45:0/1515729512 conn(0x7fefa80a7980 msgr2=0x7fefa80a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:53.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.931+0000 7fefada6f640 1 -- 172.21.15.45:0/1515729512 shutdown_connections 2023-11-18T19:06:53.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.931+0000 7fefada6f640 1 -- 172.21.15.45:0/1515729512 wait complete. 2023-11-18T19:06:53.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.932+0000 7fefada6f640 1 Processor -- start 2023-11-18T19:06:53.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.932+0000 7fefada6f640 1 -- start start 2023-11-18T19:06:53.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.933+0000 7fefada6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80ab740 0x7fefa81563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.933+0000 7fefada6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa80c1d50 0x7fefa81559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.933+0000 7fefada6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa80a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.933+0000 7fefada6f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81dc340 con 0x7fefa80ab740 2023-11-18T19:06:53.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.933+0000 7fefada6f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81e1350 con 0x7fefa80c1d50 2023-11-18T19:06:53.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.933+0000 7fefada6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa814e9a0 con 0x7fefa814fc40 2023-11-18T19:06:53.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80ab740 0x7fefa81563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80ab740 0x7fefa81563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44522/0 (socket says 172.21.15.45:44522) 2023-11-18T19:06:53.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 -- 172.21.15.45:0/4168696654 learned_addr learned my addr 172.21.15.45:0/4168696654 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:53.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa7fff640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa80a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa6ffd640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa80c1d50 0x7fefa81559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 -- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 msgr2=0x7fefa80a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa80a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 -- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa80c1d50 msgr2=0x7fefa81559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:53.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa80c1d50 0x7fefa81559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:53.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa77fe640 1 -- 172.21.15.45:0/4168696654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00094d0 con 0x7fefa80ab740 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa7fff640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa80a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.934+0000 7fefa6ffd640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa80c1d50 0x7fefa81559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.935+0000 7fefa77fe640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80ab740 0x7fefa81563d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d800 tx=0x7fef9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.935+0000 7fef9ffff640 1 -- 172.21.15.45:0/4168696654 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800b660 con 0x7fefa80ab740 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.935+0000 7fef9ffff640 1 -- 172.21.15.45:0/4168696654 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9800b7c0 con 0x7fefa80ab740 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.935+0000 7fef9ffff640 1 -- 172.21.15.45:0/4168696654 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800bb50 con 0x7fefa80ab740 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.935+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa81e15c0 con 0x7fefa80ab740 2023-11-18T19:06:53.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.935+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa8156910 con 0x7fefa80ab740 2023-11-18T19:06:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.936+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa8066b80 con 0x7fefa80ab740 2023-11-18T19:06:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.937+0000 7fef9ffff640 1 -- 172.21.15.45:0/4168696654 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef9800bcb0 con 0x7fefa80ab740 2023-11-18T19:06:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.938+0000 7fef9ffff640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef8806ae40 0x7fef8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.938+0000 7fef9ffff640 1 -- 172.21.15.45:0/4168696654 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef98089e40 con 0x7fefa80ab740 2023-11-18T19:06:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.938+0000 7fefa6ffd640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef8806ae40 0x7fef8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.939+0000 7fefa6ffd640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef8806ae40 0x7fef8806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefa80c0360 tx=0x7fef90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:53.942+0000 7fef9ffff640 1 -- 172.21.15.45:0/4168696654 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef98054b60 con 0x7fefa80ab740 2023-11-18T19:06:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.137+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fefa80747c0 con 0x7fefa80ab740 2023-11-18T19:06:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.138+0000 7fef9ffff640 1 -- 172.21.15.45:0/4168696654 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fef98058180 con 0x7fefa80ab740 2023-11-18T19:06:54.141 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:06:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.140+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef8806ae40 msgr2=0x7fef8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.140+0000 7fefada6f640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef8806ae40 0x7fef8806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefa80c0360 tx=0x7fef90009040 comp rx=0 tx=0).stop 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.140+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80ab740 msgr2=0x7fefa81563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.140+0000 7fefada6f640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80ab740 0x7fefa81563d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d800 tx=0x7fef9800dcc0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 shutdown_connections 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fef8806ae40 0x7fef8806d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefa814fc40 0x7fefa80a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa80c1d50 0x7fefa81559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 --2- 172.21.15.45:0/4168696654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80ab740 0x7fefa81563d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 >> 172.21.15.45:0/4168696654 conn(0x7fefa80a7980 msgr2=0x7fefa80c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 shutdown_connections 2023-11-18T19:06:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.141+0000 7fefada6f640 1 -- 172.21.15.45:0/4168696654 wait complete. 2023-11-18T19:06:54.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T19:06:54.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.386+0000 7fb85f59e640 1 Processor -- start 2023-11-18T19:06:54.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.387+0000 7fb85f59e640 1 -- start start 2023-11-18T19:06:54.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.388+0000 7fb85f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8600c7bc0 0x7fb860154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.388+0000 7fb85f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8600c66d0 0x7fb8600c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.388+0000 7fb85f59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86006c800 con 0x7fb8601519c0 2023-11-18T19:06:54.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.388+0000 7fb85f59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600c8070 con 0x7fb8600c7bc0 2023-11-18T19:06:54.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.388+0000 7fb85f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb860155440 con 0x7fb8600c66d0 2023-11-18T19:06:54.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.388+0000 7fb85e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb8601519c0 0x7fb86006c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47132/0 (socket says 172.21.15.45:47132) 2023-11-18T19:06:54.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85dd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8600c7bc0 0x7fb860154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85e59c640 1 -- 172.21.15.45:0/332666857 learned_addr learned my addr 172.21.15.45:0/332666857 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:54.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85ed9d640 1 --2- 172.21.15.45:0/332666857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8600c66d0 0x7fb8600c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85dd9b640 1 -- 172.21.15.45:0/332666857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8600c66d0 msgr2=0x7fb8600c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:54.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85dd9b640 1 --2- 172.21.15.45:0/332666857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8600c66d0 0x7fb8600c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85dd9b640 1 -- 172.21.15.45:0/332666857 >> v1:172.21.15.45:6789/0 conn(0x7fb8601519c0 legacy=0x7fb86006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85d59a640 1 -- 172.21.15.45:0/332666857 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307636993 0 0) 0x7fb86006c800 con 0x7fb8601519c0 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.389+0000 7fb85dd9b640 1 -- 172.21.15.45:0/332666857 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86006cec0 con 0x7fb8600c7bc0 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.390+0000 7fb85dd9b640 1 --2- 172.21.15.45:0/332666857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb860154f00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097a0 tx=0x7fb85402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2479b73bd3f31269 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85d59a640 1 -- 172.21.15.45:0/332666857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85402d040 con 0x7fb8600c7bc0 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85d59a640 1 -- 172.21.15.45:0/332666857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854031810 con 0x7fb8600c7bc0 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85d59a640 1 -- 172.21.15.45:0/332666857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854031ba0 con 0x7fb8600c7bc0 2023-11-18T19:06:54.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 -- 172.21.15.45:0/332666857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 msgr2=0x7fb860154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 --2- 172.21.15.45:0/332666857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb860154f00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097a0 tx=0x7fb85402b8b0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 -- 172.21.15.45:0/332666857 shutdown_connections 2023-11-18T19:06:54.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 --2- 172.21.15.45:0/332666857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8600c66d0 0x7fb8600c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 --2- 172.21.15.45:0/332666857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb860154f00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 -- 172.21.15.45:0/332666857 >> 172.21.15.45:0/332666857 conn(0x7fb8600aba30 msgr2=0x7fb8600abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 -- 172.21.15.45:0/332666857 shutdown_connections 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.391+0000 7fb85f59e640 1 -- 172.21.15.45:0/332666857 wait complete. 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.393+0000 7fb85f59e640 1 Processor -- start 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.393+0000 7fb85f59e640 1 -- start start 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c66d0 0x7fb86014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb8600c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8601519c0 0x7fb8600a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601eaa30 con 0x7fb8600c7bc0 2023-11-18T19:06:54.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85f59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601e9db0 con 0x7fb8600c66d0 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601ea090 con 0x7fb8601519c0 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb8600c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb8600c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44528/0 (socket says 172.21.15.45:44528) 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.394+0000 7fb85dd9b640 1 -- 172.21.15.45:0/3960442727 learned_addr learned my addr 172.21.15.45:0/3960442727 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85e59c640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c66d0 0x7fb86014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85ed9d640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8601519c0 0x7fb8600a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85dd9b640 1 -- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8601519c0 msgr2=0x7fb8600a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85dd9b640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8601519c0 0x7fb8600a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85dd9b640 1 -- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c66d0 msgr2=0x7fb86014b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85dd9b640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c66d0 0x7fb86014b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85dd9b640 1 -- 172.21.15.45:0/3960442727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854009400 con 0x7fb8600c7bc0 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85e59c640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c66d0 0x7fb86014b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85dd9b640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb8600c2b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8540098c0 tx=0x7fb8540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:54.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb84effd640 1 -- 172.21.15.45:0/3960442727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85403ad60 con 0x7fb8600c7bc0 2023-11-18T19:06:54.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb84effd640 1 -- 172.21.15.45:0/3960442727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854044400 con 0x7fb8600c7bc0 2023-11-18T19:06:54.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.395+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8601ea370 con 0x7fb8600c7bc0 2023-11-18T19:06:54.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.396+0000 7fb84effd640 1 -- 172.21.15.45:0/3960442727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8540447b0 con 0x7fb8600c7bc0 2023-11-18T19:06:54.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.396+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86014b8c0 con 0x7fb8600c7bc0 2023-11-18T19:06:54.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.397+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8601eab70 con 0x7fb8600c7bc0 2023-11-18T19:06:54.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.398+0000 7fb84effd640 1 -- 172.21.15.45:0/3960442727 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb85404d440 con 0x7fb8600c7bc0 2023-11-18T19:06:54.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.399+0000 7fb84effd640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb84006ae40 0x7fb84006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.399+0000 7fb84effd640 1 -- 172.21.15.45:0/3960442727 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8540abc10 con 0x7fb8600c7bc0 2023-11-18T19:06:54.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.400+0000 7fb85e59c640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb84006ae40 0x7fb84006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.400+0000 7fb85e59c640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb84006ae40 0x7fb84006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb850000f60 tx=0x7fb850009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:54.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.404+0000 7fb84effd640 1 -- 172.21.15.45:0/3960442727 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8601eab70 con 0x7fb8600c7bc0 2023-11-18T19:06:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.612+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb8601eab70 con 0x7fb8600c7bc0 2023-11-18T19:06:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.613+0000 7fb84effd640 1 -- 172.21.15.45:0/3960442727 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb854076b80 con 0x7fb8600c7bc0 2023-11-18T19:06:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-18T19:06:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.615+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb84006ae40 msgr2=0x7fb84006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.615+0000 7fb85f59e640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb84006ae40 0x7fb84006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb850000f60 tx=0x7fb850009040 comp rx=0 tx=0).stop 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.615+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 msgr2=0x7fb8600c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.615+0000 7fb85f59e640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb8600c2b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8540098c0 tx=0x7fb8540046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 shutdown_connections 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb84006ae40 0x7fb84006d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8601519c0 0x7fb8600a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8600c7bc0 0x7fb8600c2b00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 --2- 172.21.15.45:0/3960442727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c66d0 0x7fb86014b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 >> 172.21.15.45:0/3960442727 conn(0x7fb8600aba30 msgr2=0x7fb8600abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 shutdown_connections 2023-11-18T19:06:54.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.616+0000 7fb85f59e640 1 -- 172.21.15.45:0/3960442727 wait complete. 2023-11-18T19:06:54.638 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:06:54.638 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:06:54.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:54.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.957+0000 7f04e3ee7640 1 Processor -- start 2023-11-18T19:06:54.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.957+0000 7f04e3ee7640 1 -- start start 2023-11-18T19:06:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e3ee7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04dc151f20 0x7f04dc0c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e3ee7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06fb80 0x7f04dc1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e3ee7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0c5830 con 0x7f04dc06f1b0 2023-11-18T19:06:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e3ee7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0c6a80 con 0x7f04dc151f20 2023-11-18T19:06:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e3ee7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0c75f0 con 0x7f04dc06fb80 2023-11-18T19:06:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e1c83640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04dc151f20 0x7f04dc0c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e2484640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f04dc06f1b0 0x7f04dc0c7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47148/0 (socket says 172.21.15.45:47148) 2023-11-18T19:06:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e2484640 1 -- 172.21.15.45:0/3957580345 learned_addr learned my addr 172.21.15.45:0/3957580345 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.959+0000 7f04e1482640 1 --2- 172.21.15.45:0/3957580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06fb80 0x7f04dc1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.960+0000 7f04e1c83640 1 -- 172.21.15.45:0/3957580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06fb80 msgr2=0x7f04dc1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.960+0000 7f04e1c83640 1 --2- 172.21.15.45:0/3957580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06fb80 0x7f04dc1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.960+0000 7f04e1c83640 1 -- 172.21.15.45:0/3957580345 >> v1:172.21.15.45:6789/0 conn(0x7f04dc06f1b0 legacy=0x7f04dc0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.960+0000 7f04e1c83640 1 -- 172.21.15.45:0/3957580345 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0a70c0 con 0x7f04dc151f20 2023-11-18T19:06:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.960+0000 7f04e0c81640 1 -- 172.21.15.45:0/3957580345 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558708166 0 0) 0x7f04dc0c5830 con 0x7f04dc06f1b0 2023-11-18T19:06:54.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.961+0000 7f04e1c83640 1 --2- 172.21.15.45:0/3957580345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc0c20a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04d80097a0 tx=0x7f04d802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1171657a11b7e90 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:54.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.961+0000 7f04e0c81640 1 -- 172.21.15.45:0/3957580345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8031780 con 0x7f04dc151f20 2023-11-18T19:06:54.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.961+0000 7f04e0c81640 1 -- 172.21.15.45:0/3957580345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80318e0 con 0x7f04dc151f20 2023-11-18T19:06:54.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.961+0000 7f04e0c81640 1 -- 172.21.15.45:0/3957580345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8031c70 con 0x7f04dc151f20 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 -- 172.21.15.45:0/3957580345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 msgr2=0x7f04dc0c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/3957580345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc0c20a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04d80097a0 tx=0x7f04d802b820 comp rx=0 tx=0).stop 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 -- 172.21.15.45:0/3957580345 shutdown_connections 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/3957580345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06fb80 0x7f04dc1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/3957580345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc0c20a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 -- 172.21.15.45:0/3957580345 >> 172.21.15.45:0/3957580345 conn(0x7f04dc0661f0 msgr2=0x7f04dc0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 -- 172.21.15.45:0/3957580345 shutdown_connections 2023-11-18T19:06:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.962+0000 7f04e3ee7640 1 -- 172.21.15.45:0/3957580345 wait complete. 2023-11-18T19:06:54.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.964+0000 7f04e3ee7640 1 Processor -- start 2023-11-18T19:06:54.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.964+0000 7f04e3ee7640 1 -- start start 2023-11-18T19:06:54.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e3ee7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06f1b0 0x7f04dc1edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e3ee7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc06fb80 0x7f04dc06c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e3ee7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e3ee7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1ee140 con 0x7f04dc151f20 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e3ee7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0a7d50 con 0x7f04dc06fb80 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e3ee7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0a8a50 con 0x7f04dc06f1b0 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e2484640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e2484640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc14d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44548/0 (socket says 172.21.15.45:44548) 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e2484640 1 -- 172.21.15.45:0/2925680024 learned_addr learned my addr 172.21.15.45:0/2925680024 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e1482640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc06fb80 0x7f04dc06c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.965+0000 7f04e1c83640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06f1b0 0x7f04dc1edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e2484640 1 -- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06f1b0 msgr2=0x7f04dc1edc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e2484640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06f1b0 0x7f04dc1edc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e2484640 1 -- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc06fb80 msgr2=0x7f04dc06c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e2484640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc06fb80 0x7f04dc06c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e2484640 1 -- 172.21.15.45:0/2925680024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8009400 con 0x7f04dc151f20 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e1c83640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06f1b0 0x7f04dc1edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e2484640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc14d570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f04d400c7a0 tx=0x7f04d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04d27fc640 1 -- 172.21.15.45:0/2925680024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400a640 con 0x7f04dc151f20 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04d27fc640 1 -- 172.21.15.45:0/2925680024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d400a7a0 con 0x7f04dc151f20 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc0a8d30 con 0x7f04dc151f20 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04d27fc640 1 -- 172.21.15.45:0/2925680024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400abd0 con 0x7f04dc151f20 2023-11-18T19:06:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.966+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc06cc50 con 0x7f04dc151f20 2023-11-18T19:06:54.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.967+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc0c8b60 con 0x7f04dc151f20 2023-11-18T19:06:54.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.969+0000 7f04d27fc640 1 -- 172.21.15.45:0/2925680024 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04d400ad30 con 0x7f04dc151f20 2023-11-18T19:06:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.969+0000 7f04d27fc640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f04c006ae40 0x7f04c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.970+0000 7f04d27fc640 1 -- 172.21.15.45:0/2925680024 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04d4089120 con 0x7f04dc151f20 2023-11-18T19:06:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.970+0000 7f04e1c83640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f04c006ae40 0x7f04c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.971+0000 7f04e1c83640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f04c006ae40 0x7f04c006d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04d8036000 tx=0x7f04d8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:54.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:54.974+0000 7f04d27fc640 1 -- 172.21.15.45:0/2925680024 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04d4053ed0 con 0x7f04dc151f20 2023-11-18T19:06:55.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.168+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04dc0a88b0 con 0x7f04dc151f20 2023-11-18T19:06:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.172+0000 7f04d27fc640 1 -- 172.21.15.45:0/2925680024 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f04dc0a88b0 con 0x7f04dc151f20 2023-11-18T19:06:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:55.174 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:55.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.175+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f04c006ae40 msgr2=0x7f04c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.175+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f04c006ae40 0x7f04c006d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04d8036000 tx=0x7f04d8008030 comp rx=0 tx=0).stop 2023-11-18T19:06:55.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.175+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 msgr2=0x7f04dc14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.175+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc14d570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f04d400c7a0 tx=0x7f04d400cc60 comp rx=0 tx=0).stop 2023-11-18T19:06:55.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 shutdown_connections 2023-11-18T19:06:55.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04dc151f20 0x7f04dc14d570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04dc06fb80 0x7f04dc06c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f04c006ae40 0x7f04c006d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 --2- 172.21.15.45:0/2925680024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04dc06f1b0 0x7f04dc1edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 >> 172.21.15.45:0/2925680024 conn(0x7f04dc0661f0 msgr2=0x7f04dc0c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:55.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 shutdown_connections 2023-11-18T19:06:55.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.176+0000 7f04e3ee7640 1 -- 172.21.15.45:0/2925680024 wait complete. 2023-11-18T19:06:55.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T19:06:35.454808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T19:06:36.526298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T19:06:39.617712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T19:06:55.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:06:55.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.427+0000 7fc288a2d640 1 Processor -- start 2023-11-18T19:06:55.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.427+0000 7fc288a2d640 1 -- start start 2023-11-18T19:06:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.429+0000 7fc288a2d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc2840a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.429+0000 7fc288a2d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc284151e00 0x7fc284071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.429+0000 7fc288a2d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2840c3c50 con 0x7fc2840a5270 2023-11-18T19:06:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.429+0000 7fc288a2d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc284071080 con 0x7fc284151e00 2023-11-18T19:06:55.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.429+0000 7fc288a2d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc284071360 con 0x7fc2840c1e60 2023-11-18T19:06:55.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.429+0000 7fc281d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc284151e00 0x7fc284071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc282d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc2840a5270 0x7fc2841548f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47164/0 (socket says 172.21.15.45:47164) 2023-11-18T19:06:55.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc282d9d640 1 -- 172.21.15.45:0/4168021717 learned_addr learned my addr 172.21.15.45:0/4168021717 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:55.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc28259c640 1 --2- 172.21.15.45:0/4168021717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc2840a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc281d9b640 1 -- 172.21.15.45:0/4168021717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 msgr2=0x7fc2840a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:55.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc281d9b640 1 --2- 172.21.15.45:0/4168021717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc2840a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc281d9b640 1 -- 172.21.15.45:0/4168021717 >> v1:172.21.15.45:6789/0 conn(0x7fc2840a5270 legacy=0x7fc2841548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc281d9b640 1 -- 172.21.15.45:0/4168021717 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284071640 con 0x7fc284151e00 2023-11-18T19:06:55.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc28259c640 1 --2- 172.21.15.45:0/4168021717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc2840a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:55.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.430+0000 7fc28159a640 1 -- 172.21.15.45:0/4168021717 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890726309 0 0) 0x7fc2840c3c50 con 0x7fc2840a5270 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.431+0000 7fc281d9b640 1 --2- 172.21.15.45:0/4168021717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc284151e00 0x7fc284071e40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097a0 tx=0x7fc26c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7586802b4c790fdf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc28159a640 1 -- 172.21.15.45:0/4168021717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c031780 con 0x7fc284151e00 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc28159a640 1 -- 172.21.15.45:0/4168021717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c0318e0 con 0x7fc284151e00 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc28159a640 1 -- 172.21.15.45:0/4168021717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c031c70 con 0x7fc284151e00 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 -- 172.21.15.45:0/4168021717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc284151e00 msgr2=0x7fc284071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 --2- 172.21.15.45:0/4168021717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc284151e00 0x7fc284071e40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097a0 tx=0x7fc26c02b820 comp rx=0 tx=0).stop 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 -- 172.21.15.45:0/4168021717 shutdown_connections 2023-11-18T19:06:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 --2- 172.21.15.45:0/4168021717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc284151e00 0x7fc284071e40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 --2- 172.21.15.45:0/4168021717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc2840a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 -- 172.21.15.45:0/4168021717 >> 172.21.15.45:0/4168021717 conn(0x7fc2840a7980 msgr2=0x7fc2840a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 -- 172.21.15.45:0/4168021717 shutdown_connections 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.432+0000 7fc288a2d640 1 -- 172.21.15.45:0/4168021717 wait complete. 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.434+0000 7fc288a2d640 1 Processor -- start 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.434+0000 7fc288a2d640 1 -- start start 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.435+0000 7fc288a2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2840a5270 0x7fc28414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.435+0000 7fc288a2d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc28414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.435+0000 7fc288a2d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2841554e0 0x7fc284153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.435+0000 7fc288a2d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28414cd40 con 0x7fc2840a5270 2023-11-18T19:06:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.435+0000 7fc288a2d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840a7380 con 0x7fc2841554e0 2023-11-18T19:06:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.435+0000 7fc288a2d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840bf000 con 0x7fc2840c1e60 2023-11-18T19:06:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2840a5270 0x7fc28414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2840a5270 0x7fc28414c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44558/0 (socket says 172.21.15.45:44558) 2023-11-18T19:06:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 -- 172.21.15.45:0/167551103 learned_addr learned my addr 172.21.15.45:0/167551103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 -- 172.21.15.45:0/167551103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 msgr2=0x7fc28414c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc28414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 -- 172.21.15.45:0/167551103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2841554e0 msgr2=0x7fc284153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2841554e0 0x7fc284153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 -- 172.21.15.45:0/167551103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009400 con 0x7fc2840a5270 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.436+0000 7fc28259c640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2840a5270 0x7fc28414c2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc274009fc0 tx=0x7fc27400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.437+0000 7fc27affd640 1 -- 172.21.15.45:0/167551103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274003b90 con 0x7fc2840a5270 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.437+0000 7fc27affd640 1 -- 172.21.15.45:0/167551103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400f040 con 0x7fc2840a5270 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.437+0000 7fc27affd640 1 -- 172.21.15.45:0/167551103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274004030 con 0x7fc2840a5270 2023-11-18T19:06:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.437+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2840a6dc0 con 0x7fc2840a5270 2023-11-18T19:06:55.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.437+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2840a5db0 con 0x7fc2840a5270 2023-11-18T19:06:55.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.438+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284066b80 con 0x7fc2840a5270 2023-11-18T19:06:55.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.439+0000 7fc27affd640 1 -- 172.21.15.45:0/167551103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc274004190 con 0x7fc2840a5270 2023-11-18T19:06:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.440+0000 7fc27affd640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc26406ae70 0x7fc26406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.440+0000 7fc27affd640 1 -- 172.21.15.45:0/167551103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc274089bd0 con 0x7fc2840a5270 2023-11-18T19:06:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.440+0000 7fc281d9b640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc26406ae70 0x7fc26406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.441+0000 7fc281d9b640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc26406ae70 0x7fc26406d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc26c036000 tx=0x7fc26c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:55.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.444+0000 7fc27affd640 1 -- 172.21.15.45:0/167551103 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc274054a30 con 0x7fc2840a5270 2023-11-18T19:06:55.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.636+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2840747c0 con 0x7fc2840a5270 2023-11-18T19:06:55.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.637+0000 7fc27affd640 1 -- 172.21.15.45:0/167551103 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc27401a020 con 0x7fc2840a5270 2023-11-18T19:06:55.638 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:06:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.639+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc26406ae70 msgr2=0x7fc26406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.639+0000 7fc288a2d640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc26406ae70 0x7fc26406d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc26c036000 tx=0x7fc26c030000 comp rx=0 tx=0).stop 2023-11-18T19:06:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.639+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2840a5270 msgr2=0x7fc28414c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.639+0000 7fc288a2d640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2840a5270 0x7fc28414c2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc274009fc0 tx=0x7fc27400d560 comp rx=0 tx=0).stop 2023-11-18T19:06:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 shutdown_connections 2023-11-18T19:06:55.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2841554e0 0x7fc284153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc26406ae70 0x7fc26406d330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2840c1e60 0x7fc28414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 --2- 172.21.15.45:0/167551103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2840a5270 0x7fc28414c2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 >> 172.21.15.45:0/167551103 conn(0x7fc2840a7980 msgr2=0x7fc2840a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:55.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 shutdown_connections 2023-11-18T19:06:55.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.640+0000 7fc288a2d640 1 -- 172.21.15.45:0/167551103 wait complete. 2023-11-18T19:06:55.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T19:06:55.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.879+0000 7fe9c7b89640 1 Processor -- start 2023-11-18T19:06:55.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.880+0000 7fe9c7b89640 1 -- start start 2023-11-18T19:06:55.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.881+0000 7fe9c7b89640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9c00c4d00 0x7fe9c0158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.881+0000 7fe9c7b89640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c00c0ba0 con 0x7fe9c01585b0 2023-11-18T19:06:55.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.881+0000 7fe9c7b89640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c00a5140 con 0x7fe9c01555c0 2023-11-18T19:06:55.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.881+0000 7fe9c7b89640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c006c8f0 con 0x7fe9c00c4d00 2023-11-18T19:06:55.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.882+0000 7fe9c6126640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe9c01585b0 0x7fe9c015f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47174/0 (socket says 172.21.15.45:47174) 2023-11-18T19:06:55.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.882+0000 7fe9c6126640 1 -- 172.21.15.45:0/2149567705 learned_addr learned my addr 172.21.15.45:0/2149567705 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:55.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.882+0000 7fe9c5124640 1 --2- 172.21.15.45:0/2149567705 >> v2:172.21.15.135:3300/0 conn(0x7fe9c00c4d00 0x7fe9c0158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.882+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033325759 0 0) 0x7fe9c00c0ba0 con 0x7fe9c01585b0 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.882+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9ac003520 con 0x7fe9c01585b0 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3832518876 0 0) 0x7fe9ac003520 con 0x7fe9c01585b0 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 >> v2:172.21.15.135:3300/0 conn(0x7fe9c00c4d00 msgr2=0x7fe9c0158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 --2- 172.21.15.45:0/2149567705 >> v2:172.21.15.135:3300/0 conn(0x7fe9c00c4d00 0x7fe9c0158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 >> v1:172.21.15.135:6789/0 conn(0x7fe9c01555c0 legacy=0x7fe9c00bf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00a5420 con 0x7fe9c01585b0 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fe9b80019f0 con 0x7fe9c01585b0 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 >> v1:172.21.15.45:6789/0 conn(0x7fe9c01585b0 legacy=0x7fe9c015f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac003970 0x7fe9ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0047c0 0x7fe9ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac00c140 con 0x7fe9ac0052a0 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac00c2b0 con 0x7fe9ac003970 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac00c470 con 0x7fe9ac0047c0 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.883+0000 7fe9c6126640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c5925640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac003970 0x7fe9ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c5124640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0047c0 0x7fe9ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c6126640 1 -- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0047c0 msgr2=0x7fe9ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c6126640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0047c0 0x7fe9ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c6126640 1 -- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac003970 msgr2=0x7fe9ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c6126640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac003970 0x7fe9ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c6126640 1 -- 172.21.15.45:0/2149567705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac003520 con 0x7fe9ac0052a0 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.884+0000 7fe9c5124640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0047c0 0x7fe9ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.885+0000 7fe9c6126640 1 -- 172.21.15.45:0/2149567705 reap_dead start 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.885+0000 7fe9c6126640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800a800 tx=0x7fe9ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c606aba0a90ea7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:55.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.885+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80072d0 con 0x7fe9ac0052a0 2023-11-18T19:06:55.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.885+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b802f070 con 0x7fe9ac0052a0 2023-11-18T19:06:55.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.885+0000 7fe9c4923640 1 -- 172.21.15.45:0/2149567705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8007670 con 0x7fe9ac0052a0 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.886+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2149567705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ac0052a0 msgr2=0x7fe9ac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.886+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800a800 tx=0x7fe9ac0057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.886+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2149567705 shutdown_connections 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.886+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2149567705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9ac0052a0 0x7fe9ac00b980 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.886+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2149567705 >> 172.21.15.45:0/2149567705 conn(0x7fe9c00a7980 msgr2=0x7fe9c00a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.886+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2149567705 shutdown_connections 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.886+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2149567705 wait complete. 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.888+0000 7fe9c7b89640 1 Processor -- start 2023-11-18T19:06:55.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.888+0000 7fe9c7b89640 1 -- start start 2023-11-18T19:06:55.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.889+0000 7fe9c7b89640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0052a0 0x7fe9c014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.889+0000 7fe9c7b89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c0070870 0x7fe9c014c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.889+0000 7fe9c7b89640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0070cf0 0x7fe9c014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.889+0000 7fe9c7b89640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0156de0 con 0x7fe9c0070870 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.889+0000 7fe9c7b89640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0157900 con 0x7fe9c0070cf0 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.889+0000 7fe9c7b89640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0156b00 con 0x7fe9ac0052a0 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c0070870 0x7fe9c014c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c0070870 0x7fe9c014c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44582/0 (socket says 172.21.15.45:44582) 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 -- 172.21.15.45:0/2206165545 learned_addr learned my addr 172.21.15.45:0/2206165545 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c6126640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0070cf0 0x7fe9c014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 -- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0052a0 msgr2=0x7fe9c014cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0052a0 0x7fe9c014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 -- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0070cf0 msgr2=0x7fe9c014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:55.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0070cf0 0x7fe9c014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:55.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 -- 172.21.15.45:0/2206165545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0070070 con 0x7fe9c0070870 2023-11-18T19:06:55.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c6126640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0070cf0 0x7fe9c014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:55.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.890+0000 7fe9c5124640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c0070870 0x7fe9c014c110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0010880 tx=0x7fe9b0010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:55.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.891+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2206165545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b000eb60 con 0x7fe9c0070870 2023-11-18T19:06:55.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.891+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2206165545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b000ecc0 con 0x7fe9c0070870 2023-11-18T19:06:55.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.891+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2206165545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b001c400 con 0x7fe9c0070870 2023-11-18T19:06:55.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.891+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c0070350 con 0x7fe9c0070870 2023-11-18T19:06:55.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.891+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c0154480 con 0x7fe9c0070870 2023-11-18T19:06:55.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.892+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c0066b80 con 0x7fe9c0070870 2023-11-18T19:06:55.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.893+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2206165545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9b001c560 con 0x7fe9c0070870 2023-11-18T19:06:55.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.894+0000 7fe9b67fc640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe9a406ae70 0x7fe9a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:55.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.894+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2206165545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9b0089eb0 con 0x7fe9c0070870 2023-11-18T19:06:55.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.895+0000 7fe9c5925640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe9a406ae70 0x7fe9a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:55.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.895+0000 7fe9c5925640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe9a406ae70 0x7fe9a406d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0014f0 tx=0x7fe9bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:55.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:55.899+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2206165545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9b0054db0 con 0x7fe9c0070870 2023-11-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.095+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9c006fed0 con 0x7fe9c0070870 2023-11-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.096+0000 7fe9b67fc640 1 -- 172.21.15.45:0/2206165545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9c006fed0 con 0x7fe9c0070870 2023-11-18T19:06:56.097 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:06:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe9a406ae70 msgr2=0x7fe9a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe9a406ae70 0x7fe9a406d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0014f0 tx=0x7fe9bc009040 comp rx=0 tx=0).stop 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c0070870 msgr2=0x7fe9c014c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c0070870 0x7fe9c014c110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0010880 tx=0x7fe9b0010d40 comp rx=0 tx=0).stop 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 shutdown_connections 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c0070cf0 0x7fe9c014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c0070870 0x7fe9c014c110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe9a406ae70 0x7fe9a406d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 --2- 172.21.15.45:0/2206165545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9ac0052a0 0x7fe9c014cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 >> 172.21.15.45:0/2206165545 conn(0x7fe9c00a7980 msgr2=0x7fe9c006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 shutdown_connections 2023-11-18T19:06:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.099+0000 7fe9c7b89640 1 -- 172.21.15.45:0/2206165545 wait complete. 2023-11-18T19:06:56.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T19:06:56.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.349+0000 7fb40ed4e640 1 Processor -- start 2023-11-18T19:06:56.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.350+0000 7fb40ed4e640 1 -- start start 2023-11-18T19:06:56.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.351+0000 7fb40ed4e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb4080c8330 0x7fb4080c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.351+0000 7fb40ed4e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb4080c6620 0x7fb4081550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.351+0000 7fb40ed4e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4080c51f0 con 0x7fb4080c4690 2023-11-18T19:06:56.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.351+0000 7fb40ed4e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40806baf0 con 0x7fb4080c8330 2023-11-18T19:06:56.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.351+0000 7fb40ed4e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4080c5f10 con 0x7fb4080c6620 2023-11-18T19:06:56.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.351+0000 7fb40dd4c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb4080c4690 0x7fb40806bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47180/0 (socket says 172.21.15.45:47180) 2023-11-18T19:06:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.351+0000 7fb40dd4c640 1 -- 172.21.15.45:0/3183857149 learned_addr learned my addr 172.21.15.45:0/3183857149 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40d54b640 1 --2- 172.21.15.45:0/3183857149 >> v2:172.21.15.45:3300/0 conn(0x7fb4080c8330 0x7fb4080c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40e54d640 1 --2- 172.21.15.45:0/3183857149 >> v2:172.21.15.135:3300/0 conn(0x7fb4080c6620 0x7fb4081550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40cd4a640 1 -- 172.21.15.45:0/3183857149 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24361799 0 0) 0x7fb4080c51f0 con 0x7fb4080c4690 2023-11-18T19:06:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40cd4a640 1 -- 172.21.15.45:0/3183857149 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f4003520 con 0x7fb4080c4690 2023-11-18T19:06:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40d54b640 1 -- 172.21.15.45:0/3183857149 >> v2:172.21.15.135:3300/0 conn(0x7fb4080c6620 msgr2=0x7fb4081550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:56.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40d54b640 1 --2- 172.21.15.45:0/3183857149 >> v2:172.21.15.135:3300/0 conn(0x7fb4080c6620 0x7fb4081550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40d54b640 1 -- 172.21.15.45:0/3183857149 >> v1:172.21.15.45:6789/0 conn(0x7fb4080c4690 legacy=0x7fb40806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.352+0000 7fb40d54b640 1 -- 172.21.15.45:0/3183857149 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4081555f0 con 0x7fb4080c8330 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.353+0000 7fb40d54b640 1 --2- 172.21.15.45:0/3183857149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c8330 0x7fb4080c4a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4080bd7b0 tx=0x7fb3f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c5890e203c8280 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40cd4a640 1 -- 172.21.15.45:0/3183857149 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8031830 con 0x7fb4080c8330 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40cd4a640 1 -- 172.21.15.45:0/3183857149 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f8031990 con 0x7fb4080c8330 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40cd4a640 1 -- 172.21.15.45:0/3183857149 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8031d20 con 0x7fb4080c8330 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 -- 172.21.15.45:0/3183857149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c8330 msgr2=0x7fb4080c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/3183857149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c8330 0x7fb4080c4a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4080bd7b0 tx=0x7fb3f802b8d0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 -- 172.21.15.45:0/3183857149 shutdown_connections 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/3183857149 >> v2:172.21.15.135:3300/0 conn(0x7fb4080c6620 0x7fb4081550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/3183857149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c8330 0x7fb4080c4a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 -- 172.21.15.45:0/3183857149 >> 172.21.15.45:0/3183857149 conn(0x7fb4080ab8a0 msgr2=0x7fb4080abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 -- 172.21.15.45:0/3183857149 shutdown_connections 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.354+0000 7fb40ed4e640 1 -- 172.21.15.45:0/3183857149 wait complete. 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.356+0000 7fb40ed4e640 1 Processor -- start 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.356+0000 7fb40ed4e640 1 -- start start 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40ed4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4080c4690 0x7fb4081e9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40ed4e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c6620 0x7fb4081eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40ed4e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4080c8330 0x7fb4080c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40ed4e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080c08e0 con 0x7fb4080c6620 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40ed4e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40814f840 con 0x7fb4080c4690 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40ed4e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40814ec30 con 0x7fb4080c8330 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40d54b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c6620 0x7fb4081eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.357+0000 7fb40d54b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c6620 0x7fb4081eb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44598/0 (socket says 172.21.15.45:44598) 2023-11-18T19:06:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40d54b640 1 -- 172.21.15.45:0/675663648 learned_addr learned my addr 172.21.15.45:0/675663648 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40dd4c640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4080c4690 0x7fb4081e9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40e54d640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4080c8330 0x7fb4080c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40d54b640 1 -- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4080c8330 msgr2=0x7fb4080c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40d54b640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4080c8330 0x7fb4080c03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40d54b640 1 -- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4080c4690 msgr2=0x7fb4081e9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40d54b640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4080c4690 0x7fb4081e9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40d54b640 1 -- 172.21.15.45:0/675663648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009400 con 0x7fb4080c6620 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.358+0000 7fb40d54b640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c6620 0x7fb4081eb0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8034040 tx=0x7fb3f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.359+0000 7fb3fe7fc640 1 -- 172.21.15.45:0/675663648 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f803a830 con 0x7fb4080c6620 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.359+0000 7fb3fe7fc640 1 -- 172.21.15.45:0/675663648 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f803a9b0 con 0x7fb4080c6620 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.359+0000 7fb3fe7fc640 1 -- 172.21.15.45:0/675663648 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f803ad60 con 0x7fb4080c6620 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.359+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40814ef10 con 0x7fb4080c6620 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.359+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40814f4d0 con 0x7fb4080c6620 2023-11-18T19:06:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.360+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40814f690 con 0x7fb4080c6620 2023-11-18T19:06:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.361+0000 7fb3fe7fc640 1 -- 172.21.15.45:0/675663648 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3f804d440 con 0x7fb4080c6620 2023-11-18T19:06:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.362+0000 7fb3fe7fc640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb3ec06ae40 0x7fb3ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.362+0000 7fb3fe7fc640 1 -- 172.21.15.45:0/675663648 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3f80ab850 con 0x7fb4080c6620 2023-11-18T19:06:56.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.363+0000 7fb40dd4c640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb3ec06ae40 0x7fb3ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.363+0000 7fb40dd4c640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb3ec06ae40 0x7fb3ec06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4040011e0 tx=0x7fb404009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.367+0000 7fb3fe7fc640 1 -- 172.21.15.45:0/675663648 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3f8076570 con 0x7fb4080c6620 2023-11-18T19:06:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.561+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4081555f0 con 0x7fb4080c6620 2023-11-18T19:06:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.562+0000 7fb3fe7fc640 1 -- 172.21.15.45:0/675663648 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4081555f0 con 0x7fb4080c6620 2023-11-18T19:06:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb3ec06ae40 msgr2=0x7fb3ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb3ec06ae40 0x7fb3ec06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4040011e0 tx=0x7fb404009040 comp rx=0 tx=0).stop 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c6620 msgr2=0x7fb4081eb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c6620 0x7fb4081eb0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8034040 tx=0x7fb3f80046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 shutdown_connections 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb3ec06ae40 0x7fb3ec06d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4080c8330 0x7fb4080c03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4080c6620 0x7fb4081eb0f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 --2- 172.21.15.45:0/675663648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4080c4690 0x7fb4081e9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.564+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 >> 172.21.15.45:0/675663648 conn(0x7fb4080ab8a0 msgr2=0x7fb4080c4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.565+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 shutdown_connections 2023-11-18T19:06:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.565+0000 7fb40ed4e640 1 -- 172.21.15.45:0/675663648 wait complete. 2023-11-18T19:06:56.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T19:06:56.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.805+0000 7f532927e640 1 Processor -- start 2023-11-18T19:06:56.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.806+0000 7f532927e640 1 -- start start 2023-11-18T19:06:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.807+0000 7f532927e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f532406a500 0x7f53240c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.808+0000 7f532927e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532406ad10 con 0x7f532406a8e0 2023-11-18T19:06:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.808+0000 7f532927e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240c3fa0 con 0x7f5324152280 2023-11-18T19:06:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.808+0000 7f532927e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240c4280 con 0x7f532406a500 2023-11-18T19:06:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.808+0000 7f5328a7d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f532406a8e0 0x7f532406dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47192/0 (socket says 172.21.15.45:47192) 2023-11-18T19:06:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.808+0000 7f5328a7d640 1 -- 172.21.15.45:0/2619343581 learned_addr learned my addr 172.21.15.45:0/2619343581 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.808+0000 7f5323fff640 1 --2- 172.21.15.45:0/2619343581 >> v2:172.21.15.45:3300/0 conn(0x7f532406a500 0x7f53240c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.809+0000 7f5323fff640 1 -- 172.21.15.45:0/2619343581 >> v1:172.21.15.135:6789/0 conn(0x7f5324152280 legacy=0x7f532406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.808+0000 7f53237fe640 1 -- 172.21.15.45:0/2619343581 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456615709 0 0) 0x7f532406ad10 con 0x7f532406a8e0 2023-11-18T19:06:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.809+0000 7f5323fff640 1 -- 172.21.15.45:0/2619343581 >> v1:172.21.15.45:6789/0 conn(0x7f532406a8e0 legacy=0x7f532406dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.809+0000 7f5323fff640 1 -- 172.21.15.45:0/2619343581 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240c4560 con 0x7f532406a500 2023-11-18T19:06:56.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.810+0000 7f5323fff640 1 --2- 172.21.15.45:0/2619343581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f53240c39c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53140097a0 tx=0x7f531402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452fbdfc6e066e0e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:56.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.810+0000 7f53237fe640 1 -- 172.21.15.45:0/2619343581 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531402e070 con 0x7f532406a500 2023-11-18T19:06:56.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.810+0000 7f53237fe640 1 -- 172.21.15.45:0/2619343581 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140315a0 con 0x7f532406a500 2023-11-18T19:06:56.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.810+0000 7f53237fe640 1 -- 172.21.15.45:0/2619343581 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314031930 con 0x7f532406a500 2023-11-18T19:06:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.811+0000 7f532927e640 1 -- 172.21.15.45:0/2619343581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 msgr2=0x7f53240c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.811+0000 7f532927e640 1 --2- 172.21.15.45:0/2619343581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f53240c39c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53140097a0 tx=0x7f531402b840 comp rx=0 tx=0).stop 2023-11-18T19:06:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.811+0000 7f532927e640 1 -- 172.21.15.45:0/2619343581 shutdown_connections 2023-11-18T19:06:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.811+0000 7f532927e640 1 --2- 172.21.15.45:0/2619343581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f53240c39c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.811+0000 7f532927e640 1 -- 172.21.15.45:0/2619343581 >> 172.21.15.45:0/2619343581 conn(0x7f53240a7870 msgr2=0x7f53240a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.811+0000 7f532927e640 1 -- 172.21.15.45:0/2619343581 shutdown_connections 2023-11-18T19:06:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.811+0000 7f532927e640 1 -- 172.21.15.45:0/2619343581 wait complete. 2023-11-18T19:06:56.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.813+0000 7f532927e640 1 Processor -- start 2023-11-18T19:06:56.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.813+0000 7f532927e640 1 -- start start 2023-11-18T19:06:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f532927e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f5324155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f532927e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532406a8e0 0x7f53241e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f532927e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5324152280 0x7f53241e7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f532927e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324155550 con 0x7f532406a500 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f532927e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53241ea900 con 0x7f532406a8e0 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f532927e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53241557a0 con 0x7f5324152280 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f5323fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f5324155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f5323fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f5324155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44610/0 (socket says 172.21.15.45:44610) 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f5323fff640 1 -- 172.21.15.45:0/4187134573 learned_addr learned my addr 172.21.15.45:0/4187134573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.814+0000 7f531bfff640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532406a8e0 0x7f53241e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5328a7d640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5324152280 0x7f53241e7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5323fff640 1 -- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5324152280 msgr2=0x7f53241e7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5323fff640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5324152280 0x7f53241e7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5323fff640 1 -- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532406a8e0 msgr2=0x7f53241e6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5323fff640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532406a8e0 0x7f53241e6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5323fff640 1 -- 172.21.15.45:0/4187134573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009400 con 0x7f532406a500 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5328a7d640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5324152280 0x7f53241e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f5323fff640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f5324155e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53140098c0 tx=0x7f53140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f53217fa640 1 -- 172.21.15.45:0/4187134573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314032840 con 0x7f532406a500 2023-11-18T19:06:56.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f53217fa640 1 -- 172.21.15.45:0/4187134573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140329a0 con 0x7f532406a500 2023-11-18T19:06:56.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53241ea590 con 0x7f532406a500 2023-11-18T19:06:56.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.815+0000 7f53217fa640 1 -- 172.21.15.45:0/4187134573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314032d50 con 0x7f532406a500 2023-11-18T19:06:56.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.816+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53240a7570 con 0x7f532406a500 2023-11-18T19:06:56.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.817+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53241ea3d0 con 0x7f532406a500 2023-11-18T19:06:56.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.818+0000 7f53217fa640 1 -- 172.21.15.45:0/4187134573 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f531403b3f0 con 0x7f532406a500 2023-11-18T19:06:56.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.819+0000 7f53217fa640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f530406ae40 0x7f530406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:56.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.819+0000 7f53217fa640 1 -- 172.21.15.45:0/4187134573 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53140ab9c0 con 0x7f532406a500 2023-11-18T19:06:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.819+0000 7f531bfff640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f530406ae40 0x7f530406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.820+0000 7f531bfff640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f530406ae40 0x7f530406d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f530c006fd0 tx=0x7f530c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:56.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:56.823+0000 7f53217fa640 1 -- 172.21.15.45:0/4187134573 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5314076810 con 0x7f532406a500 2023-11-18T19:06:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.019+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f53240683a0 con 0x7f532406a500 2023-11-18T19:06:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.019+0000 7f53217fa640 1 -- 172.21.15.45:0/4187134573 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5314079e30 con 0x7f532406a500 2023-11-18T19:06:57.021 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f530406ae40 msgr2=0x7f530406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f530406ae40 0x7f530406d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f530c006fd0 tx=0x7f530c008040 comp rx=0 tx=0).stop 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 msgr2=0x7f5324155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f5324155e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53140098c0 tx=0x7f53140046c0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 shutdown_connections 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f530406ae40 0x7f530406d300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5324152280 0x7f53241e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f532406a8e0 0x7f53241e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 --2- 172.21.15.45:0/4187134573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532406a500 0x7f5324155e10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 >> 172.21.15.45:0/4187134573 conn(0x7f53240a7870 msgr2=0x7f53240714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 shutdown_connections 2023-11-18T19:06:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.022+0000 7f532927e640 1 -- 172.21.15.45:0/4187134573 wait complete. 2023-11-18T19:06:57.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T19:06:57.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.270+0000 7f76ae0ad640 1 Processor -- start 2023-11-18T19:06:57.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.270+0000 7f76ae0ad640 1 -- start start 2023-11-18T19:06:57.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ae0ad640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a80727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ae0ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76a80c55b0 0x7f76a80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ae0ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a80c1f20 con 0x7f76a8155880 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ae0ad640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a80c1d10 con 0x7f76a80c55b0 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ae0ad640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8071d90 con 0x7f76a80a5100 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ac8aa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76a80c55b0 0x7f76a80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ad8ac640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f76a8155880 0x7f76a806daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47196/0 (socket says 172.21.15.45:47196) 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ad8ac640 1 -- 172.21.15.45:0/4275874200 learned_addr learned my addr 172.21.15.45:0/4275874200 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.272+0000 7f76ac8aa640 1 --2- 172.21.15.45:0/4275874200 >> v2:172.21.15.45:3300/0 conn(0x7f76a80c55b0 0x7f76a80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44618/0 (socket says 172.21.15.45:44618) 2023-11-18T19:06:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.273+0000 7f76ad0ab640 1 --2- 172.21.15.45:0/4275874200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a80727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.273+0000 7f76ac8aa640 1 -- 172.21.15.45:0/4275874200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 msgr2=0x7f76a80727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.273+0000 7f76ac8aa640 1 --2- 172.21.15.45:0/4275874200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a80727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.273+0000 7f76ac8aa640 1 -- 172.21.15.45:0/4275874200 >> v1:172.21.15.45:6789/0 conn(0x7f76a8155880 legacy=0x7f76a806daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.273+0000 7f76ac8aa640 1 -- 172.21.15.45:0/4275874200 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a80c2200 con 0x7f76a80c55b0 2023-11-18T19:06:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.273+0000 7f769ffff640 1 -- 172.21.15.45:0/4275874200 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833862534 0 0) 0x7f76a80c1f20 con 0x7f76a8155880 2023-11-18T19:06:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.274+0000 7f76ac8aa640 1 --2- 172.21.15.45:0/4275874200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a80c55b0 0x7f76a80702c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76980097a0 tx=0x7f769802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ffe29214eb732 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.274+0000 7f769ffff640 1 -- 172.21.15.45:0/4275874200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769802e070 con 0x7f76a80c55b0 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.274+0000 7f769ffff640 1 -- 172.21.15.45:0/4275874200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76980315a0 con 0x7f76a80c55b0 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.274+0000 7f769ffff640 1 -- 172.21.15.45:0/4275874200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698031930 con 0x7f76a80c55b0 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 -- 172.21.15.45:0/4275874200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a80c55b0 msgr2=0x7f76a80702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/4275874200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a80c55b0 0x7f76a80702c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76980097a0 tx=0x7f769802b840 comp rx=0 tx=0).stop 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 -- 172.21.15.45:0/4275874200 shutdown_connections 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/4275874200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a80c55b0 0x7f76a80702c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/4275874200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a80727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 -- 172.21.15.45:0/4275874200 >> 172.21.15.45:0/4275874200 conn(0x7f76a80a78a0 msgr2=0x7f76a80a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 -- 172.21.15.45:0/4275874200 shutdown_connections 2023-11-18T19:06:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.275+0000 7f76ae0ad640 1 -- 172.21.15.45:0/4275874200 wait complete. 2023-11-18T19:06:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.277+0000 7f76ae0ad640 1 Processor -- start 2023-11-18T19:06:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.277+0000 7f76ae0ad640 1 -- start start 2023-11-18T19:06:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ae0ad640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ae0ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a80c55b0 0x7f76a814c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ae0ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a8155880 0x7f76a814c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ae0ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8153000 con 0x7f76a8155880 2023-11-18T19:06:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ae0ad640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80ab7c0 con 0x7f76a80c55b0 2023-11-18T19:06:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ae0ad640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8152240 con 0x7f76a80a5100 2023-11-18T19:06:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ad8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a8155880 0x7f76a814c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ad8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a8155880 0x7f76a814c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44620/0 (socket says 172.21.15.45:44620) 2023-11-18T19:06:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.278+0000 7f76ad8ac640 1 -- 172.21.15.45:0/3197959803 learned_addr learned my addr 172.21.15.45:0/3197959803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ac8aa640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a80c55b0 0x7f76a814c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ad0ab640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ad8ac640 1 -- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 msgr2=0x7f76a806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ad8ac640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a806cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ad8ac640 1 -- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a80c55b0 msgr2=0x7f76a814c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ad8ac640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a80c55b0 0x7f76a814c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ad8ac640 1 -- 172.21.15.45:0/3197959803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698009400 con 0x7f76a8155880 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ad8ac640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a8155880 0x7f76a814c600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c7e0 tx=0x7f76a000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f769dffb640 1 -- 172.21.15.45:0/3197959803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000a640 con 0x7f76a8155880 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f769dffb640 1 -- 172.21.15.45:0/3197959803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a000a7c0 con 0x7f76a8155880 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a8152520 con 0x7f76a8155880 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.279+0000 7f769dffb640 1 -- 172.21.15.45:0/3197959803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000ab70 con 0x7f76a8155880 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.280+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a8152ae0 con 0x7f76a8155880 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.281+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a8067940 con 0x7f76a8155880 2023-11-18T19:06:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.282+0000 7f769dffb640 1 -- 172.21.15.45:0/3197959803 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76a000acd0 con 0x7f76a8155880 2023-11-18T19:06:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.283+0000 7f769dffb640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae70 0x7f768c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.283+0000 7f769dffb640 1 -- 172.21.15.45:0/3197959803 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76a00891b0 con 0x7f76a8155880 2023-11-18T19:06:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.283+0000 7f76ad0ab640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae70 0x7f768c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.283+0000 7f76ad0ab640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae70 0x7f768c06d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76a4006fd0 tx=0x7f76a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:57.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.287+0000 7f769dffb640 1 -- 172.21.15.45:0/3197959803 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76a0053ee0 con 0x7f76a8155880 2023-11-18T19:06:57.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.495+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f76a8152cd0 con 0x7f76a8155880 2023-11-18T19:06:57.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.496+0000 7f769dffb640 1 -- 172.21.15.45:0/3197959803 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f76a0018080 con 0x7f76a8155880 2023-11-18T19:06:57.497 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-18T19:06:57.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae70 msgr2=0x7f768c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae70 0x7f768c06d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76a4006fd0 tx=0x7f76a4008040 comp rx=0 tx=0).stop 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a8155880 msgr2=0x7f76a814c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a8155880 0x7f76a814c600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c7e0 tx=0x7f76a000cca0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 shutdown_connections 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a8155880 0x7f76a814c600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a80c55b0 0x7f76a814c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae70 0x7f768c06d330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 --2- 172.21.15.45:0/3197959803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a80a5100 0x7f76a806cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 >> 172.21.15.45:0/3197959803 conn(0x7f76a80a78a0 msgr2=0x7f76a80c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:57.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 shutdown_connections 2023-11-18T19:06:57.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.499+0000 7f76ae0ad640 1 -- 172.21.15.45:0/3197959803 wait complete. 2023-11-18T19:06:57.520 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-18T19:06:57.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:57.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-18T19:06:57.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[91810]: fuse finished with error 0 and tester_r 0 2023-11-18T19:06:57.617 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:06:57.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:06:57.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:06:57.656 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-18T19:06:57.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:57.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.992+0000 7f8a9890f640 1 Processor -- start 2023-11-18T19:06:57.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.993+0000 7f8a9890f640 1 -- start start 2023-11-18T19:06:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.994+0000 7f8a9890f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a940a9280 0x7f8a9415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.994+0000 7f8a9890f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a94155790 con 0x7f8a9414eb20 2023-11-18T19:06:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.994+0000 7f8a9890f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a940c21f0 con 0x7f8a94155310 2023-11-18T19:06:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.994+0000 7f8a9890f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a940aab40 con 0x7f8a940a9280 2023-11-18T19:06:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.994+0000 7f8a9259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8a9414eb20 0x7f8a940c4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47204/0 (socket says 172.21.15.45:47204) 2023-11-18T19:06:57.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.994+0000 7f8a9259c640 1 -- 172.21.15.45:0/4097555148 learned_addr learned my addr 172.21.15.45:0/4097555148 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:57.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.994+0000 7f8a92d9d640 1 --2- 172.21.15.45:0/4097555148 >> v2:172.21.15.135:3300/0 conn(0x7f8a940a9280 0x7f8a9415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910637106 0 0) 0x7f8a94155790 con 0x7f8a9414eb20 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a80005730 con 0x7f8a9414eb20 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238922280 0 0) 0x7f8a80005730 con 0x7f8a9414eb20 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 >> v2:172.21.15.135:3300/0 conn(0x7f8a940a9280 msgr2=0x7f8a9415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 --2- 172.21.15.45:0/4097555148 >> v2:172.21.15.135:3300/0 conn(0x7f8a940a9280 0x7f8a9415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 >> v1:172.21.15.135:6789/0 conn(0x7f8a94155310 legacy=0x7f8a940a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a941516c0 con 0x7f8a9414eb20 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f8a840019f0 con 0x7f8a9414eb20 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 >> v1:172.21.15.45:6789/0 conn(0x7f8a9414eb20 legacy=0x7f8a940c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a80005b80 0x7f8a80005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800069d0 0x7f8a80006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800074b0 0x7f8a8000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000e350 con 0x7f8a800069d0 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000e4c0 con 0x7f8a800074b0 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.995+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000e680 con 0x7f8a80005b80 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a91d9b640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800069d0 0x7f8a80006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a92d9d640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800074b0 0x7f8a8000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a91d9b640 1 -- 172.21.15.45:0/4097555148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a80005b80 msgr2=0x7f8a80005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a91d9b640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a80005b80 0x7f8a80005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a91d9b640 1 -- 172.21.15.45:0/4097555148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800074b0 msgr2=0x7f8a8000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a91d9b640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800074b0 0x7f8a8000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a91d9b640 1 -- 172.21.15.45:0/4097555148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80005730 con 0x7f8a800069d0 2023-11-18T19:06:57.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.996+0000 7f8a92d9d640 1 -- 172.21.15.45:0/4097555148 reap_dead start 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.997+0000 7f8a91d9b640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800069d0 0x7f8a80006e50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a940c3500 tx=0x7f8a80007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f02392a7a1d7f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.997+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0052d0 con 0x7f8a800069d0 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.997+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c02e050 con 0x7f8a800069d0 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.997+0000 7f8a9159a640 1 -- 172.21.15.45:0/4097555148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c003830 con 0x7f8a800069d0 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.998+0000 7f8a9890f640 1 -- 172.21.15.45:0/4097555148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800069d0 msgr2=0x7f8a80006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.998+0000 7f8a9890f640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800069d0 0x7f8a80006e50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a940c3500 tx=0x7f8a80007a00 comp rx=0 tx=0).stop 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.998+0000 7f8a9890f640 1 -- 172.21.15.45:0/4097555148 shutdown_connections 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.998+0000 7f8a9890f640 1 --2- 172.21.15.45:0/4097555148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800069d0 0x7f8a80006e50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.998+0000 7f8a9890f640 1 -- 172.21.15.45:0/4097555148 >> 172.21.15.45:0/4097555148 conn(0x7f8a9406a500 msgr2=0x7f8a9406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.998+0000 7f8a9890f640 1 -- 172.21.15.45:0/4097555148 shutdown_connections 2023-11-18T19:06:58.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:57.998+0000 7f8a9890f640 1 -- 172.21.15.45:0/4097555148 wait complete. 2023-11-18T19:06:58.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.000+0000 7f8a9890f640 1 Processor -- start 2023-11-18T19:06:58.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.000+0000 7f8a9890f640 1 -- start start 2023-11-18T19:06:58.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a9890f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800069d0 0x7f8a941ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a9890f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a940a5290 0x7f8a940bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a9890f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940a5f00 0x7f8a9414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a9890f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a941e9950 con 0x7f8a940a5290 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a9890f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a941ed960 con 0x7f8a940a5f00 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a9890f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a941e9bf0 con 0x7f8a800069d0 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a91d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a940a5290 0x7f8a940bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a91d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a940a5290 0x7f8a940bfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44636/0 (socket says 172.21.15.45:44636) 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.001+0000 7f8a91d9b640 1 -- 172.21.15.45:0/1132195923 learned_addr learned my addr 172.21.15.45:0/1132195923 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a92d9d640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940a5f00 0x7f8a9414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a9259c640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800069d0 0x7f8a941ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a91d9b640 1 -- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800069d0 msgr2=0x7f8a941ea3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a91d9b640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800069d0 0x7f8a941ea3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a91d9b640 1 -- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940a5f00 msgr2=0x7f8a9414cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a91d9b640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940a5f00 0x7f8a9414cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a91d9b640 1 -- 172.21.15.45:0/1132195923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a941e9ed0 con 0x7f8a940a5290 2023-11-18T19:06:58.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a91d9b640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a940a5290 0x7f8a940bfca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c005040 tx=0x7f8a7c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a8affd640 1 -- 172.21.15.45:0/1132195923 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0076c0 con 0x7f8a940a5290 2023-11-18T19:06:58.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a8affd640 1 -- 172.21.15.45:0/1132195923 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c007a30 con 0x7f8a940a5290 2023-11-18T19:06:58.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a8affd640 1 -- 172.21.15.45:0/1132195923 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c006c00 con 0x7f8a940a5290 2023-11-18T19:06:58.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.002+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a941edc40 con 0x7f8a940a5290 2023-11-18T19:06:58.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.003+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a940a4a70 con 0x7f8a940a5290 2023-11-18T19:06:58.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.004+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a940747c0 con 0x7f8a940a5290 2023-11-18T19:06:58.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.005+0000 7f8a8affd640 1 -- 172.21.15.45:0/1132195923 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a7c0035f0 con 0x7f8a940a5290 2023-11-18T19:06:58.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.006+0000 7f8a8affd640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a7406ae70 0x7f8a7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.006+0000 7f8a8affd640 1 -- 172.21.15.45:0/1132195923 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a7c0ab5b0 con 0x7f8a940a5290 2023-11-18T19:06:58.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.006+0000 7f8a9259c640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a7406ae70 0x7f8a7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.007+0000 7f8a9259c640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a7406ae70 0x7f8a7406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a84001370 tx=0x7f8a84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.010+0000 7f8a8affd640 1 -- 172.21.15.45:0/1132195923 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a7c076360 con 0x7f8a940a5290 2023-11-18T19:06:58.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.208+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a940c0d40 con 0x7f8a940a5290 2023-11-18T19:06:58.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.210+0000 7f8a8affd640 1 -- 172.21.15.45:0/1132195923 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f8a7c079980 con 0x7f8a940a5290 2023-11-18T19:06:58.212 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:58.212 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a7406ae70 msgr2=0x7f8a7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a7406ae70 0x7f8a7406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a84001370 tx=0x7f8a84009040 comp rx=0 tx=0).stop 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a940a5290 msgr2=0x7f8a940bfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a940a5290 0x7f8a940bfca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c005040 tx=0x7f8a7c001120 comp rx=0 tx=0).stop 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 shutdown_connections 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940a5f00 0x7f8a9414cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a940a5290 0x7f8a940bfca0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a7406ae70 0x7f8a7406d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 --2- 172.21.15.45:0/1132195923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800069d0 0x7f8a941ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.213+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 >> 172.21.15.45:0/1132195923 conn(0x7f8a9406a500 msgr2=0x7f8a9406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.214+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 shutdown_connections 2023-11-18T19:06:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.214+0000 7f8a9890f640 1 -- 172.21.15.45:0/1132195923 wait complete. 2023-11-18T19:06:58.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:06:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.450+0000 7fe9af59e640 1 Processor -- start 2023-11-18T19:06:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.451+0000 7fe9af59e640 1 -- start start 2023-11-18T19:06:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.452+0000 7fe9af59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00722c0 0x7fe9b00c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.452+0000 7fe9af59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9b0155890 0x7fe9b0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.452+0000 7fe9af59e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b00a5540 con 0x7fe9b00c2fb0 2023-11-18T19:06:58.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.452+0000 7fe9af59e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b0156780 con 0x7fe9b0155890 2023-11-18T19:06:58.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.452+0000 7fe9af59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b006b9a0 con 0x7fe9b00722c0 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9aed9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9b0155890 0x7fe9b0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9aed9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9b0155890 0x7fe9b0155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:35024/0 (socket says 172.21.15.45:35024) 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9aed9d640 1 -- 172.21.15.45:0/2142582035 learned_addr learned my addr 172.21.15.45:0/2142582035 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9add9b640 1 --2- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00722c0 0x7fe9b00c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9aed9d640 1 -- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00722c0 msgr2=0x7fe9b00c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9aed9d640 1 --2- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00722c0 0x7fe9b00c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9aed9d640 1 -- 172.21.15.45:0/2142582035 >> v1:172.21.15.135:6789/0 conn(0x7fe9b00c2fb0 legacy=0x7fe9b00a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.453+0000 7fe9aed9d640 1 -- 172.21.15.45:0/2142582035 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b006bc80 con 0x7fe9b0155890 2023-11-18T19:06:58.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.455+0000 7fe9aed9d640 1 --2- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b0155890 0x7fe9b0155d20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009e50 tx=0x7fe9a802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eed5b830670bd6a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.455+0000 7fe9ad59a640 1 -- 172.21.15.45:0/2142582035 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a802c9f0 con 0x7fe9b0155890 2023-11-18T19:06:58.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.455+0000 7fe9ad59a640 1 -- 172.21.15.45:0/2142582035 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a802cb50 con 0x7fe9b0155890 2023-11-18T19:06:58.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.455+0000 7fe9ad59a640 1 -- 172.21.15.45:0/2142582035 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80343f0 con 0x7fe9b0155890 2023-11-18T19:06:58.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 -- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b0155890 msgr2=0x7fe9b0155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 --2- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b0155890 0x7fe9b0155d20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009e50 tx=0x7fe9a802be50 comp rx=0 tx=0).stop 2023-11-18T19:06:58.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 -- 172.21.15.45:0/2142582035 shutdown_connections 2023-11-18T19:06:58.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 --2- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00722c0 0x7fe9b00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 --2- 172.21.15.45:0/2142582035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b0155890 0x7fe9b0155d20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 -- 172.21.15.45:0/2142582035 >> 172.21.15.45:0/2142582035 conn(0x7fe9b00c5af0 msgr2=0x7fe9b00c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:58.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 -- 172.21.15.45:0/2142582035 shutdown_connections 2023-11-18T19:06:58.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.456+0000 7fe9af59e640 1 -- 172.21.15.45:0/2142582035 wait complete. 2023-11-18T19:06:58.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.458+0000 7fe9af59e640 1 Processor -- start 2023-11-18T19:06:58.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.458+0000 7fe9af59e640 1 -- start start 2023-11-18T19:06:58.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.459+0000 7fe9af59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b00722c0 0x7fe9b00bae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.459+0000 7fe9af59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00c2fb0 0x7fe9b0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.459+0000 7fe9af59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b0155890 0x7fe9b0151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.459+0000 7fe9af59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00bcbb0 con 0x7fe9b0155890 2023-11-18T19:06:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.459+0000 7fe9af59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b0150ed0 con 0x7fe9b00722c0 2023-11-18T19:06:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.459+0000 7fe9af59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b01502c0 con 0x7fe9b00c2fb0 2023-11-18T19:06:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b0155890 0x7fe9b0151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b0155890 0x7fe9b0151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44646/0 (socket says 172.21.15.45:44646) 2023-11-18T19:06:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 -- 172.21.15.45:0/3331574200 learned_addr learned my addr 172.21.15.45:0/3331574200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9add9b640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00c2fb0 0x7fe9b0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9ae59c640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b00722c0 0x7fe9b00bae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 -- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00c2fb0 msgr2=0x7fe9b0152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00c2fb0 0x7fe9b0152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 -- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b00722c0 msgr2=0x7fe9b00bae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b00722c0 0x7fe9b00bae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9aed9d640 1 -- 172.21.15.45:0/3331574200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a8009b30 con 0x7fe9b0155890 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.460+0000 7fe9ae59c640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b00722c0 0x7fe9b00bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.461+0000 7fe9aed9d640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b0155890 0x7fe9b0151360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009e50 tx=0x7fe9a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.461+0000 7fe99effd640 1 -- 172.21.15.45:0/3331574200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a803e450 con 0x7fe9b0155890 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.461+0000 7fe99effd640 1 -- 172.21.15.45:0/3331574200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a803e5d0 con 0x7fe9b0155890 2023-11-18T19:06:58.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.461+0000 7fe99effd640 1 -- 172.21.15.45:0/3331574200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a803e980 con 0x7fe9b0155890 2023-11-18T19:06:58.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.461+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b01505a0 con 0x7fe9b0155890 2023-11-18T19:06:58.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.461+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b0150b60 con 0x7fe9b0155890 2023-11-18T19:06:58.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.462+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b0067fc0 con 0x7fe9b0155890 2023-11-18T19:06:58.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.463+0000 7fe99effd640 1 -- 172.21.15.45:0/3331574200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9a803eae0 con 0x7fe9b0155890 2023-11-18T19:06:58.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.464+0000 7fe99effd640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe99006ae40 0x7fe99006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.465+0000 7fe99effd640 1 -- 172.21.15.45:0/3331574200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9a80ac670 con 0x7fe9b0155890 2023-11-18T19:06:58.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.465+0000 7fe9ae59c640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe99006ae40 0x7fe99006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.465+0000 7fe9ae59c640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe99006ae40 0x7fe99006d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00bad10 tx=0x7fe9a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.469+0000 7fe99effd640 1 -- 172.21.15.45:0/3331574200 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9a8077420 con 0x7fe9b0155890 2023-11-18T19:06:58.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.665+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9b0151060 con 0x7fe9b0155890 2023-11-18T19:06:58.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.669+0000 7fe99effd640 1 -- 172.21.15.45:0/3331574200 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7fe9a807aa40 con 0x7fe9b0155890 2023-11-18T19:06:58.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:06:58.670 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe99006ae40 msgr2=0x7fe99006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe99006ae40 0x7fe99006d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00bad10 tx=0x7fe9a0009040 comp rx=0 tx=0).stop 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b0155890 msgr2=0x7fe9b0151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b0155890 0x7fe9b0151360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009e50 tx=0x7fe9a8004a40 comp rx=0 tx=0).stop 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 shutdown_connections 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b0155890 0x7fe9b0151360 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe99006ae40 0x7fe99006d300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b00c2fb0 0x7fe9b0152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 --2- 172.21.15.45:0/3331574200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b00722c0 0x7fe9b00bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.671+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 >> 172.21.15.45:0/3331574200 conn(0x7fe9b00c5af0 msgr2=0x7fe9b00c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.672+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 shutdown_connections 2023-11-18T19:06:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.672+0000 7fe9af59e640 1 -- 172.21.15.45:0/3331574200 wait complete. 2023-11-18T19:06:58.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-18T19:06:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.917+0000 7f3bda21a640 1 Processor -- start 2023-11-18T19:06:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.917+0000 7f3bda21a640 1 -- start start 2023-11-18T19:06:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.918+0000 7f3bda21a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 0x7f3bd4152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.918+0000 7f3bda21a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd406ad70 con 0x7f3bd406a8e0 2023-11-18T19:06:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.918+0000 7f3bda21a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40c3fa0 con 0x7f3bd406a500 2023-11-18T19:06:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.918+0000 7f3bda21a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c4280 con 0x7f3bd40c39c0 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.918+0000 7f3bd9a19640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3bd406a8e0 0x7f3bd406dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47220/0 (socket says 172.21.15.45:47220) 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.918+0000 7f3bd9a19640 1 -- 172.21.15.45:0/3459612306 learned_addr learned my addr 172.21.15.45:0/3459612306 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bd8a17640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 0x7f3bd4152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216656584 0 0) 0x7f3bcc001490 con 0x7f3bd406a8e0 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc0003520 con 0x7f3bd406a8e0 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2945412366 0 0) 0x7f3bc0003520 con 0x7f3bd406a8e0 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 msgr2=0x7f3bd4152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 0x7f3bd4152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 >> v1:172.21.15.135:6789/0 conn(0x7f3bd406a500 legacy=0x7f3bd406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40c4560 con 0x7f3bd406a8e0 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f3bcc001b80 con 0x7f3bd406a8e0 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 >> v1:172.21.15.45:6789/0 conn(0x7f3bd406a8e0 legacy=0x7f3bd406dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc00039a0 0x7f3bc0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.919+0000 7f3bcbfff640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc00047c0 0x7f3bc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bcbfff640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 0x7f3bc0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c4280 con 0x7f3bc00039a0 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc000bb40 con 0x7f3bc00047c0 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc000bd00 con 0x7f3bd40c39c0 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9218640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc00039a0 0x7f3bc0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd8a17640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc00047c0 0x7f3bc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9a19640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 0x7f3bc0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9218640 1 -- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 msgr2=0x7f3bc0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9218640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 0x7f3bc0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9218640 1 -- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc00047c0 msgr2=0x7f3bc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:06:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9218640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc00047c0 0x7f3bc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9218640 1 -- 172.21.15.45:0/3459612306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0003520 con 0x7f3bc00039a0 2023-11-18T19:06:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.920+0000 7f3bd9a19640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bd40c39c0 0x7f3bc0005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:06:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.921+0000 7f3bd9218640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc00039a0 0x7f3bc0003dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0001750 tx=0x7f3bc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4819221133b3dc77 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00052d0 con 0x7f3bc00039a0 2023-11-18T19:06:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd002e050 con 0x7f3bc00039a0 2023-11-18T19:06:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bcbfff640 1 -- 172.21.15.45:0/3459612306 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00035f0 con 0x7f3bc00039a0 2023-11-18T19:06:58.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bda21a640 1 -- 172.21.15.45:0/3459612306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc00039a0 msgr2=0x7f3bc0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bda21a640 1 --2- 172.21.15.45:0/3459612306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc00039a0 0x7f3bc0003dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0001750 tx=0x7f3bc00057f0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bd9a19640 1 -- 172.21.15.45:0/3459612306 reap_dead start 2023-11-18T19:06:58.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bda21a640 1 -- 172.21.15.45:0/3459612306 shutdown_connections 2023-11-18T19:06:58.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.922+0000 7f3bda21a640 1 -- 172.21.15.45:0/3459612306 >> 172.21.15.45:0/3459612306 conn(0x7f3bd40a7870 msgr2=0x7f3bd40a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:06:58.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.923+0000 7f3bda21a640 1 -- 172.21.15.45:0/3459612306 shutdown_connections 2023-11-18T19:06:58.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.923+0000 7f3bda21a640 1 -- 172.21.15.45:0/3459612306 wait complete. 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.924+0000 7f3bda21a640 1 Processor -- start 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.925+0000 7f3bda21a640 1 -- start start 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bda21a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bc00039a0 0x7f3bd4149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bda21a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bd41dc0b0 0x7f3bd41eb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bda21a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd4148eb0 0x7f3bd413a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bda21a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd414cc00 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bda21a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd414a0a0 con 0x7f3bd4148eb0 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bda21a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd41ebf50 con 0x7f3bc00039a0 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd8a17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bd41dc0b0 0x7f3bd41eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd8a17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bd41dc0b0 0x7f3bd41eb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44666/0 (socket says 172.21.15.45:44666) 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd8a17640 1 -- 172.21.15.45:0/2314489205 learned_addr learned my addr 172.21.15.45:0/2314489205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd9218640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bc00039a0 0x7f3bd4149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd9a19640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd4148eb0 0x7f3bd413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd8a17640 1 -- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bc00039a0 msgr2=0x7f3bd4149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd8a17640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bc00039a0 0x7f3bd4149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd8a17640 1 -- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd4148eb0 msgr2=0x7f3bd413a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.926+0000 7f3bd8a17640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd4148eb0 0x7f3bd413a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:06:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.927+0000 7f3bd8a17640 1 -- 172.21.15.45:0/2314489205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd41ec230 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.927+0000 7f3bd8a17640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bd41dc0b0 0x7f3bd41eb710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4011600 tx=0x7f3bc4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.927+0000 7f3bc9ffb640 1 -- 172.21.15.45:0/2314489205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400f920 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.927+0000 7f3bc9ffb640 1 -- 172.21.15.45:0/2314489205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400fa80 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.927+0000 7f3bc9ffb640 1 -- 172.21.15.45:0/2314489205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400fdf0 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.927+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd4149d30 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.927+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd413aee0 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.928+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd4149b70 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.929+0000 7f3bc9ffb640 1 -- 172.21.15.45:0/2314489205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3bc4015460 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.930+0000 7f3bc9ffb640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f3bb806ae40 0x7f3bb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:06:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.930+0000 7f3bc9ffb640 1 -- 172.21.15.45:0/2314489205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3bc4089ca0 con 0x7f3bd41dc0b0 2023-11-18T19:06:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.931+0000 7f3bd9218640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f3bb806ae40 0x7f3bb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:06:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.931+0000 7f3bd9218640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f3bb806ae40 0x7f3bb806d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0033000 tx=0x7f3bd0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:06:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:58.935+0000 7f3bc9ffb640 1 -- 172.21.15.45:0/2314489205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3bc4054af0 con 0x7f3bd41dc0b0 2023-11-18T19:06:59.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:06:59.167+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3bd41ec3c0 con 0x7f3bd41dc0b0 2023-11-18T19:07:00.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.081+0000 7f3bc9ffb640 1 -- 172.21.15.45:0/2314489205 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3bc40220b0 con 0x7f3bd41dc0b0 2023-11-18T19:07:00.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.084+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f3bb806ae40 msgr2=0x7f3bb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:00.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.084+0000 7f3bda21a640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f3bb806ae40 0x7f3bb806d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0033000 tx=0x7f3bd0009030 comp rx=0 tx=0).stop 2023-11-18T19:07:00.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bd41dc0b0 msgr2=0x7f3bd41eb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bd41dc0b0 0x7f3bd41eb710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4011600 tx=0x7f3bc4011ac0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 shutdown_connections 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd4148eb0 0x7f3bd413a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bd41dc0b0 0x7f3bd41eb710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f3bb806ae40 0x7f3bb806d300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 --2- 172.21.15.45:0/2314489205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bc00039a0 0x7f3bd4149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 >> 172.21.15.45:0/2314489205 conn(0x7f3bd40a7870 msgr2=0x7f3bd40a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 shutdown_connections 2023-11-18T19:07:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.085+0000 7f3bda21a640 1 -- 172.21.15.45:0/2314489205 wait complete. 2023-11-18T19:07:00.108 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-18T19:07:00.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-18T19:07:00.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.343+0000 7fceb1b5e640 1 Processor -- start 2023-11-18T19:07:00.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.343+0000 7fceb1b5e640 1 -- start start 2023-11-18T19:07:00.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.344+0000 7fceb1b5e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fceac0c3010 0x7fceac0c3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.344+0000 7fceb1b5e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac070840 con 0x7fceac06fd50 2023-11-18T19:07:00.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.344+0000 7fceb1b5e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac152c80 con 0x7fceac0a6d50 2023-11-18T19:07:00.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.344+0000 7fceb1b5e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac1531b0 con 0x7fceac0c3010 2023-11-18T19:07:00.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.345+0000 7fceb0b5c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fceac06fd50 0x7fceac070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47226/0 (socket says 172.21.15.45:47226) 2023-11-18T19:07:00.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.345+0000 7fceb0b5c640 1 -- 172.21.15.45:0/628198097 learned_addr learned my addr 172.21.15.45:0/628198097 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:00.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.345+0000 7fceb135d640 1 --2- 172.21.15.45:0/628198097 >> v2:172.21.15.135:3300/0 conn(0x7fceac0c3010 0x7fceac0c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.345+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970300430 0 0) 0x7fceac070840 con 0x7fceac06fd50 2023-11-18T19:07:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.345+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce94003520 con 0x7fceac06fd50 2023-11-18T19:07:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1290995173 0 0) 0x7fce94003520 con 0x7fceac06fd50 2023-11-18T19:07:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 >> v2:172.21.15.135:3300/0 conn(0x7fceac0c3010 msgr2=0x7fceac0c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 --2- 172.21.15.45:0/628198097 >> v2:172.21.15.135:3300/0 conn(0x7fceac0c3010 0x7fceac0c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 >> v1:172.21.15.135:6789/0 conn(0x7fceac0a6d50 legacy=0x7fceac14f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac06df40 con 0x7fceac06fd50 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fce9c001670 con 0x7fceac06fd50 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 >> v1:172.21.15.45:6789/0 conn(0x7fceac06fd50 legacy=0x7fceac070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce94003970 0x7fce94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce940047c0 0x7fce94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce940052a0 0x7fce9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1531b0 con 0x7fce940047c0 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9400c170 con 0x7fce940052a0 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9400c330 con 0x7fce94003970 2023-11-18T19:07:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.346+0000 7fceabfff640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce940047c0 0x7fce94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceb0b5c640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce94003970 0x7fce94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceb135d640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce940052a0 0x7fce9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceabfff640 1 -- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce94003970 msgr2=0x7fce94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceabfff640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce94003970 0x7fce94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceabfff640 1 -- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce940052a0 msgr2=0x7fce9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceabfff640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce940052a0 0x7fce9400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceabfff640 1 -- 172.21.15.45:0/628198097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94003520 con 0x7fce940047c0 2023-11-18T19:07:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.347+0000 7fceb135d640 1 -- 172.21.15.45:0/628198097 reap_dead start 2023-11-18T19:07:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.348+0000 7fceabfff640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce940047c0 0x7fce94004c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcea0001720 tx=0x7fce940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17771662b9160d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.348+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00052d0 con 0x7fce940047c0 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.348+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea002e050 con 0x7fce940047c0 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.348+0000 7fceab7fe640 1 -- 172.21.15.45:0/628198097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0003830 con 0x7fce940047c0 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.349+0000 7fceb1b5e640 1 -- 172.21.15.45:0/628198097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce940047c0 msgr2=0x7fce94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.349+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce940047c0 0x7fce94004c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcea0001720 tx=0x7fce940057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.349+0000 7fceb1b5e640 1 -- 172.21.15.45:0/628198097 shutdown_connections 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.349+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/628198097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce940047c0 0x7fce94004c40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.349+0000 7fceb1b5e640 1 -- 172.21.15.45:0/628198097 >> 172.21.15.45:0/628198097 conn(0x7fceac0a9930 msgr2=0x7fceac0a9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.349+0000 7fceb1b5e640 1 -- 172.21.15.45:0/628198097 shutdown_connections 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.349+0000 7fceb1b5e640 1 -- 172.21.15.45:0/628198097 wait complete. 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.351+0000 7fceb1b5e640 1 Processor -- start 2023-11-18T19:07:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.351+0000 7fceb1b5e640 1 -- start start 2023-11-18T19:07:00.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb1b5e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce940047c0 0x7fceac06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb1b5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac14e8a0 0x7fceac145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb1b5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceac1464f0 0x7fceac0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb1b5e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac146970 con 0x7fceac1464f0 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb1b5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac06cd00 con 0x7fceac14e8a0 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb1b5e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1ecb20 con 0x7fce940047c0 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb135d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceac1464f0 0x7fceac0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb135d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceac1464f0 0x7fceac0c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44686/0 (socket says 172.21.15.45:44686) 2023-11-18T19:07:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb135d640 1 -- 172.21.15.45:0/1424044829 learned_addr learned my addr 172.21.15.45:0/1424044829 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceb0b5c640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce940047c0 0x7fceac06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.352+0000 7fceabfff640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac14e8a0 0x7fceac145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fceb135d640 1 -- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce940047c0 msgr2=0x7fceac06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fceb135d640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce940047c0 0x7fceac06c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fceb135d640 1 -- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac14e8a0 msgr2=0x7fceac145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fceb135d640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac14e8a0 0x7fceac145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fceb135d640 1 -- 172.21.15.45:0/1424044829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac1ece00 con 0x7fceac1464f0 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fceb135d640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceac1464f0 0x7fceac0c45d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fceac0c2220 tx=0x7fcea40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fcea97fa640 1 -- 172.21.15.45:0/1424044829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400e070 con 0x7fceac1464f0 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fcea97fa640 1 -- 172.21.15.45:0/1424044829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4011e10 con 0x7fceac1464f0 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac1ed0e0 con 0x7fceac1464f0 2023-11-18T19:07:00.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.353+0000 7fcea97fa640 1 -- 172.21.15.45:0/1424044829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4003990 con 0x7fceac1464f0 2023-11-18T19:07:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.354+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac1e70e0 con 0x7fceac1464f0 2023-11-18T19:07:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.355+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac1ed600 con 0x7fceac1464f0 2023-11-18T19:07:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.356+0000 7fcea97fa640 1 -- 172.21.15.45:0/1424044829 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcea4003af0 con 0x7fceac1464f0 2023-11-18T19:07:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.357+0000 7fcea97fa640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae70 0x7fce9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.357+0000 7fcea97fa640 1 -- 172.21.15.45:0/1424044829 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcea408a0a0 con 0x7fceac1464f0 2023-11-18T19:07:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.357+0000 7fceb0b5c640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae70 0x7fce9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.358+0000 7fceb0b5c640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae70 0x7fce9806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce9c005990 tx=0x7fce9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:00.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.362+0000 7fcea97fa640 1 -- 172.21.15.45:0/1424044829 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fceac1ed600 con 0x7fceac1464f0 2023-11-18T19:07:00.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:00.596+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fceac1ed600 con 0x7fceac1464f0 2023-11-18T19:07:01.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.095+0000 7fcea97fa640 1 -- 172.21.15.45:0/1424044829 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fceac1ed600 con 0x7fceac1464f0 2023-11-18T19:07:01.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae70 msgr2=0x7fce9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae70 0x7fce9806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce9c005990 tx=0x7fce9c009040 comp rx=0 tx=0).stop 2023-11-18T19:07:01.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceac1464f0 msgr2=0x7fceac0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceac1464f0 0x7fceac0c45d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fceac0c2220 tx=0x7fcea40115a0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 shutdown_connections 2023-11-18T19:07:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceac1464f0 0x7fceac0c45d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceac14e8a0 0x7fceac145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae70 0x7fce9806d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 --2- 172.21.15.45:0/1424044829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce940047c0 0x7fceac06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.098+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 >> 172.21.15.45:0/1424044829 conn(0x7fceac0a9930 msgr2=0x7fceac1482f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.099+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 shutdown_connections 2023-11-18T19:07:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.099+0000 7fceb1b5e640 1 -- 172.21.15.45:0/1424044829 wait complete. 2023-11-18T19:07:01.122 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-18T19:07:01.122 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:07:01.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.335+0000 7eff26cdf640 1 Processor -- start 2023-11-18T19:07:01.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.335+0000 7eff26cdf640 1 -- start start 2023-11-18T19:07:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.336+0000 7eff26cdf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff20072210 0x7eff200c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff26cdf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200c5940 con 0x7eff200c3e70 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff26cdf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200c5380 con 0x7eff200c47b0 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff26cdf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200c4cb0 con 0x7eff20072210 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff254dc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff200c3e70 0x7eff200a96f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47234/0 (socket says 172.21.15.45:47234) 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff254dc640 1 -- 172.21.15.45:0/1786208320 learned_addr learned my addr 172.21.15.45:0/1786208320 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff25cdd640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff20072210 0x7eff200c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957490768 0 0) 0x7eff200c5940 con 0x7eff200c3e70 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.337+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff0c003520 con 0x7eff200c3e70 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232153139 0 0) 0x7eff0c003520 con 0x7eff200c3e70 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff20072210 msgr2=0x7eff200c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff20072210 0x7eff200c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 >> v1:172.21.15.135:6789/0 conn(0x7eff200c47b0 legacy=0x7eff2015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff200c5660 con 0x7eff200c3e70 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7eff10001670 con 0x7eff200c3e70 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 >> v1:172.21.15.45:6789/0 conn(0x7eff200c3e70 legacy=0x7eff200a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff20072210 0x7eff0c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff0c003f20 0x7eff0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c004d00 0x7eff0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200c4cb0 con 0x7eff0c004d00 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c00bb10 con 0x7eff0c003f20 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c00bcd0 con 0x7eff20072210 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.338+0000 7eff264de640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c004d00 0x7eff0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.339+0000 7eff254dc640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff0c003f20 0x7eff0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.339+0000 7eff264de640 1 -- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff20072210 msgr2=0x7eff0c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.339+0000 7eff264de640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff20072210 0x7eff0c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.339+0000 7eff264de640 1 -- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff0c003f20 msgr2=0x7eff0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.339+0000 7eff264de640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff0c003f20 0x7eff0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.339+0000 7eff264de640 1 -- 172.21.15.45:0/1786208320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c003520 con 0x7eff0c004d00 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.340+0000 7eff264de640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c004d00 0x7eff0c005180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff18001720 tx=0x7eff0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f4e3a9fd4c9706 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.340+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180052d0 con 0x7eff0c004d00 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.340+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1802e050 con 0x7eff0c004d00 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.340+0000 7eff24cdb640 1 -- 172.21.15.45:0/1786208320 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180035f0 con 0x7eff0c004d00 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.341+0000 7eff26cdf640 1 -- 172.21.15.45:0/1786208320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c004d00 msgr2=0x7eff0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.341+0000 7eff26cdf640 1 --2- 172.21.15.45:0/1786208320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c004d00 0x7eff0c005180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff18001720 tx=0x7eff0c0057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.341+0000 7eff264de640 1 -- 172.21.15.45:0/1786208320 reap_dead start 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.341+0000 7eff26cdf640 1 -- 172.21.15.45:0/1786208320 shutdown_connections 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.341+0000 7eff26cdf640 1 -- 172.21.15.45:0/1786208320 >> 172.21.15.45:0/1786208320 conn(0x7eff200c5af0 msgr2=0x7eff200c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.341+0000 7eff26cdf640 1 -- 172.21.15.45:0/1786208320 shutdown_connections 2023-11-18T19:07:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.341+0000 7eff26cdf640 1 -- 172.21.15.45:0/1786208320 wait complete. 2023-11-18T19:07:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.343+0000 7eff26cdf640 1 Processor -- start 2023-11-18T19:07:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.343+0000 7eff26cdf640 1 -- start start 2023-11-18T19:07:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff26cdf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff0c004d00 0x7eff201edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff26cdf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff200a4430 0x7eff200a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff26cdf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff201d7270 0x7eff201e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff26cdf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200a4930 con 0x7eff200a4430 2023-11-18T19:07:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff26cdf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff201ed430 con 0x7eff201d7270 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff26cdf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff201ed710 con 0x7eff0c004d00 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff254dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff200a4430 0x7eff200a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff254dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff200a4430 0x7eff200a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44708/0 (socket says 172.21.15.45:44708) 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.344+0000 7eff254dc640 1 -- 172.21.15.45:0/3403752550 learned_addr learned my addr 172.21.15.45:0/3403752550 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff25cdd640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff0c004d00 0x7eff201edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff264de640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff201d7270 0x7eff201e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff254dc640 1 -- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff0c004d00 msgr2=0x7eff201edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff254dc640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff0c004d00 0x7eff201edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff254dc640 1 -- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff201d7270 msgr2=0x7eff201e9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff254dc640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff201d7270 0x7eff201e9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff254dc640 1 -- 172.21.15.45:0/3403752550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff201ed9f0 con 0x7eff200a4430 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff264de640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff201d7270 0x7eff201e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff254dc640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff200a4430 0x7eff200a7600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff1000e7f0 tx=0x7eff1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff167fc640 1 -- 172.21.15.45:0/3403752550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000c8d0 con 0x7eff200a4430 2023-11-18T19:07:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff167fc640 1 -- 172.21.15.45:0/3403752550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000ca30 con 0x7eff200a4430 2023-11-18T19:07:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff167fc640 1 -- 172.21.15.45:0/3403752550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000cdc0 con 0x7eff200a4430 2023-11-18T19:07:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.345+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff200a4c10 con 0x7eff200a4430 2023-11-18T19:07:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.346+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff200a7b40 con 0x7eff200a4430 2023-11-18T19:07:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.347+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff20067fc0 con 0x7eff200a4430 2023-11-18T19:07:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.348+0000 7eff167fc640 1 -- 172.21.15.45:0/3403752550 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff1001d460 con 0x7eff200a4430 2023-11-18T19:07:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.348+0000 7eff167fc640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7eff0406ae70 0x7eff0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.349+0000 7eff167fc640 1 -- 172.21.15.45:0/3403752550 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff10089980 con 0x7eff200a4430 2023-11-18T19:07:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.349+0000 7eff25cdd640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7eff0406ae70 0x7eff0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.349+0000 7eff25cdd640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7eff0406ae70 0x7eff0406d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004b30 tx=0x7eff1c00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:01.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.353+0000 7eff167fc640 1 -- 172.21.15.45:0/3403752550 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff10054730 con 0x7eff200a4430 2023-11-18T19:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.591+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff20068410 con 0x7eff200a4430 2023-11-18T19:07:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.592+0000 7eff167fc640 1 -- 172.21.15.45:0/3403752550 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7eff10057d50 con 0x7eff200a4430 2023-11-18T19:07:01.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:01.594 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:07:00.598223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T19:07:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-11-18T19:07:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7eff0406ae70 msgr2=0x7eff0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7eff0406ae70 0x7eff0406d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004b30 tx=0x7eff1c00d040 comp rx=0 tx=0).stop 2023-11-18T19:07:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff200a4430 msgr2=0x7eff200a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff200a4430 0x7eff200a7600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff1000e7f0 tx=0x7eff1000ecb0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 shutdown_connections 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff201d7270 0x7eff201e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff200a4430 0x7eff200a7600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7eff0406ae70 0x7eff0406d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 --2- 172.21.15.45:0/3403752550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff0c004d00 0x7eff201edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 >> 172.21.15.45:0/3403752550 conn(0x7eff200c5af0 msgr2=0x7eff201dbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 shutdown_connections 2023-11-18T19:07:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.595+0000 7eff26cdf640 1 -- 172.21.15.45:0/3403752550 wait complete. 2023-11-18T19:07:01.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:07:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.828+0000 7f03969ef640 1 Processor -- start 2023-11-18T19:07:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.828+0000 7f03969ef640 1 -- start start 2023-11-18T19:07:01.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.830+0000 7f03969ef640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f03900726b0 0x7f03900a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.830+0000 7f03969ef640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900aa0b0 con 0x7f03900c4d70 2023-11-18T19:07:01.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.830+0000 7f03969ef640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900aa2f0 con 0x7f03900c3050 2023-11-18T19:07:01.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.830+0000 7f03969ef640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03900aa590 con 0x7f03900726b0 2023-11-18T19:07:01.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.830+0000 7f03959ed640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f03900c4d70 0x7f0390071fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47242/0 (socket says 172.21.15.45:47242) 2023-11-18T19:07:01.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.830+0000 7f03959ed640 1 -- 172.21.15.45:0/873124559 learned_addr learned my addr 172.21.15.45:0/873124559 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:01.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.830+0000 7f03951ec640 1 --2- 172.21.15.45:0/873124559 >> v2:172.21.15.135:3300/0 conn(0x7f03900726b0 0x7f03900a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345736680 0 0) 0x7f038c001110 con 0x7f03900c4d70 2023-11-18T19:07:01.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f037c003520 con 0x7f03900c4d70 2023-11-18T19:07:01.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3424093860 0 0) 0x7f037c003520 con 0x7f03900c4d70 2023-11-18T19:07:01.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 >> v2:172.21.15.135:3300/0 conn(0x7f03900726b0 msgr2=0x7f03900a9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:01.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 --2- 172.21.15.45:0/873124559 >> v2:172.21.15.135:3300/0 conn(0x7f03900726b0 0x7f03900a9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 >> v1:172.21.15.135:6789/0 conn(0x7f03900c3050 legacy=0x7f039006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039006c2b0 con 0x7f03900c4d70 2023-11-18T19:07:01.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f038c001800 con 0x7f03900c4d70 2023-11-18T19:07:01.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 >> v1:172.21.15.45:6789/0 conn(0x7f03900c4d70 legacy=0x7f0390071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f037c003970 0x7f037c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c0047c0 0x7f037c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c005180 0x7f037c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900aa590 con 0x7f037c003970 2023-11-18T19:07:01.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c00c120 con 0x7f037c005180 2023-11-18T19:07:01.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c00c2e0 con 0x7f037c0047c0 2023-11-18T19:07:01.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.831+0000 7f03959ed640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f037c003970 0x7f037c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.832+0000 7f03961ee640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c005180 0x7f037c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.832+0000 7f03959ed640 1 -- 172.21.15.45:0/873124559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c0047c0 msgr2=0x7f037c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:01.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.832+0000 7f03959ed640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c0047c0 0x7f037c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.832+0000 7f03959ed640 1 -- 172.21.15.45:0/873124559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c005180 msgr2=0x7f037c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:01.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.832+0000 7f03959ed640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f037c005180 0x7f037c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.832+0000 7f03959ed640 1 -- 172.21.15.45:0/873124559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c003520 con 0x7f037c003970 2023-11-18T19:07:01.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.832+0000 7f03961ee640 1 -- 172.21.15.45:0/873124559 reap_dead start 2023-11-18T19:07:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.833+0000 7f03959ed640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f037c003970 0x7f037c003d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c190 tx=0x7f037c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9af9d534a48a46b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.833+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c005ad0 con 0x7f037c003970 2023-11-18T19:07:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.833+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c005c50 con 0x7f037c003970 2023-11-18T19:07:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.833+0000 7f03949eb640 1 -- 172.21.15.45:0/873124559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c02c7e0 con 0x7f037c003970 2023-11-18T19:07:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.834+0000 7f03969ef640 1 -- 172.21.15.45:0/873124559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f037c003970 msgr2=0x7f037c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.834+0000 7f03969ef640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f037c003970 0x7f037c003d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c190 tx=0x7f037c0057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.834+0000 7f03969ef640 1 -- 172.21.15.45:0/873124559 shutdown_connections 2023-11-18T19:07:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.834+0000 7f03969ef640 1 --2- 172.21.15.45:0/873124559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f037c003970 0x7f037c003d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.834+0000 7f03969ef640 1 -- 172.21.15.45:0/873124559 >> 172.21.15.45:0/873124559 conn(0x7f03900c5af0 msgr2=0x7f03900c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.834+0000 7f03969ef640 1 -- 172.21.15.45:0/873124559 shutdown_connections 2023-11-18T19:07:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.834+0000 7f03969ef640 1 -- 172.21.15.45:0/873124559 wait complete. 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.836+0000 7f03969ef640 1 Processor -- start 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.836+0000 7f03969ef640 1 -- start start 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.837+0000 7f03969ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c003970 0x7f03901e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.837+0000 7f03969ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03900bab10 0x7f03900bf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.837+0000 7f03969ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03901d8aa0 0x7f03900be750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.837+0000 7f03969ef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03901e5e40 con 0x7f03901d8aa0 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.837+0000 7f03969ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390071970 con 0x7f03900bab10 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.837+0000 7f03969ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03900c5f70 con 0x7f037c003970 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.837+0000 7f03961ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03901d8aa0 0x7f03900be750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03901d8aa0 0x7f03900be750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44720/0 (socket says 172.21.15.45:44720) 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 -- 172.21.15.45:0/4121329073 learned_addr learned my addr 172.21.15.45:0/4121329073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03959ed640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c003970 0x7f03901e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03951ec640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03900bab10 0x7f03900bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 -- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c003970 msgr2=0x7f03901e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c003970 0x7f03901e62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 -- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03900bab10 msgr2=0x7f03900bf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03900bab10 0x7f03900bf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 -- 172.21.15.45:0/4121329073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03901e5810 con 0x7f03901d8aa0 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03951ec640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03900bab10 0x7f03900bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03961ee640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03901d8aa0 0x7f03900be750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f03900c1e00 tx=0x7f038800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03867fc640 1 -- 172.21.15.45:0/4121329073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388003b70 con 0x7f03901d8aa0 2023-11-18T19:07:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.838+0000 7f03867fc640 1 -- 172.21.15.45:0/4121329073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0388003cd0 con 0x7f03901d8aa0 2023-11-18T19:07:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.839+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03900c6210 con 0x7f03901d8aa0 2023-11-18T19:07:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.839+0000 7f03867fc640 1 -- 172.21.15.45:0/4121329073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03880052b0 con 0x7f03901d8aa0 2023-11-18T19:07:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.839+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03900bfd90 con 0x7f03901d8aa0 2023-11-18T19:07:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.840+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0390067fc0 con 0x7f03901d8aa0 2023-11-18T19:07:01.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.841+0000 7f03867fc640 1 -- 172.21.15.45:0/4121329073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0388005410 con 0x7f03901d8aa0 2023-11-18T19:07:01.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.842+0000 7f03867fc640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f037406ae40 0x7f037406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:01.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.842+0000 7f03867fc640 1 -- 172.21.15.45:0/4121329073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0388089210 con 0x7f03901d8aa0 2023-11-18T19:07:01.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.842+0000 7f03959ed640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f037406ae40 0x7f037406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:01.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.843+0000 7f03959ed640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f037406ae40 0x7f037406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f038c034000 tx=0x7f038c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:01.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:01.846+0000 7f03867fc640 1 -- 172.21.15.45:0/4121329073 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0388053fc0 con 0x7f03901d8aa0 2023-11-18T19:07:02.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.041+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0390068410 con 0x7f03901d8aa0 2023-11-18T19:07:02.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.043+0000 7f03867fc640 1 -- 172.21.15.45:0/4121329073 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f03880575e0 con 0x7f03901d8aa0 2023-11-18T19:07:02.045 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:02.046 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:07:02.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f037406ae40 msgr2=0x7f037406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f037406ae40 0x7f037406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f038c034000 tx=0x7f038c009030 comp rx=0 tx=0).stop 2023-11-18T19:07:02.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03901d8aa0 msgr2=0x7f03900be750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03901d8aa0 0x7f03900be750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f03900c1e00 tx=0x7f038800dc00 comp rx=0 tx=0).stop 2023-11-18T19:07:02.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 shutdown_connections 2023-11-18T19:07:02.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03901d8aa0 0x7f03900be750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03900bab10 0x7f03900bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f037406ae40 0x7f037406d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 --2- 172.21.15.45:0/4121329073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f037c003970 0x7f03901e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 >> 172.21.15.45:0/4121329073 conn(0x7f03900c5af0 msgr2=0x7f03900c1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:02.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 shutdown_connections 2023-11-18T19:07:02.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.046+0000 7f03969ef640 1 -- 172.21.15.45:0/4121329073 wait complete. 2023-11-18T19:07:02.067 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-18T19:07:02.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:07:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.281+0000 7f830e7a7640 1 Processor -- start 2023-11-18T19:07:02.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.281+0000 7f830e7a7640 1 -- start start 2023-11-18T19:07:02.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830e7a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83080726b0 0x7f83080a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830e7a7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080aa0b0 con 0x7f83080c4d70 2023-11-18T19:07:02.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830e7a7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080aa2f0 con 0x7f83080c3050 2023-11-18T19:07:02.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830e7a7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83080aa590 con 0x7f83080726b0 2023-11-18T19:07:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830cfa4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83080726b0 0x7f83080a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830d7a5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f83080c4d70 0x7f8308071fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47250/0 (socket says 172.21.15.45:47250) 2023-11-18T19:07:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830d7a5640 1 -- 172.21.15.45:0/2513151366 learned_addr learned my addr 172.21.15.45:0/2513151366 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830cfa4640 1 -- 172.21.15.45:0/2513151366 >> v1:172.21.15.135:6789/0 conn(0x7f83080c3050 legacy=0x7f830806cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.283+0000 7f830cfa4640 1 -- 172.21.15.45:0/2513151366 >> v1:172.21.15.45:6789/0 conn(0x7f83080c4d70 legacy=0x7f8308071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.284+0000 7f82fffff640 1 -- 172.21.15.45:0/2513151366 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919797103 0 0) 0x7f8304001110 con 0x7f83080c4d70 2023-11-18T19:07:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.284+0000 7f830cfa4640 1 -- 172.21.15.45:0/2513151366 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830806c2b0 con 0x7f83080726b0 2023-11-18T19:07:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.285+0000 7f830cfa4640 1 --2- 172.21.15.45:0/2513151366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080726b0 0x7f83080a9b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3add824f5db71929 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.285+0000 7f82fffff640 1 -- 172.21.15.45:0/2513151366 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f802e070 con 0x7f83080726b0 2023-11-18T19:07:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.285+0000 7f82fffff640 1 -- 172.21.15.45:0/2513151366 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f80315a0 con 0x7f83080726b0 2023-11-18T19:07:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.285+0000 7f82fffff640 1 -- 172.21.15.45:0/2513151366 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8031930 con 0x7f83080726b0 2023-11-18T19:07:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.286+0000 7f830e7a7640 1 -- 172.21.15.45:0/2513151366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080726b0 msgr2=0x7f83080a9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.286+0000 7f830e7a7640 1 --2- 172.21.15.45:0/2513151366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080726b0 0x7f83080a9b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f802b840 comp rx=0 tx=0).stop 2023-11-18T19:07:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.286+0000 7f830e7a7640 1 -- 172.21.15.45:0/2513151366 shutdown_connections 2023-11-18T19:07:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.286+0000 7f830e7a7640 1 --2- 172.21.15.45:0/2513151366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080726b0 0x7f83080a9b70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.286+0000 7f830e7a7640 1 -- 172.21.15.45:0/2513151366 >> 172.21.15.45:0/2513151366 conn(0x7f83080c5af0 msgr2=0x7f83080c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.286+0000 7f830e7a7640 1 -- 172.21.15.45:0/2513151366 shutdown_connections 2023-11-18T19:07:02.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.286+0000 7f830e7a7640 1 -- 172.21.15.45:0/2513151366 wait complete. 2023-11-18T19:07:02.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.288+0000 7f830e7a7640 1 Processor -- start 2023-11-18T19:07:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.288+0000 7f830e7a7640 1 -- start start 2023-11-18T19:07:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830e7a7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83080726b0 0x7f83081d5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830e7a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080c3050 0x7f83081ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830e7a7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83080c4d70 0x7f83081d8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830e7a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83081ecca0 con 0x7f83080c3050 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830e7a7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83081ecf80 con 0x7f83080726b0 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830e7a7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83080bc8f0 con 0x7f83080c4d70 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830cfa4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080c3050 0x7f83081ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830cfa4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080c3050 0x7f83081ed3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44740/0 (socket says 172.21.15.45:44740) 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830cfa4640 1 -- 172.21.15.45:0/113480263 learned_addr learned my addr 172.21.15.45:0/113480263 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830d7a5640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83080726b0 0x7f83081d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830dfa6640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83080c4d70 0x7f83081d8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830cfa4640 1 -- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83080c4d70 msgr2=0x7f83081d8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830cfa4640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83080c4d70 0x7f83081d8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.290+0000 7f830cfa4640 1 -- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83080726b0 msgr2=0x7f83081d5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f830cfa4640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83080726b0 0x7f83081d5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f830cfa4640 1 -- 172.21.15.45:0/113480263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8009400 con 0x7f83080c3050 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f830dfa6640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83080c4d70 0x7f83081d8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f830cfa4640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080c3050 0x7f83081ed3a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f82fdffb640 1 -- 172.21.15.45:0/113480263 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8032980 con 0x7f83080c3050 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f82fdffb640 1 -- 172.21.15.45:0/113480263 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8032ae0 con 0x7f83080c3050 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f82fdffb640 1 -- 172.21.15.45:0/113480263 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8032e90 con 0x7f83080c3050 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.291+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83080a4b70 con 0x7f83080c3050 2023-11-18T19:07:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.292+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830806d740 con 0x7f83080c3050 2023-11-18T19:07:02.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.293+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308067fc0 con 0x7f83080c3050 2023-11-18T19:07:02.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.293+0000 7f82fdffb640 1 -- 172.21.15.45:0/113480263 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82f803b3f0 con 0x7f83080c3050 2023-11-18T19:07:02.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.294+0000 7f82fdffb640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f82ec06ae70 0x7f82ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.295+0000 7f82fdffb640 1 -- 172.21.15.45:0/113480263 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82f80ab9e0 con 0x7f83080c3050 2023-11-18T19:07:02.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.295+0000 7f830d7a5640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f82ec06ae70 0x7f82ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.296+0000 7f830d7a5640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f82ec06ae70 0x7f82ec06d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8304000f60 tx=0x7f8304007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.299+0000 7f82fdffb640 1 -- 172.21.15.45:0/113480263 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82f8076830 con 0x7f83080c3050 2023-11-18T19:07:02.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.488+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83080aac90 con 0x7f82ec06ae70 2023-11-18T19:07:02.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.502+0000 7f82fdffb640 1 -- 172.21.15.45:0/113480263 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345226 (secure 0 0 0) 0x7f83080aac90 con 0x7f82ec06ae70 2023-11-18T19:07:02.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:02.510 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.509+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f82ec06ae70 msgr2=0x7f82ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.509+0000 7f830e7a7640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f82ec06ae70 0x7f82ec06d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8304000f60 tx=0x7f8304007c00 comp rx=0 tx=0).stop 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.509+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080c3050 msgr2=0x7f83081ed3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.509+0000 7f830e7a7640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080c3050 0x7f83081ed3a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f80046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 shutdown_connections 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f82ec06ae70 0x7f82ec06d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83080c4d70 0x7f83081d8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83080c3050 0x7f83081ed3a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 --2- 172.21.15.45:0/113480263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83080726b0 0x7f83081d5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 >> 172.21.15.45:0/113480263 conn(0x7f83080c5af0 msgr2=0x7f83080715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:02.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 shutdown_connections 2023-11-18T19:07:02.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.510+0000 7f830e7a7640 1 -- 172.21.15.45:0/113480263 wait complete. 2023-11-18T19:07:02.530 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-18T19:07:01.174631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222736,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751984,"statfs":{"total":773094113280,"available":772866031616,"internally_reserved":0,"allocated":2457600,"data_stored":2070758,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004605"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595259+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:06:41.595259+0000","last_peered":"2023-11-18T19:06:41.595259+0000","last_clean":"2023-11-18T19:06:41.595259+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:06:41.595259+0000","last_undegraded":"2023-11-18T19:06:41.595259+0000","last_fullsized":"2023-11-18T19:06:41.595259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594762+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:06:41.594762+0000","last_peered":"2023-11-18T19:06:41.594762+0000","last_clean":"2023-11-18T19:06:41.594762+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:06:41.594762+0000","last_undegraded":"2023-11-18T19:06:41.594762+0000","last_fullsized":"2023-11-18T19:06:41.594762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559367+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:06:43.559367+0000","last_peered":"2023-11-18T19:06:43.559367+0000","last_clean":"2023-11-18T19:06:43.559367+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:06:43.559367+0000","last_undegraded":"2023-11-18T19:06:43.559367+0000","last_fullsized":"2023-11-18T19:06:43.559367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595732+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:06:41.595732+0000","last_peered":"2023-11-18T19:06:41.595732+0000","last_clean":"2023-11-18T19:06:41.595732+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:06:41.595732+0000","last_undegraded":"2023-11-18T19:06:41.595732+0000","last_fullsized":"2023-11-18T19:06:41.595732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595986+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:06:41.595986+0000","last_peered":"2023-11-18T19:06:41.595986+0000","last_clean":"2023-11-18T19:06:41.595986+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:06:41.595986+0000","last_undegraded":"2023-11-18T19:06:41.595986+0000","last_fullsized":"2023-11-18T19:06:41.595986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606153+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:06:42.606153+0000","last_peered":"2023-11-18T19:06:42.606153+0000","last_clean":"2023-11-18T19:06:42.606153+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:06:42.606153+0000","last_undegraded":"2023-11-18T19:06:42.606153+0000","last_fullsized":"2023-11-18T19:06:42.606153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587914+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:06:41.587914+0000","last_peered":"2023-11-18T19:06:41.587914+0000","last_clean":"2023-11-18T19:06:41.587914+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:06:41.587914+0000","last_undegraded":"2023-11-18T19:06:41.587914+0000","last_fullsized":"2023-11-18T19:06:41.587914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591833+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:06:41.591833+0000","last_peered":"2023-11-18T19:06:41.591833+0000","last_clean":"2023-11-18T19:06:41.591833+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:06:41.591833+0000","last_undegraded":"2023-11-18T19:06:41.591833+0000","last_fullsized":"2023-11-18T19:06:41.591833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606957+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:06:42.606957+0000","last_peered":"2023-11-18T19:06:42.606957+0000","last_clean":"2023-11-18T19:06:42.606957+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:06:42.606957+0000","last_undegraded":"2023-11-18T19:06:42.606957+0000","last_fullsized":"2023-11-18T19:06:42.606957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588640+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:06:41.588640+0000","last_peered":"2023-11-18T19:06:41.588640+0000","last_clean":"2023-11-18T19:06:41.588640+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:06:41.588640+0000","last_undegraded":"2023-11-18T19:06:41.588640+0000","last_fullsized":"2023-11-18T19:06:41.588640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574155+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:06:41.574155+0000","last_peered":"2023-11-18T19:06:41.574155+0000","last_clean":"2023-11-18T19:06:41.574155+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:06:41.574155+0000","last_undegraded":"2023-11-18T19:06:41.574155+0000","last_fullsized":"2023-11-18T19:06:41.574155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606417+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:06:42.606417+0000","last_peered":"2023-11-18T19:06:42.606417+0000","last_clean":"2023-11-18T19:06:42.606417+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:06:42.606417+0000","last_undegraded":"2023-11-18T19:06:42.606417+0000","last_fullsized":"2023-11-18T19:06:42.606417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572339+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:06:41.572339+0000","last_peered":"2023-11-18T19:06:41.572339+0000","last_clean":"2023-11-18T19:06:41.572339+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:06:41.572339+0000","last_undegraded":"2023-11-18T19:06:41.572339+0000","last_fullsized":"2023-11-18T19:06:41.572339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574750+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:06:41.574750+0000","last_peered":"2023-11-18T19:06:41.574750+0000","last_clean":"2023-11-18T19:06:41.574750+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:06:41.574750+0000","last_undegraded":"2023-11-18T19:06:41.574750+0000","last_fullsized":"2023-11-18T19:06:41.574750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718092+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:06:42.718092+0000","last_peered":"2023-11-18T19:06:42.718092+0000","last_clean":"2023-11-18T19:06:42.718092+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:06:42.718092+0000","last_undegraded":"2023-11-18T19:06:42.718092+0000","last_fullsized":"2023-11-18T19:06:42.718092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606456+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:06:41.606456+0000","last_peered":"2023-11-18T19:06:41.606456+0000","last_clean":"2023-11-18T19:06:41.606456+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:06:41.606456+0000","last_undegraded":"2023-11-18T19:06:41.606456+0000","last_fullsized":"2023-11-18T19:06:41.606456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579797+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:06:41.579797+0000","last_peered":"2023-11-18T19:06:41.579797+0000","last_clean":"2023-11-18T19:06:41.579797+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:06:41.579797+0000","last_undegraded":"2023-11-18T19:06:41.579797+0000","last_fullsized":"2023-11-18T19:06:41.579797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558472+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:06:43.558472+0000","last_peered":"2023-11-18T19:06:43.558472+0000","last_clean":"2023-11-18T19:06:43.558472+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:06:43.558472+0000","last_undegraded":"2023-11-18T19:06:43.558472+0000","last_fullsized":"2023-11-18T19:06:43.558472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592221+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:06:41.592221+0000","last_peered":"2023-11-18T19:06:41.592221+0000","last_clean":"2023-11-18T19:06:41.592221+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:06:41.592221+0000","last_undegraded":"2023-11-18T19:06:41.592221+0000","last_fullsized":"2023-11-18T19:06:41.592221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594052+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:06:41.594052+0000","last_peered":"2023-11-18T19:06:41.594052+0000","last_clean":"2023-11-18T19:06:41.594052+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:06:41.594052+0000","last_undegraded":"2023-11-18T19:06:41.594052+0000","last_fullsized":"2023-11-18T19:06:41.594052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562033+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:06:43.562033+0000","last_peered":"2023-11-18T19:06:43.562033+0000","last_clean":"2023-11-18T19:06:43.562033+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:06:43.562033+0000","last_undegraded":"2023-11-18T19:06:43.562033+0000","last_fullsized":"2023-11-18T19:06:43.562033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571771+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:06:41.571771+0000","last_peered":"2023-11-18T19:06:41.571771+0000","last_clean":"2023-11-18T19:06:41.571771+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:06:41.571771+0000","last_undegraded":"2023-11-18T19:06:41.571771+0000","last_fullsized":"2023-11-18T19:06:41.571771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580390+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:06:41.580390+0000","last_peered":"2023-11-18T19:06:41.580390+0000","last_clean":"2023-11-18T19:06:41.580390+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:06:41.580390+0000","last_undegraded":"2023-11-18T19:06:41.580390+0000","last_fullsized":"2023-11-18T19:06:41.580390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608335+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:06:42.608335+0000","last_peered":"2023-11-18T19:06:42.608335+0000","last_clean":"2023-11-18T19:06:42.608335+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:06:42.608335+0000","last_undegraded":"2023-11-18T19:06:42.608335+0000","last_fullsized":"2023-11-18T19:06:42.608335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594176+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:06:41.594176+0000","last_peered":"2023-11-18T19:06:41.594176+0000","last_clean":"2023-11-18T19:06:41.594176+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:06:41.594176+0000","last_undegraded":"2023-11-18T19:06:41.594176+0000","last_fullsized":"2023-11-18T19:06:41.594176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575911+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:06:41.575911+0000","last_peered":"2023-11-18T19:06:41.575911+0000","last_clean":"2023-11-18T19:06:41.575911+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:06:41.575911+0000","last_undegraded":"2023-11-18T19:06:41.575911+0000","last_fullsized":"2023-11-18T19:06:41.575911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606274+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:06:42.606274+0000","last_peered":"2023-11-18T19:06:42.606274+0000","last_clean":"2023-11-18T19:06:42.606274+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:06:42.606274+0000","last_undegraded":"2023-11-18T19:06:42.606274+0000","last_fullsized":"2023-11-18T19:06:42.606274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595159+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:06:41.595159+0000","last_peered":"2023-11-18T19:06:41.595159+0000","last_clean":"2023-11-18T19:06:41.595159+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:06:41.595159+0000","last_undegraded":"2023-11-18T19:06:41.595159+0000","last_fullsized":"2023-11-18T19:06:41.595159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594379+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:06:41.594379+0000","last_peered":"2023-11-18T19:06:41.594379+0000","last_clean":"2023-11-18T19:06:41.594379+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:06:41.594379+0000","last_undegraded":"2023-11-18T19:06:41.594379+0000","last_fullsized":"2023-11-18T19:06:41.594379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608512+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:06:42.608512+0000","last_peered":"2023-11-18T19:06:42.608512+0000","last_clean":"2023-11-18T19:06:42.608512+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:06:42.608512+0000","last_undegraded":"2023-11-18T19:06:42.608512+0000","last_fullsized":"2023-11-18T19:06:42.608512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584700+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:06:41.584700+0000","last_peered":"2023-11-18T19:06:41.584700+0000","last_clean":"2023-11-18T19:06:41.584700+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:06:41.584700+0000","last_undegraded":"2023-11-18T19:06:41.584700+0000","last_fullsized":"2023-11-18T19:06:41.584700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574502+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:06:41.574502+0000","last_peered":"2023-11-18T19:06:41.574502+0000","last_clean":"2023-11-18T19:06:41.574502+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:06:41.574502+0000","last_undegraded":"2023-11-18T19:06:41.574502+0000","last_fullsized":"2023-11-18T19:06:41.574502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609207+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:06:42.609207+0000","last_peered":"2023-11-18T19:06:42.609207+0000","last_clean":"2023-11-18T19:06:42.609207+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:06:42.609207+0000","last_undegraded":"2023-11-18T19:06:42.609207+0000","last_fullsized":"2023-11-18T19:06:42.609207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584886+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:06:41.584886+0000","last_peered":"2023-11-18T19:06:41.584886+0000","last_clean":"2023-11-18T19:06:41.584886+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:06:41.584886+0000","last_undegraded":"2023-11-18T19:06:41.584886+0000","last_fullsized":"2023-11-18T19:06:41.584886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580430+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:06:41.580430+0000","last_peered":"2023-11-18T19:06:41.580430+0000","last_clean":"2023-11-18T19:06:41.580430+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:06:41.580430+0000","last_undegraded":"2023-11-18T19:06:41.580430+0000","last_fullsized":"2023-11-18T19:06:41.580430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611054+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:06:42.611054+0000","last_peered":"2023-11-18T19:06:42.611054+0000","last_clean":"2023-11-18T19:06:42.611054+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:06:42.611054+0000","last_undegraded":"2023-11-18T19:06:42.611054+0000","last_fullsized":"2023-11-18T19:06:42.611054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579918+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:06:41.579918+0000","last_peered":"2023-11-18T19:06:41.579918+0000","last_clean":"2023-11-18T19:06:41.579918+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:06:41.579918+0000","last_undegraded":"2023-11-18T19:06:41.579918+0000","last_fullsized":"2023-11-18T19:06:41.579918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575468+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:06:41.575468+0000","last_peered":"2023-11-18T19:06:41.575468+0000","last_clean":"2023-11-18T19:06:41.575468+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:06:41.575468+0000","last_undegraded":"2023-11-18T19:06:41.575468+0000","last_fullsized":"2023-11-18T19:06:41.575468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610460+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:06:42.610460+0000","last_peered":"2023-11-18T19:06:42.610460+0000","last_clean":"2023-11-18T19:06:42.610460+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:06:42.610460+0000","last_undegraded":"2023-11-18T19:06:42.610460+0000","last_fullsized":"2023-11-18T19:06:42.610460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579649+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:06:41.579649+0000","last_peered":"2023-11-18T19:06:41.579649+0000","last_clean":"2023-11-18T19:06:41.579649+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:06:41.579649+0000","last_undegraded":"2023-11-18T19:06:41.579649+0000","last_fullsized":"2023-11-18T19:06:41.579649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604625+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:06:41.604625+0000","last_peered":"2023-11-18T19:06:41.604625+0000","last_clean":"2023-11-18T19:06:41.604625+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:06:41.604625+0000","last_undegraded":"2023-11-18T19:06:41.604625+0000","last_fullsized":"2023-11-18T19:06:41.604625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.613259+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:06:42.613259+0000","last_peered":"2023-11-18T19:06:42.613259+0000","last_clean":"2023-11-18T19:06:42.613259+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:06:42.613259+0000","last_undegraded":"2023-11-18T19:06:42.613259+0000","last_fullsized":"2023-11-18T19:06:42.613259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582674+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:06:41.582674+0000","last_peered":"2023-11-18T19:06:41.582674+0000","last_clean":"2023-11-18T19:06:41.582674+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:06:41.582674+0000","last_undegraded":"2023-11-18T19:06:41.582674+0000","last_fullsized":"2023-11-18T19:06:41.582674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573262+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:06:41.573262+0000","last_peered":"2023-11-18T19:06:41.573262+0000","last_clean":"2023-11-18T19:06:41.573262+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:06:41.573262+0000","last_undegraded":"2023-11-18T19:06:41.573262+0000","last_fullsized":"2023-11-18T19:06:41.573262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561489+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:06:43.561489+0000","last_peered":"2023-11-18T19:06:43.561489+0000","last_clean":"2023-11-18T19:06:43.561489+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:06:43.561489+0000","last_undegraded":"2023-11-18T19:06:43.561489+0000","last_fullsized":"2023-11-18T19:06:43.561489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587345+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:06:41.587345+0000","last_peered":"2023-11-18T19:06:41.587345+0000","last_clean":"2023-11-18T19:06:41.587345+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:06:41.587345+0000","last_undegraded":"2023-11-18T19:06:41.587345+0000","last_fullsized":"2023-11-18T19:06:41.587345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574458+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:06:41.574458+0000","last_peered":"2023-11-18T19:06:41.574458+0000","last_clean":"2023-11-18T19:06:41.574458+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:06:41.574458+0000","last_undegraded":"2023-11-18T19:06:41.574458+0000","last_fullsized":"2023-11-18T19:06:41.574458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590707+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:06:41.590707+0000","last_peered":"2023-11-18T19:06:41.590707+0000","last_clean":"2023-11-18T19:06:41.590707+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:06:41.590707+0000","last_undegraded":"2023-11-18T19:06:41.590707+0000","last_fullsized":"2023-11-18T19:06:41.590707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:24:48.318265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718474+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:06:42.718474+0000","last_peered":"2023-11-18T19:06:42.718474+0000","last_clean":"2023-11-18T19:06:42.718474+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:06:42.718474+0000","last_undegraded":"2023-11-18T19:06:42.718474+0000","last_fullsized":"2023-11-18T19:06:42.718474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574260+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:06:41.574260+0000","last_peered":"2023-11-18T19:06:41.574260+0000","last_clean":"2023-11-18T19:06:41.574260+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:06:41.574260+0000","last_undegraded":"2023-11-18T19:06:41.574260+0000","last_fullsized":"2023-11-18T19:06:41.574260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584878+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:06:41.584878+0000","last_peered":"2023-11-18T19:06:41.584878+0000","last_clean":"2023-11-18T19:06:41.584878+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:06:41.584878+0000","last_undegraded":"2023-11-18T19:06:41.584878+0000","last_fullsized":"2023-11-18T19:06:41.584878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606686+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:06:42.606686+0000","last_peered":"2023-11-18T19:06:42.606686+0000","last_clean":"2023-11-18T19:06:42.606686+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:06:42.606686+0000","last_undegraded":"2023-11-18T19:06:42.606686+0000","last_fullsized":"2023-11-18T19:06:42.606686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589667+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:06:41.589667+0000","last_peered":"2023-11-18T19:06:41.589667+0000","last_clean":"2023-11-18T19:06:41.589667+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:06:41.589667+0000","last_undegraded":"2023-11-18T19:06:41.589667+0000","last_fullsized":"2023-11-18T19:06:41.589667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591151+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:06:41.591151+0000","last_peered":"2023-11-18T19:06:41.591151+0000","last_clean":"2023-11-18T19:06:41.591151+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:06:41.591151+0000","last_undegraded":"2023-11-18T19:06:41.591151+0000","last_fullsized":"2023-11-18T19:06:41.591151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.560394+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:06:43.560394+0000","last_peered":"2023-11-18T19:06:43.560394+0000","last_clean":"2023-11-18T19:06:43.560394+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:06:43.560394+0000","last_undegraded":"2023-11-18T19:06:43.560394+0000","last_fullsized":"2023-11-18T19:06:43.560394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588173+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:06:41.588173+0000","last_peered":"2023-11-18T19:06:41.588173+0000","last_clean":"2023-11-18T19:06:41.588173+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:06:41.588173+0000","last_undegraded":"2023-11-18T19:06:41.588173+0000","last_fullsized":"2023-11-18T19:06:41.588173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594281+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:06:41.594281+0000","last_peered":"2023-11-18T19:06:41.594281+0000","last_clean":"2023-11-18T19:06:41.594281+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:06:41.594281+0000","last_undegraded":"2023-11-18T19:06:41.594281+0000","last_fullsized":"2023-11-18T19:06:41.594281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.717717+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:06:42.717717+0000","last_peered":"2023-11-18T19:06:42.717717+0000","last_clean":"2023-11-18T19:06:42.717717+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:06:42.717717+0000","last_undegraded":"2023-11-18T19:06:42.717717+0000","last_fullsized":"2023-11-18T19:06:42.717717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584417+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:06:41.584417+0000","last_peered":"2023-11-18T19:06:41.584417+0000","last_clean":"2023-11-18T19:06:41.584417+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:06:41.584417+0000","last_undegraded":"2023-11-18T19:06:41.584417+0000","last_fullsized":"2023-11-18T19:06:41.584417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588264+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:06:41.588264+0000","last_peered":"2023-11-18T19:06:41.588264+0000","last_clean":"2023-11-18T19:06:41.588264+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:06:41.588264+0000","last_undegraded":"2023-11-18T19:06:41.588264+0000","last_fullsized":"2023-11-18T19:06:41.588264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558034+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:06:43.558034+0000","last_peered":"2023-11-18T19:06:43.558034+0000","last_clean":"2023-11-18T19:06:43.558034+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:06:43.558034+0000","last_undegraded":"2023-11-18T19:06:43.558034+0000","last_fullsized":"2023-11-18T19:06:43.558034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:03.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571644+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:06:41.571644+0000","last_peered":"2023-11-18T19:06:41.571644+0000","last_clean":"2023-11-18T19:06:41.571644+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:06:41.571644+0000","last_undegraded":"2023-11-18T19:06:41.571644+0000","last_fullsized":"2023-11-18T19:06:41.571644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592325+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:06:41.592325+0000","last_peered":"2023-11-18T19:06:41.592325+0000","last_clean":"2023-11-18T19:06:41.592325+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:06:41.592325+0000","last_undegraded":"2023-11-18T19:06:41.592325+0000","last_fullsized":"2023-11-18T19:06:41.592325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562218+0000","last_change":"2023-11-18T19:06:41.614438+0000","last_active":"2023-11-18T19:06:43.562218+0000","last_peered":"2023-11-18T19:06:43.562218+0000","last_clean":"2023-11-18T19:06:43.562218+0000","last_became_active":"2023-11-18T19:06:41.613140+0000","last_became_peered":"2023-11-18T19:06:41.613140+0000","last_unstale":"2023-11-18T19:06:43.562218+0000","last_undegraded":"2023-11-18T19:06:43.562218+0000","last_fullsized":"2023-11-18T19:06:43.562218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:25.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590560+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:06:41.590560+0000","last_peered":"2023-11-18T19:06:41.590560+0000","last_clean":"2023-11-18T19:06:41.590560+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:06:41.590560+0000","last_undegraded":"2023-11-18T19:06:41.590560+0000","last_fullsized":"2023-11-18T19:06:41.590560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581506+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:06:41.581506+0000","last_peered":"2023-11-18T19:06:41.581506+0000","last_clean":"2023-11-18T19:06:41.581506+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:06:41.581506+0000","last_undegraded":"2023-11-18T19:06:41.581506+0000","last_fullsized":"2023-11-18T19:06:41.581506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561030+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:06:43.561030+0000","last_peered":"2023-11-18T19:06:43.561030+0000","last_clean":"2023-11-18T19:06:43.561030+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:06:43.561030+0000","last_undegraded":"2023-11-18T19:06:43.561030+0000","last_fullsized":"2023-11-18T19:06:43.561030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572710+0000","last_change":"2023-11-18T19:06:37.579602+0000","last_active":"2023-11-18T19:06:41.572710+0000","last_peered":"2023-11-18T19:06:41.572710+0000","last_clean":"2023-11-18T19:06:41.572710+0000","last_became_active":"2023-11-18T19:06:37.579178+0000","last_became_peered":"2023-11-18T19:06:37.579178+0000","last_unstale":"2023-11-18T19:06:41.572710+0000","last_undegraded":"2023-11-18T19:06:41.572710+0000","last_fullsized":"2023-11-18T19:06:41.572710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:15.325066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572917+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:06:41.572917+0000","last_peered":"2023-11-18T19:06:41.572917+0000","last_clean":"2023-11-18T19:06:41.572917+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:06:41.572917+0000","last_undegraded":"2023-11-18T19:06:41.572917+0000","last_fullsized":"2023-11-18T19:06:41.572917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610033+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:06:42.610033+0000","last_peered":"2023-11-18T19:06:42.610033+0000","last_clean":"2023-11-18T19:06:42.610033+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:06:42.610033+0000","last_undegraded":"2023-11-18T19:06:42.610033+0000","last_fullsized":"2023-11-18T19:06:42.610033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579551+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:06:41.579551+0000","last_peered":"2023-11-18T19:06:41.579551+0000","last_clean":"2023-11-18T19:06:41.579551+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:06:41.579551+0000","last_undegraded":"2023-11-18T19:06:41.579551+0000","last_fullsized":"2023-11-18T19:06:41.579551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.607281+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:06:41.607281+0000","last_peered":"2023-11-18T19:06:41.607281+0000","last_clean":"2023-11-18T19:06:41.607281+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:06:41.607281+0000","last_undegraded":"2023-11-18T19:06:41.607281+0000","last_fullsized":"2023-11-18T19:06:41.607281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718925+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:06:42.718925+0000","last_peered":"2023-11-18T19:06:42.718925+0000","last_clean":"2023-11-18T19:06:42.718925+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:06:42.718925+0000","last_undegraded":"2023-11-18T19:06:42.718925+0000","last_fullsized":"2023-11-18T19:06:42.718925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587790+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:06:41.587790+0000","last_peered":"2023-11-18T19:06:41.587790+0000","last_clean":"2023-11-18T19:06:41.587790+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:06:41.587790+0000","last_undegraded":"2023-11-18T19:06:41.587790+0000","last_fullsized":"2023-11-18T19:06:41.587790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:57.618128+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:06:57.618128+0000","last_peered":"2023-11-18T19:06:57.618128+0000","last_clean":"2023-11-18T19:06:57.618128+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:06:57.618128+0000","last_undegraded":"2023-11-18T19:06:57.618128+0000","last_fullsized":"2023-11-18T19:06:57.618128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611068+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:06:42.611068+0000","last_peered":"2023-11-18T19:06:42.611068+0000","last_clean":"2023-11-18T19:06:42.611068+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:06:42.611068+0000","last_undegraded":"2023-11-18T19:06:42.611068+0000","last_fullsized":"2023-11-18T19:06:42.611068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.576702+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:06:41.576702+0000","last_peered":"2023-11-18T19:06:41.576702+0000","last_clean":"2023-11-18T19:06:41.576702+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:06:41.576702+0000","last_undegraded":"2023-11-18T19:06:41.576702+0000","last_fullsized":"2023-11-18T19:06:41.576702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606192+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:06:41.606192+0000","last_peered":"2023-11-18T19:06:41.606192+0000","last_clean":"2023-11-18T19:06:41.606192+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:06:41.606192+0000","last_undegraded":"2023-11-18T19:06:41.606192+0000","last_fullsized":"2023-11-18T19:06:41.606192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.607397+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:06:42.607397+0000","last_peered":"2023-11-18T19:06:42.607397+0000","last_clean":"2023-11-18T19:06:42.607397+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:06:42.607397+0000","last_undegraded":"2023-11-18T19:06:42.607397+0000","last_fullsized":"2023-11-18T19:06:42.607397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.596028+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:06:41.596028+0000","last_peered":"2023-11-18T19:06:41.596028+0000","last_clean":"2023-11-18T19:06:41.596028+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:06:41.596028+0000","last_undegraded":"2023-11-18T19:06:41.596028+0000","last_fullsized":"2023-11-18T19:06:41.596028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587870+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:06:41.587870+0000","last_peered":"2023-11-18T19:06:41.587870+0000","last_clean":"2023-11-18T19:06:41.587870+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:06:41.587870+0000","last_undegraded":"2023-11-18T19:06:41.587870+0000","last_fullsized":"2023-11-18T19:06:41.587870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559235+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:06:43.559235+0000","last_peered":"2023-11-18T19:06:43.559235+0000","last_clean":"2023-11-18T19:06:43.559235+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:06:43.559235+0000","last_undegraded":"2023-11-18T19:06:43.559235+0000","last_fullsized":"2023-11-18T19:06:43.559235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584320+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:06:41.584320+0000","last_peered":"2023-11-18T19:06:41.584320+0000","last_clean":"2023-11-18T19:06:41.584320+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:06:41.584320+0000","last_undegraded":"2023-11-18T19:06:41.584320+0000","last_fullsized":"2023-11-18T19:06:41.584320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592273+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:06:41.592273+0000","last_peered":"2023-11-18T19:06:41.592273+0000","last_clean":"2023-11-18T19:06:41.592273+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:06:41.592273+0000","last_undegraded":"2023-11-18T19:06:41.592273+0000","last_fullsized":"2023-11-18T19:06:41.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:08.678189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609111+0000","last_change":"2023-11-18T19:06:41.622287+0000","last_active":"2023-11-18T19:06:42.609111+0000","last_peered":"2023-11-18T19:06:42.609111+0000","last_clean":"2023-11-18T19:06:42.609111+0000","last_became_active":"2023-11-18T19:06:41.618340+0000","last_became_peered":"2023-11-18T19:06:41.618340+0000","last_unstale":"2023-11-18T19:06:42.609111+0000","last_undegraded":"2023-11-18T19:06:42.609111+0000","last_fullsized":"2023-11-18T19:06:42.609111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.614055+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:06:42.614055+0000","last_peered":"2023-11-18T19:06:42.614055+0000","last_clean":"2023-11-18T19:06:42.614055+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:06:42.614055+0000","last_undegraded":"2023-11-18T19:06:42.614055+0000","last_fullsized":"2023-11-18T19:06:42.614055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590846+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:06:41.590846+0000","last_peered":"2023-11-18T19:06:41.590846+0000","last_clean":"2023-11-18T19:06:41.590846+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:06:41.590846+0000","last_undegraded":"2023-11-18T19:06:41.590846+0000","last_fullsized":"2023-11-18T19:06:41.590846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573178+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:06:41.573178+0000","last_peered":"2023-11-18T19:06:41.573178+0000","last_clean":"2023-11-18T19:06:41.573178+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:06:41.573178+0000","last_undegraded":"2023-11-18T19:06:41.573178+0000","last_fullsized":"2023-11-18T19:06:41.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718948+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:06:42.718948+0000","last_peered":"2023-11-18T19:06:42.718948+0000","last_clean":"2023-11-18T19:06:42.718948+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:06:42.718948+0000","last_undegraded":"2023-11-18T19:06:42.718948+0000","last_fullsized":"2023-11-18T19:06:42.718948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579857+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:06:41.579857+0000","last_peered":"2023-11-18T19:06:41.579857+0000","last_clean":"2023-11-18T19:06:41.579857+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:06:41.579857+0000","last_undegraded":"2023-11-18T19:06:41.579857+0000","last_fullsized":"2023-11-18T19:06:41.579857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582912+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:06:41.582912+0000","last_peered":"2023-11-18T19:06:41.582912+0000","last_clean":"2023-11-18T19:06:41.582912+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:06:41.582912+0000","last_undegraded":"2023-11-18T19:06:41.582912+0000","last_fullsized":"2023-11-18T19:06:41.582912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572727+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:06:41.572727+0000","last_peered":"2023-11-18T19:06:41.572727+0000","last_clean":"2023-11-18T19:06:41.572727+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:06:41.572727+0000","last_undegraded":"2023-11-18T19:06:41.572727+0000","last_fullsized":"2023-11-18T19:06:41.572727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591508+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:06:41.591508+0000","last_peered":"2023-11-18T19:06:41.591508+0000","last_clean":"2023-11-18T19:06:41.591508+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:06:41.591508+0000","last_undegraded":"2023-11-18T19:06:41.591508+0000","last_fullsized":"2023-11-18T19:06:41.591508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611823+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:06:42.611823+0000","last_peered":"2023-11-18T19:06:42.611823+0000","last_clean":"2023-11-18T19:06:42.611823+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:06:42.611823+0000","last_undegraded":"2023-11-18T19:06:42.611823+0000","last_fullsized":"2023-11-18T19:06:42.611823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584083+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:06:41.584083+0000","last_peered":"2023-11-18T19:06:41.584083+0000","last_clean":"2023-11-18T19:06:41.584083+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:06:41.584083+0000","last_undegraded":"2023-11-18T19:06:41.584083+0000","last_fullsized":"2023-11-18T19:06:41.584083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589767+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:06:41.589767+0000","last_peered":"2023-11-18T19:06:41.589767+0000","last_clean":"2023-11-18T19:06:41.589767+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:06:41.589767+0000","last_undegraded":"2023-11-18T19:06:41.589767+0000","last_fullsized":"2023-11-18T19:06:41.589767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561860+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:06:43.561860+0000","last_peered":"2023-11-18T19:06:43.561860+0000","last_clean":"2023-11-18T19:06:43.561860+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:06:43.561860+0000","last_undegraded":"2023-11-18T19:06:43.561860+0000","last_fullsized":"2023-11-18T19:06:43.561860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582668+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:06:41.582668+0000","last_peered":"2023-11-18T19:06:41.582668+0000","last_clean":"2023-11-18T19:06:41.582668+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:06:41.582668+0000","last_undegraded":"2023-11-18T19:06:41.582668+0000","last_fullsized":"2023-11-18T19:06:41.582668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604540+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:06:41.604540+0000","last_peered":"2023-11-18T19:06:41.604540+0000","last_clean":"2023-11-18T19:06:41.604540+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:06:41.604540+0000","last_undegraded":"2023-11-18T19:06:41.604540+0000","last_fullsized":"2023-11-18T19:06:41.604540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571628+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:06:41.571628+0000","last_peered":"2023-11-18T19:06:41.571628+0000","last_clean":"2023-11-18T19:06:41.571628+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:06:41.571628+0000","last_undegraded":"2023-11-18T19:06:41.571628+0000","last_fullsized":"2023-11-18T19:06:41.571628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.583899+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:06:41.583899+0000","last_peered":"2023-11-18T19:06:41.583899+0000","last_clean":"2023-11-18T19:06:41.583899+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:06:41.583899+0000","last_undegraded":"2023-11-18T19:06:41.583899+0000","last_fullsized":"2023-11-18T19:06:41.583899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584150+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:06:41.584150+0000","last_peered":"2023-11-18T19:06:41.584150+0000","last_clean":"2023-11-18T19:06:41.584150+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:06:41.584150+0000","last_undegraded":"2023-11-18T19:06:41.584150+0000","last_fullsized":"2023-11-18T19:06:41.584150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580014+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:06:41.580014+0000","last_peered":"2023-11-18T19:06:41.580014+0000","last_clean":"2023-11-18T19:06:41.580014+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:06:41.580014+0000","last_undegraded":"2023-11-18T19:06:41.580014+0000","last_fullsized":"2023-11-18T19:06:41.580014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584222+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:06:41.584222+0000","last_peered":"2023-11-18T19:06:41.584222+0000","last_clean":"2023-11-18T19:06:41.584222+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:06:41.584222+0000","last_undegraded":"2023-11-18T19:06:41.584222+0000","last_fullsized":"2023-11-18T19:06:41.584222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595920+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:06:41.595920+0000","last_peered":"2023-11-18T19:06:41.595920+0000","last_clean":"2023-11-18T19:06:41.595920+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:06:41.595920+0000","last_undegraded":"2023-11-18T19:06:41.595920+0000","last_fullsized":"2023-11-18T19:06:41.595920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572929+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:06:41.572929+0000","last_peered":"2023-11-18T19:06:41.572929+0000","last_clean":"2023-11-18T19:06:41.572929+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:06:41.572929+0000","last_undegraded":"2023-11-18T19:06:41.572929+0000","last_fullsized":"2023-11-18T19:06:41.572929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580481+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:06:41.580481+0000","last_peered":"2023-11-18T19:06:41.580481+0000","last_clean":"2023-11-18T19:06:41.580481+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:06:41.580481+0000","last_undegraded":"2023-11-18T19:06:41.580481+0000","last_fullsized":"2023-11-18T19:06:41.580481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589699+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:06:41.589699+0000","last_peered":"2023-11-18T19:06:41.589699+0000","last_clean":"2023-11-18T19:06:41.589699+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:06:41.589699+0000","last_undegraded":"2023-11-18T19:06:41.589699+0000","last_fullsized":"2023-11-18T19:06:41.589699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591289+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:06:41.591289+0000","last_peered":"2023-11-18T19:06:41.591289+0000","last_clean":"2023-11-18T19:06:41.591289+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:06:41.591289+0000","last_undegraded":"2023-11-18T19:06:41.591289+0000","last_fullsized":"2023-11-18T19:06:41.591289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588400+0000","last_change":"2023-11-18T19:06:37.568642+0000","last_active":"2023-11-18T19:06:41.588400+0000","last_peered":"2023-11-18T19:06:41.588400+0000","last_clean":"2023-11-18T19:06:41.588400+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:06:41.588400+0000","last_undegraded":"2023-11-18T19:06:41.588400+0000","last_fullsized":"2023-11-18T19:06:41.588400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574387+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:06:41.574387+0000","last_peered":"2023-11-18T19:06:41.574387+0000","last_clean":"2023-11-18T19:06:41.574387+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:06:41.574387+0000","last_undegraded":"2023-11-18T19:06:41.574387+0000","last_fullsized":"2023-11-18T19:06:41.574387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606645+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:06:41.606645+0000","last_peered":"2023-11-18T19:06:41.606645+0000","last_clean":"2023-11-18T19:06:41.606645+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:06:41.606645+0000","last_undegraded":"2023-11-18T19:06:41.606645+0000","last_fullsized":"2023-11-18T19:06:41.606645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575789+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:06:41.575789+0000","last_peered":"2023-11-18T19:06:41.575789+0000","last_clean":"2023-11-18T19:06:41.575789+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:06:41.575789+0000","last_undegraded":"2023-11-18T19:06:41.575789+0000","last_fullsized":"2023-11-18T19:06:41.575789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572996+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:06:41.572996+0000","last_peered":"2023-11-18T19:06:41.572996+0000","last_clean":"2023-11-18T19:06:41.572996+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:06:41.572996+0000","last_undegraded":"2023-11-18T19:06:41.572996+0000","last_fullsized":"2023-11-18T19:06:41.572996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580120+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:06:41.580120+0000","last_peered":"2023-11-18T19:06:41.580120+0000","last_clean":"2023-11-18T19:06:41.580120+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:06:41.580120+0000","last_undegraded":"2023-11-18T19:06:41.580120+0000","last_fullsized":"2023-11-18T19:06:41.580120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579307+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:06:41.579307+0000","last_peered":"2023-11-18T19:06:41.579307+0000","last_clean":"2023-11-18T19:06:41.579307+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:06:41.579307+0000","last_undegraded":"2023-11-18T19:06:41.579307+0000","last_fullsized":"2023-11-18T19:06:41.579307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580691+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:06:41.580691+0000","last_peered":"2023-11-18T19:06:41.580691+0000","last_clean":"2023-11-18T19:06:41.580691+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:06:41.580691+0000","last_undegraded":"2023-11-18T19:06:41.580691+0000","last_fullsized":"2023-11-18T19:06:41.580691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588307+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:06:41.588307+0000","last_peered":"2023-11-18T19:06:41.588307+0000","last_clean":"2023-11-18T19:06:41.588307+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:06:41.588307+0000","last_undegraded":"2023-11-18T19:06:41.588307+0000","last_fullsized":"2023-11-18T19:06:41.588307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587696+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:06:41.587696+0000","last_peered":"2023-11-18T19:06:41.587696+0000","last_clean":"2023-11-18T19:06:41.587696+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:06:41.587696+0000","last_undegraded":"2023-11-18T19:06:41.587696+0000","last_fullsized":"2023-11-18T19:06:41.587696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587712+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:06:41.587712+0000","last_peered":"2023-11-18T19:06:41.587712+0000","last_clean":"2023-11-18T19:06:41.587712+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:06:41.587712+0000","last_undegraded":"2023-11-18T19:06:41.587712+0000","last_fullsized":"2023-11-18T19:06:41.587712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592211+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:06:41.592211+0000","last_peered":"2023-11-18T19:06:41.592211+0000","last_clean":"2023-11-18T19:06:41.592211+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:06:41.592211+0000","last_undegraded":"2023-11-18T19:06:41.592211+0000","last_fullsized":"2023-11-18T19:06:41.592211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579563+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:06:41.579563+0000","last_peered":"2023-11-18T19:06:41.579563+0000","last_clean":"2023-11-18T19:06:41.579563+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:06:41.579563+0000","last_undegraded":"2023-11-18T19:06:41.579563+0000","last_fullsized":"2023-11-18T19:06:41.579563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581411+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:06:41.581411+0000","last_peered":"2023-11-18T19:06:41.581411+0000","last_clean":"2023-11-18T19:06:41.581411+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:06:41.581411+0000","last_undegraded":"2023-11-18T19:06:41.581411+0000","last_fullsized":"2023-11-18T19:06:41.581411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584038+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:06:41.584038+0000","last_peered":"2023-11-18T19:06:41.584038+0000","last_clean":"2023-11-18T19:06:41.584038+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:06:41.584038+0000","last_undegraded":"2023-11-18T19:06:41.584038+0000","last_fullsized":"2023-11-18T19:06:41.584038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580068+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:06:41.580068+0000","last_peered":"2023-11-18T19:06:41.580068+0000","last_clean":"2023-11-18T19:06:41.580068+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:06:41.580068+0000","last_undegraded":"2023-11-18T19:06:41.580068+0000","last_fullsized":"2023-11-18T19:06:41.580068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584628+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:06:41.584628+0000","last_peered":"2023-11-18T19:06:41.584628+0000","last_clean":"2023-11-18T19:06:41.584628+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:06:41.584628+0000","last_undegraded":"2023-11-18T19:06:41.584628+0000","last_fullsized":"2023-11-18T19:06:41.584628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591038+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:06:41.591038+0000","last_peered":"2023-11-18T19:06:41.591038+0000","last_clean":"2023-11-18T19:06:41.591038+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:06:41.591038+0000","last_undegraded":"2023-11-18T19:06:41.591038+0000","last_fullsized":"2023-11-18T19:06:41.591038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594622+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:06:41.594622+0000","last_peered":"2023-11-18T19:06:41.594622+0000","last_clean":"2023-11-18T19:06:41.594622+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:06:41.594622+0000","last_undegraded":"2023-11-18T19:06:41.594622+0000","last_fullsized":"2023-11-18T19:06:41.594622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588068+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:06:41.588068+0000","last_peered":"2023-11-18T19:06:41.588068+0000","last_clean":"2023-11-18T19:06:41.588068+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:06:41.588068+0000","last_undegraded":"2023-11-18T19:06:41.588068+0000","last_fullsized":"2023-11-18T19:06:41.588068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7609999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":700553,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":110675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.766}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":700531,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.792}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:07:02.536 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:07:02.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.790+0000 7f9ba23ac640 1 Processor -- start 2023-11-18T19:07:02.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.790+0000 7f9ba23ac640 1 -- start start 2023-11-18T19:07:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba23ac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c0722c0 0x7f9b9c0c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba23ac640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9b9c155890 0x7f9b9c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba23ac640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c0a5540 con 0x7f9b9c0c2fb0 2023-11-18T19:07:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba23ac640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9c156780 con 0x7f9b9c155890 2023-11-18T19:07:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba23ac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c06b9a0 con 0x7f9b9c0722c0 2023-11-18T19:07:02.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba1bab640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9b9c155890 0x7f9b9c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba0ba9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c0722c0 0x7f9b9c0c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba0ba9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c0722c0 0x7f9b9c0c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:46274/0 (socket says 172.21.15.45:46274) 2023-11-18T19:07:02.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.792+0000 7f9ba0ba9640 1 -- 172.21.15.45:0/3661895744 learned_addr learned my addr 172.21.15.45:0/3661895744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.793+0000 7f9ba1bab640 1 -- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c0722c0 msgr2=0x7f9b9c0c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.793+0000 7f9ba1bab640 1 --2- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c0722c0 0x7f9b9c0c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.793+0000 7f9ba1bab640 1 -- 172.21.15.45:0/3661895744 >> v1:172.21.15.135:6789/0 conn(0x7f9b9c0c2fb0 legacy=0x7f9b9c0a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.793+0000 7f9ba1bab640 1 -- 172.21.15.45:0/3661895744 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c06bc80 con 0x7f9b9c155890 2023-11-18T19:07:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.793+0000 7f9ba0ba9640 1 --2- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c0722c0 0x7f9b9c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.794+0000 7f9ba1bab640 1 --2- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c155890 0x7f9b9c155d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009d90 tx=0x7f9b9402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=793e2604d96d510e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:02.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9b93fff640 1 -- 172.21.15.45:0/3661895744 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9402cb30 con 0x7f9b9c155890 2023-11-18T19:07:02.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9b93fff640 1 -- 172.21.15.45:0/3661895744 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9402cc90 con 0x7f9b9c155890 2023-11-18T19:07:02.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9b93fff640 1 -- 172.21.15.45:0/3661895744 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94034440 con 0x7f9b9c155890 2023-11-18T19:07:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9ba23ac640 1 -- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c155890 msgr2=0x7f9b9c155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c155890 0x7f9b9c155d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009d90 tx=0x7f9b9402bd80 comp rx=0 tx=0).stop 2023-11-18T19:07:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9ba23ac640 1 -- 172.21.15.45:0/3661895744 shutdown_connections 2023-11-18T19:07:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c0722c0 0x7f9b9c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/3661895744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c155890 0x7f9b9c155d20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.795+0000 7f9ba23ac640 1 -- 172.21.15.45:0/3661895744 >> 172.21.15.45:0/3661895744 conn(0x7f9b9c0c5af0 msgr2=0x7f9b9c0c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.796+0000 7f9ba23ac640 1 -- 172.21.15.45:0/3661895744 shutdown_connections 2023-11-18T19:07:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.796+0000 7f9ba23ac640 1 -- 172.21.15.45:0/3661895744 wait complete. 2023-11-18T19:07:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.797+0000 7f9ba23ac640 1 Processor -- start 2023-11-18T19:07:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.797+0000 7f9ba23ac640 1 -- start start 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.798+0000 7f9ba23ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c0722c0 0x7f9b9c0bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.798+0000 7f9ba23ac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c0c2fb0 0x7f9b9c14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.798+0000 7f9ba23ac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c155890 0x7f9b9c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.798+0000 7f9ba23ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0a8270 con 0x7f9b9c0722c0 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.798+0000 7f9ba23ac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0a7660 con 0x7f9b9c0c2fb0 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.798+0000 7f9ba23ac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0a7940 con 0x7f9b9c155890 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.798+0000 7f9ba13aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c0722c0 0x7f9b9c0bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c0722c0 0x7f9b9c0bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44744/0 (socket says 172.21.15.45:44744) 2023-11-18T19:07:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 -- 172.21.15.45:0/2481763276 learned_addr learned my addr 172.21.15.45:0/2481763276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba0ba9640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c0c2fb0 0x7f9b9c14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 -- 172.21.15.45:0/2481763276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c155890 msgr2=0x7f9b9c148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c155890 0x7f9b9c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 -- 172.21.15.45:0/2481763276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c0c2fb0 msgr2=0x7f9b9c14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c0c2fb0 0x7f9b9c14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 -- 172.21.15.45:0/2481763276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c0094d0 con 0x7f9b9c0722c0 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9ba13aa640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c0722c0 0x7f9b9c0bfcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c400 tx=0x7f9b9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.799+0000 7f9b91ffb640 1 -- 172.21.15.45:0/2481763276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b980052d0 con 0x7f9b9c0722c0 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.800+0000 7f9b91ffb640 1 -- 172.21.15.45:0/2481763276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b98005430 con 0x7f9b9c0722c0 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.800+0000 7f9b91ffb640 1 -- 172.21.15.45:0/2481763276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98003830 con 0x7f9b9c0722c0 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.800+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b94009a70 con 0x7f9b9c0722c0 2023-11-18T19:07:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.800+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c0a7f00 con 0x7f9b9c0722c0 2023-11-18T19:07:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.801+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c067fc0 con 0x7f9b9c0722c0 2023-11-18T19:07:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.802+0000 7f9b91ffb640 1 -- 172.21.15.45:0/2481763276 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b98003990 con 0x7f9b9c0722c0 2023-11-18T19:07:02.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.803+0000 7f9b91ffb640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9b8006ae40 0x7f9b8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:02.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.803+0000 7f9b91ffb640 1 -- 172.21.15.45:0/2481763276 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b98088e70 con 0x7f9b9c0722c0 2023-11-18T19:07:02.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.803+0000 7f9ba0ba9640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9b8006ae40 0x7f9b8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:02.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.804+0000 7f9ba0ba9640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9b8006ae40 0x7f9b8006d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0675d0 tx=0x7f9b8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:02.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.807+0000 7f9b91ffb640 1 -- 172.21.15.45:0/2481763276 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b98053c20 con 0x7f9b9c0722c0 2023-11-18T19:07:02.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:02.996+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b9c06dd60 con 0x7f9b8006ae40 2023-11-18T19:07:03.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.022+0000 7f9b91ffb640 1 -- 172.21.15.45:0/2481763276 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345226 (secure 0 0 0) 0x7f9b8c011e60 con 0x7f9b8006ae40 2023-11-18T19:07:03.028 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:03.030 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:07:03.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9b8006ae40 msgr2=0x7f9b8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9b8006ae40 0x7f9b8006d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0675d0 tx=0x7f9b8c008040 comp rx=0 tx=0).stop 2023-11-18T19:07:03.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c0722c0 msgr2=0x7f9b9c0bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c0722c0 0x7f9b9c0bfcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c400 tx=0x7f9b9800c8c0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 shutdown_connections 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9b8006ae40 0x7f9b8006d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b9c155890 0x7f9b9c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b9c0c2fb0 0x7f9b9c14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 --2- 172.21.15.45:0/2481763276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c0722c0 0x7f9b9c0bfcd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.028+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 >> 172.21.15.45:0/2481763276 conn(0x7f9b9c0c5af0 msgr2=0x7f9b9c0c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.029+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 shutdown_connections 2023-11-18T19:07:03.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.029+0000 7f9ba23ac640 1 -- 172.21.15.45:0/2481763276 wait complete. 2023-11-18T19:07:03.049 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-18T19:07:01.174631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222736,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751984,"statfs":{"total":773094113280,"available":772866031616,"internally_reserved":0,"allocated":2457600,"data_stored":2070758,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004605"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595259+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:06:41.595259+0000","last_peered":"2023-11-18T19:06:41.595259+0000","last_clean":"2023-11-18T19:06:41.595259+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:06:41.595259+0000","last_undegraded":"2023-11-18T19:06:41.595259+0000","last_fullsized":"2023-11-18T19:06:41.595259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594762+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:06:41.594762+0000","last_peered":"2023-11-18T19:06:41.594762+0000","last_clean":"2023-11-18T19:06:41.594762+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:06:41.594762+0000","last_undegraded":"2023-11-18T19:06:41.594762+0000","last_fullsized":"2023-11-18T19:06:41.594762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559367+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:06:43.559367+0000","last_peered":"2023-11-18T19:06:43.559367+0000","last_clean":"2023-11-18T19:06:43.559367+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:06:43.559367+0000","last_undegraded":"2023-11-18T19:06:43.559367+0000","last_fullsized":"2023-11-18T19:06:43.559367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595732+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:06:41.595732+0000","last_peered":"2023-11-18T19:06:41.595732+0000","last_clean":"2023-11-18T19:06:41.595732+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:06:41.595732+0000","last_undegraded":"2023-11-18T19:06:41.595732+0000","last_fullsized":"2023-11-18T19:06:41.595732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595986+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:06:41.595986+0000","last_peered":"2023-11-18T19:06:41.595986+0000","last_clean":"2023-11-18T19:06:41.595986+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:06:41.595986+0000","last_undegraded":"2023-11-18T19:06:41.595986+0000","last_fullsized":"2023-11-18T19:06:41.595986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606153+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:06:42.606153+0000","last_peered":"2023-11-18T19:06:42.606153+0000","last_clean":"2023-11-18T19:06:42.606153+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:06:42.606153+0000","last_undegraded":"2023-11-18T19:06:42.606153+0000","last_fullsized":"2023-11-18T19:06:42.606153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587914+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:06:41.587914+0000","last_peered":"2023-11-18T19:06:41.587914+0000","last_clean":"2023-11-18T19:06:41.587914+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:06:41.587914+0000","last_undegraded":"2023-11-18T19:06:41.587914+0000","last_fullsized":"2023-11-18T19:06:41.587914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591833+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:06:41.591833+0000","last_peered":"2023-11-18T19:06:41.591833+0000","last_clean":"2023-11-18T19:06:41.591833+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:06:41.591833+0000","last_undegraded":"2023-11-18T19:06:41.591833+0000","last_fullsized":"2023-11-18T19:06:41.591833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606957+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:06:42.606957+0000","last_peered":"2023-11-18T19:06:42.606957+0000","last_clean":"2023-11-18T19:06:42.606957+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:06:42.606957+0000","last_undegraded":"2023-11-18T19:06:42.606957+0000","last_fullsized":"2023-11-18T19:06:42.606957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588640+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:06:41.588640+0000","last_peered":"2023-11-18T19:06:41.588640+0000","last_clean":"2023-11-18T19:06:41.588640+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:06:41.588640+0000","last_undegraded":"2023-11-18T19:06:41.588640+0000","last_fullsized":"2023-11-18T19:06:41.588640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574155+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:06:41.574155+0000","last_peered":"2023-11-18T19:06:41.574155+0000","last_clean":"2023-11-18T19:06:41.574155+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:06:41.574155+0000","last_undegraded":"2023-11-18T19:06:41.574155+0000","last_fullsized":"2023-11-18T19:06:41.574155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606417+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:06:42.606417+0000","last_peered":"2023-11-18T19:06:42.606417+0000","last_clean":"2023-11-18T19:06:42.606417+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:06:42.606417+0000","last_undegraded":"2023-11-18T19:06:42.606417+0000","last_fullsized":"2023-11-18T19:06:42.606417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572339+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:06:41.572339+0000","last_peered":"2023-11-18T19:06:41.572339+0000","last_clean":"2023-11-18T19:06:41.572339+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:06:41.572339+0000","last_undegraded":"2023-11-18T19:06:41.572339+0000","last_fullsized":"2023-11-18T19:06:41.572339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574750+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:06:41.574750+0000","last_peered":"2023-11-18T19:06:41.574750+0000","last_clean":"2023-11-18T19:06:41.574750+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:06:41.574750+0000","last_undegraded":"2023-11-18T19:06:41.574750+0000","last_fullsized":"2023-11-18T19:06:41.574750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718092+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:06:42.718092+0000","last_peered":"2023-11-18T19:06:42.718092+0000","last_clean":"2023-11-18T19:06:42.718092+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:06:42.718092+0000","last_undegraded":"2023-11-18T19:06:42.718092+0000","last_fullsized":"2023-11-18T19:06:42.718092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606456+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:06:41.606456+0000","last_peered":"2023-11-18T19:06:41.606456+0000","last_clean":"2023-11-18T19:06:41.606456+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:06:41.606456+0000","last_undegraded":"2023-11-18T19:06:41.606456+0000","last_fullsized":"2023-11-18T19:06:41.606456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579797+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:06:41.579797+0000","last_peered":"2023-11-18T19:06:41.579797+0000","last_clean":"2023-11-18T19:06:41.579797+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:06:41.579797+0000","last_undegraded":"2023-11-18T19:06:41.579797+0000","last_fullsized":"2023-11-18T19:06:41.579797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558472+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:06:43.558472+0000","last_peered":"2023-11-18T19:06:43.558472+0000","last_clean":"2023-11-18T19:06:43.558472+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:06:43.558472+0000","last_undegraded":"2023-11-18T19:06:43.558472+0000","last_fullsized":"2023-11-18T19:06:43.558472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592221+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:06:41.592221+0000","last_peered":"2023-11-18T19:06:41.592221+0000","last_clean":"2023-11-18T19:06:41.592221+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:06:41.592221+0000","last_undegraded":"2023-11-18T19:06:41.592221+0000","last_fullsized":"2023-11-18T19:06:41.592221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594052+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:06:41.594052+0000","last_peered":"2023-11-18T19:06:41.594052+0000","last_clean":"2023-11-18T19:06:41.594052+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:06:41.594052+0000","last_undegraded":"2023-11-18T19:06:41.594052+0000","last_fullsized":"2023-11-18T19:06:41.594052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562033+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:06:43.562033+0000","last_peered":"2023-11-18T19:06:43.562033+0000","last_clean":"2023-11-18T19:06:43.562033+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:06:43.562033+0000","last_undegraded":"2023-11-18T19:06:43.562033+0000","last_fullsized":"2023-11-18T19:06:43.562033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571771+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:06:41.571771+0000","last_peered":"2023-11-18T19:06:41.571771+0000","last_clean":"2023-11-18T19:06:41.571771+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:06:41.571771+0000","last_undegraded":"2023-11-18T19:06:41.571771+0000","last_fullsized":"2023-11-18T19:06:41.571771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580390+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:06:41.580390+0000","last_peered":"2023-11-18T19:06:41.580390+0000","last_clean":"2023-11-18T19:06:41.580390+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:06:41.580390+0000","last_undegraded":"2023-11-18T19:06:41.580390+0000","last_fullsized":"2023-11-18T19:06:41.580390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608335+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:06:42.608335+0000","last_peered":"2023-11-18T19:06:42.608335+0000","last_clean":"2023-11-18T19:06:42.608335+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:06:42.608335+0000","last_undegraded":"2023-11-18T19:06:42.608335+0000","last_fullsized":"2023-11-18T19:06:42.608335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594176+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:06:41.594176+0000","last_peered":"2023-11-18T19:06:41.594176+0000","last_clean":"2023-11-18T19:06:41.594176+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:06:41.594176+0000","last_undegraded":"2023-11-18T19:06:41.594176+0000","last_fullsized":"2023-11-18T19:06:41.594176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575911+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:06:41.575911+0000","last_peered":"2023-11-18T19:06:41.575911+0000","last_clean":"2023-11-18T19:06:41.575911+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:06:41.575911+0000","last_undegraded":"2023-11-18T19:06:41.575911+0000","last_fullsized":"2023-11-18T19:06:41.575911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606274+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:06:42.606274+0000","last_peered":"2023-11-18T19:06:42.606274+0000","last_clean":"2023-11-18T19:06:42.606274+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:06:42.606274+0000","last_undegraded":"2023-11-18T19:06:42.606274+0000","last_fullsized":"2023-11-18T19:06:42.606274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595159+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:06:41.595159+0000","last_peered":"2023-11-18T19:06:41.595159+0000","last_clean":"2023-11-18T19:06:41.595159+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:06:41.595159+0000","last_undegraded":"2023-11-18T19:06:41.595159+0000","last_fullsized":"2023-11-18T19:06:41.595159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594379+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:06:41.594379+0000","last_peered":"2023-11-18T19:06:41.594379+0000","last_clean":"2023-11-18T19:06:41.594379+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:06:41.594379+0000","last_undegraded":"2023-11-18T19:06:41.594379+0000","last_fullsized":"2023-11-18T19:06:41.594379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608512+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:06:42.608512+0000","last_peered":"2023-11-18T19:06:42.608512+0000","last_clean":"2023-11-18T19:06:42.608512+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:06:42.608512+0000","last_undegraded":"2023-11-18T19:06:42.608512+0000","last_fullsized":"2023-11-18T19:06:42.608512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584700+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:06:41.584700+0000","last_peered":"2023-11-18T19:06:41.584700+0000","last_clean":"2023-11-18T19:06:41.584700+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:06:41.584700+0000","last_undegraded":"2023-11-18T19:06:41.584700+0000","last_fullsized":"2023-11-18T19:06:41.584700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574502+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:06:41.574502+0000","last_peered":"2023-11-18T19:06:41.574502+0000","last_clean":"2023-11-18T19:06:41.574502+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:06:41.574502+0000","last_undegraded":"2023-11-18T19:06:41.574502+0000","last_fullsized":"2023-11-18T19:06:41.574502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609207+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:06:42.609207+0000","last_peered":"2023-11-18T19:06:42.609207+0000","last_clean":"2023-11-18T19:06:42.609207+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:06:42.609207+0000","last_undegraded":"2023-11-18T19:06:42.609207+0000","last_fullsized":"2023-11-18T19:06:42.609207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584886+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:06:41.584886+0000","last_peered":"2023-11-18T19:06:41.584886+0000","last_clean":"2023-11-18T19:06:41.584886+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:06:41.584886+0000","last_undegraded":"2023-11-18T19:06:41.584886+0000","last_fullsized":"2023-11-18T19:06:41.584886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580430+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:06:41.580430+0000","last_peered":"2023-11-18T19:06:41.580430+0000","last_clean":"2023-11-18T19:06:41.580430+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:06:41.580430+0000","last_undegraded":"2023-11-18T19:06:41.580430+0000","last_fullsized":"2023-11-18T19:06:41.580430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611054+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:06:42.611054+0000","last_peered":"2023-11-18T19:06:42.611054+0000","last_clean":"2023-11-18T19:06:42.611054+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:06:42.611054+0000","last_undegraded":"2023-11-18T19:06:42.611054+0000","last_fullsized":"2023-11-18T19:06:42.611054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579918+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:06:41.579918+0000","last_peered":"2023-11-18T19:06:41.579918+0000","last_clean":"2023-11-18T19:06:41.579918+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:06:41.579918+0000","last_undegraded":"2023-11-18T19:06:41.579918+0000","last_fullsized":"2023-11-18T19:06:41.579918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575468+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:06:41.575468+0000","last_peered":"2023-11-18T19:06:41.575468+0000","last_clean":"2023-11-18T19:06:41.575468+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:06:41.575468+0000","last_undegraded":"2023-11-18T19:06:41.575468+0000","last_fullsized":"2023-11-18T19:06:41.575468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610460+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:06:42.610460+0000","last_peered":"2023-11-18T19:06:42.610460+0000","last_clean":"2023-11-18T19:06:42.610460+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:06:42.610460+0000","last_undegraded":"2023-11-18T19:06:42.610460+0000","last_fullsized":"2023-11-18T19:06:42.610460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579649+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:06:41.579649+0000","last_peered":"2023-11-18T19:06:41.579649+0000","last_clean":"2023-11-18T19:06:41.579649+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:06:41.579649+0000","last_undegraded":"2023-11-18T19:06:41.579649+0000","last_fullsized":"2023-11-18T19:06:41.579649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604625+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:06:41.604625+0000","last_peered":"2023-11-18T19:06:41.604625+0000","last_clean":"2023-11-18T19:06:41.604625+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:06:41.604625+0000","last_undegraded":"2023-11-18T19:06:41.604625+0000","last_fullsized":"2023-11-18T19:06:41.604625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.613259+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:06:42.613259+0000","last_peered":"2023-11-18T19:06:42.613259+0000","last_clean":"2023-11-18T19:06:42.613259+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:06:42.613259+0000","last_undegraded":"2023-11-18T19:06:42.613259+0000","last_fullsized":"2023-11-18T19:06:42.613259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582674+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:06:41.582674+0000","last_peered":"2023-11-18T19:06:41.582674+0000","last_clean":"2023-11-18T19:06:41.582674+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:06:41.582674+0000","last_undegraded":"2023-11-18T19:06:41.582674+0000","last_fullsized":"2023-11-18T19:06:41.582674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573262+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:06:41.573262+0000","last_peered":"2023-11-18T19:06:41.573262+0000","last_clean":"2023-11-18T19:06:41.573262+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:06:41.573262+0000","last_undegraded":"2023-11-18T19:06:41.573262+0000","last_fullsized":"2023-11-18T19:06:41.573262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561489+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:06:43.561489+0000","last_peered":"2023-11-18T19:06:43.561489+0000","last_clean":"2023-11-18T19:06:43.561489+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:06:43.561489+0000","last_undegraded":"2023-11-18T19:06:43.561489+0000","last_fullsized":"2023-11-18T19:06:43.561489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587345+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:06:41.587345+0000","last_peered":"2023-11-18T19:06:41.587345+0000","last_clean":"2023-11-18T19:06:41.587345+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:06:41.587345+0000","last_undegraded":"2023-11-18T19:06:41.587345+0000","last_fullsized":"2023-11-18T19:06:41.587345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574458+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:06:41.574458+0000","last_peered":"2023-11-18T19:06:41.574458+0000","last_clean":"2023-11-18T19:06:41.574458+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:06:41.574458+0000","last_undegraded":"2023-11-18T19:06:41.574458+0000","last_fullsized":"2023-11-18T19:06:41.574458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590707+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:06:41.590707+0000","last_peered":"2023-11-18T19:06:41.590707+0000","last_clean":"2023-11-18T19:06:41.590707+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:06:41.590707+0000","last_undegraded":"2023-11-18T19:06:41.590707+0000","last_fullsized":"2023-11-18T19:06:41.590707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:24:48.318265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718474+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:06:42.718474+0000","last_peered":"2023-11-18T19:06:42.718474+0000","last_clean":"2023-11-18T19:06:42.718474+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:06:42.718474+0000","last_undegraded":"2023-11-18T19:06:42.718474+0000","last_fullsized":"2023-11-18T19:06:42.718474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574260+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:06:41.574260+0000","last_peered":"2023-11-18T19:06:41.574260+0000","last_clean":"2023-11-18T19:06:41.574260+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:06:41.574260+0000","last_undegraded":"2023-11-18T19:06:41.574260+0000","last_fullsized":"2023-11-18T19:06:41.574260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584878+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:06:41.584878+0000","last_peered":"2023-11-18T19:06:41.584878+0000","last_clean":"2023-11-18T19:06:41.584878+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:06:41.584878+0000","last_undegraded":"2023-11-18T19:06:41.584878+0000","last_fullsized":"2023-11-18T19:06:41.584878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606686+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:06:42.606686+0000","last_peered":"2023-11-18T19:06:42.606686+0000","last_clean":"2023-11-18T19:06:42.606686+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:06:42.606686+0000","last_undegraded":"2023-11-18T19:06:42.606686+0000","last_fullsized":"2023-11-18T19:06:42.606686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589667+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:06:41.589667+0000","last_peered":"2023-11-18T19:06:41.589667+0000","last_clean":"2023-11-18T19:06:41.589667+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:06:41.589667+0000","last_undegraded":"2023-11-18T19:06:41.589667+0000","last_fullsized":"2023-11-18T19:06:41.589667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591151+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:06:41.591151+0000","last_peered":"2023-11-18T19:06:41.591151+0000","last_clean":"2023-11-18T19:06:41.591151+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:06:41.591151+0000","last_undegraded":"2023-11-18T19:06:41.591151+0000","last_fullsized":"2023-11-18T19:06:41.591151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.560394+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:06:43.560394+0000","last_peered":"2023-11-18T19:06:43.560394+0000","last_clean":"2023-11-18T19:06:43.560394+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:06:43.560394+0000","last_undegraded":"2023-11-18T19:06:43.560394+0000","last_fullsized":"2023-11-18T19:06:43.560394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588173+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:06:41.588173+0000","last_peered":"2023-11-18T19:06:41.588173+0000","last_clean":"2023-11-18T19:06:41.588173+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:06:41.588173+0000","last_undegraded":"2023-11-18T19:06:41.588173+0000","last_fullsized":"2023-11-18T19:06:41.588173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594281+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:06:41.594281+0000","last_peered":"2023-11-18T19:06:41.594281+0000","last_clean":"2023-11-18T19:06:41.594281+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:06:41.594281+0000","last_undegraded":"2023-11-18T19:06:41.594281+0000","last_fullsized":"2023-11-18T19:06:41.594281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.717717+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:06:42.717717+0000","last_peered":"2023-11-18T19:06:42.717717+0000","last_clean":"2023-11-18T19:06:42.717717+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:06:42.717717+0000","last_undegraded":"2023-11-18T19:06:42.717717+0000","last_fullsized":"2023-11-18T19:06:42.717717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584417+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:06:41.584417+0000","last_peered":"2023-11-18T19:06:41.584417+0000","last_clean":"2023-11-18T19:06:41.584417+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:06:41.584417+0000","last_undegraded":"2023-11-18T19:06:41.584417+0000","last_fullsized":"2023-11-18T19:06:41.584417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588264+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:06:41.588264+0000","last_peered":"2023-11-18T19:06:41.588264+0000","last_clean":"2023-11-18T19:06:41.588264+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:06:41.588264+0000","last_undegraded":"2023-11-18T19:06:41.588264+0000","last_fullsized":"2023-11-18T19:06:41.588264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558034+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:06:43.558034+0000","last_peered":"2023-11-18T19:06:43.558034+0000","last_clean":"2023-11-18T19:06:43.558034+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:06:43.558034+0000","last_undegraded":"2023-11-18T19:06:43.558034+0000","last_fullsized":"2023-11-18T19:06:43.558034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:03.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571644+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:06:41.571644+0000","last_peered":"2023-11-18T19:06:41.571644+0000","last_clean":"2023-11-18T19:06:41.571644+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:06:41.571644+0000","last_undegraded":"2023-11-18T19:06:41.571644+0000","last_fullsized":"2023-11-18T19:06:41.571644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592325+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:06:41.592325+0000","last_peered":"2023-11-18T19:06:41.592325+0000","last_clean":"2023-11-18T19:06:41.592325+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:06:41.592325+0000","last_undegraded":"2023-11-18T19:06:41.592325+0000","last_fullsized":"2023-11-18T19:06:41.592325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562218+0000","last_change":"2023-11-18T19:06:41.614438+0000","last_active":"2023-11-18T19:06:43.562218+0000","last_peered":"2023-11-18T19:06:43.562218+0000","last_clean":"2023-11-18T19:06:43.562218+0000","last_became_active":"2023-11-18T19:06:41.613140+0000","last_became_peered":"2023-11-18T19:06:41.613140+0000","last_unstale":"2023-11-18T19:06:43.562218+0000","last_undegraded":"2023-11-18T19:06:43.562218+0000","last_fullsized":"2023-11-18T19:06:43.562218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:25.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590560+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:06:41.590560+0000","last_peered":"2023-11-18T19:06:41.590560+0000","last_clean":"2023-11-18T19:06:41.590560+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:06:41.590560+0000","last_undegraded":"2023-11-18T19:06:41.590560+0000","last_fullsized":"2023-11-18T19:06:41.590560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581506+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:06:41.581506+0000","last_peered":"2023-11-18T19:06:41.581506+0000","last_clean":"2023-11-18T19:06:41.581506+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:06:41.581506+0000","last_undegraded":"2023-11-18T19:06:41.581506+0000","last_fullsized":"2023-11-18T19:06:41.581506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561030+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:06:43.561030+0000","last_peered":"2023-11-18T19:06:43.561030+0000","last_clean":"2023-11-18T19:06:43.561030+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:06:43.561030+0000","last_undegraded":"2023-11-18T19:06:43.561030+0000","last_fullsized":"2023-11-18T19:06:43.561030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572710+0000","last_change":"2023-11-18T19:06:37.579602+0000","last_active":"2023-11-18T19:06:41.572710+0000","last_peered":"2023-11-18T19:06:41.572710+0000","last_clean":"2023-11-18T19:06:41.572710+0000","last_became_active":"2023-11-18T19:06:37.579178+0000","last_became_peered":"2023-11-18T19:06:37.579178+0000","last_unstale":"2023-11-18T19:06:41.572710+0000","last_undegraded":"2023-11-18T19:06:41.572710+0000","last_fullsized":"2023-11-18T19:06:41.572710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:15.325066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572917+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:06:41.572917+0000","last_peered":"2023-11-18T19:06:41.572917+0000","last_clean":"2023-11-18T19:06:41.572917+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:06:41.572917+0000","last_undegraded":"2023-11-18T19:06:41.572917+0000","last_fullsized":"2023-11-18T19:06:41.572917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610033+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:06:42.610033+0000","last_peered":"2023-11-18T19:06:42.610033+0000","last_clean":"2023-11-18T19:06:42.610033+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:06:42.610033+0000","last_undegraded":"2023-11-18T19:06:42.610033+0000","last_fullsized":"2023-11-18T19:06:42.610033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579551+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:06:41.579551+0000","last_peered":"2023-11-18T19:06:41.579551+0000","last_clean":"2023-11-18T19:06:41.579551+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:06:41.579551+0000","last_undegraded":"2023-11-18T19:06:41.579551+0000","last_fullsized":"2023-11-18T19:06:41.579551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.607281+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:06:41.607281+0000","last_peered":"2023-11-18T19:06:41.607281+0000","last_clean":"2023-11-18T19:06:41.607281+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:06:41.607281+0000","last_undegraded":"2023-11-18T19:06:41.607281+0000","last_fullsized":"2023-11-18T19:06:41.607281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718925+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:06:42.718925+0000","last_peered":"2023-11-18T19:06:42.718925+0000","last_clean":"2023-11-18T19:06:42.718925+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:06:42.718925+0000","last_undegraded":"2023-11-18T19:06:42.718925+0000","last_fullsized":"2023-11-18T19:06:42.718925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587790+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:06:41.587790+0000","last_peered":"2023-11-18T19:06:41.587790+0000","last_clean":"2023-11-18T19:06:41.587790+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:06:41.587790+0000","last_undegraded":"2023-11-18T19:06:41.587790+0000","last_fullsized":"2023-11-18T19:06:41.587790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:57.618128+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:06:57.618128+0000","last_peered":"2023-11-18T19:06:57.618128+0000","last_clean":"2023-11-18T19:06:57.618128+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:06:57.618128+0000","last_undegraded":"2023-11-18T19:06:57.618128+0000","last_fullsized":"2023-11-18T19:06:57.618128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611068+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:06:42.611068+0000","last_peered":"2023-11-18T19:06:42.611068+0000","last_clean":"2023-11-18T19:06:42.611068+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:06:42.611068+0000","last_undegraded":"2023-11-18T19:06:42.611068+0000","last_fullsized":"2023-11-18T19:06:42.611068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.576702+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:06:41.576702+0000","last_peered":"2023-11-18T19:06:41.576702+0000","last_clean":"2023-11-18T19:06:41.576702+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:06:41.576702+0000","last_undegraded":"2023-11-18T19:06:41.576702+0000","last_fullsized":"2023-11-18T19:06:41.576702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606192+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:06:41.606192+0000","last_peered":"2023-11-18T19:06:41.606192+0000","last_clean":"2023-11-18T19:06:41.606192+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:06:41.606192+0000","last_undegraded":"2023-11-18T19:06:41.606192+0000","last_fullsized":"2023-11-18T19:06:41.606192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.607397+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:06:42.607397+0000","last_peered":"2023-11-18T19:06:42.607397+0000","last_clean":"2023-11-18T19:06:42.607397+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:06:42.607397+0000","last_undegraded":"2023-11-18T19:06:42.607397+0000","last_fullsized":"2023-11-18T19:06:42.607397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.596028+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:06:41.596028+0000","last_peered":"2023-11-18T19:06:41.596028+0000","last_clean":"2023-11-18T19:06:41.596028+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:06:41.596028+0000","last_undegraded":"2023-11-18T19:06:41.596028+0000","last_fullsized":"2023-11-18T19:06:41.596028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587870+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:06:41.587870+0000","last_peered":"2023-11-18T19:06:41.587870+0000","last_clean":"2023-11-18T19:06:41.587870+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:06:41.587870+0000","last_undegraded":"2023-11-18T19:06:41.587870+0000","last_fullsized":"2023-11-18T19:06:41.587870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559235+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:06:43.559235+0000","last_peered":"2023-11-18T19:06:43.559235+0000","last_clean":"2023-11-18T19:06:43.559235+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:06:43.559235+0000","last_undegraded":"2023-11-18T19:06:43.559235+0000","last_fullsized":"2023-11-18T19:06:43.559235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584320+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:06:41.584320+0000","last_peered":"2023-11-18T19:06:41.584320+0000","last_clean":"2023-11-18T19:06:41.584320+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:06:41.584320+0000","last_undegraded":"2023-11-18T19:06:41.584320+0000","last_fullsized":"2023-11-18T19:06:41.584320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592273+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:06:41.592273+0000","last_peered":"2023-11-18T19:06:41.592273+0000","last_clean":"2023-11-18T19:06:41.592273+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:06:41.592273+0000","last_undegraded":"2023-11-18T19:06:41.592273+0000","last_fullsized":"2023-11-18T19:06:41.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:08.678189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609111+0000","last_change":"2023-11-18T19:06:41.622287+0000","last_active":"2023-11-18T19:06:42.609111+0000","last_peered":"2023-11-18T19:06:42.609111+0000","last_clean":"2023-11-18T19:06:42.609111+0000","last_became_active":"2023-11-18T19:06:41.618340+0000","last_became_peered":"2023-11-18T19:06:41.618340+0000","last_unstale":"2023-11-18T19:06:42.609111+0000","last_undegraded":"2023-11-18T19:06:42.609111+0000","last_fullsized":"2023-11-18T19:06:42.609111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.614055+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:06:42.614055+0000","last_peered":"2023-11-18T19:06:42.614055+0000","last_clean":"2023-11-18T19:06:42.614055+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:06:42.614055+0000","last_undegraded":"2023-11-18T19:06:42.614055+0000","last_fullsized":"2023-11-18T19:06:42.614055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590846+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:06:41.590846+0000","last_peered":"2023-11-18T19:06:41.590846+0000","last_clean":"2023-11-18T19:06:41.590846+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:06:41.590846+0000","last_undegraded":"2023-11-18T19:06:41.590846+0000","last_fullsized":"2023-11-18T19:06:41.590846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573178+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:06:41.573178+0000","last_peered":"2023-11-18T19:06:41.573178+0000","last_clean":"2023-11-18T19:06:41.573178+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:06:41.573178+0000","last_undegraded":"2023-11-18T19:06:41.573178+0000","last_fullsized":"2023-11-18T19:06:41.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718948+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:06:42.718948+0000","last_peered":"2023-11-18T19:06:42.718948+0000","last_clean":"2023-11-18T19:06:42.718948+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:06:42.718948+0000","last_undegraded":"2023-11-18T19:06:42.718948+0000","last_fullsized":"2023-11-18T19:06:42.718948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579857+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:06:41.579857+0000","last_peered":"2023-11-18T19:06:41.579857+0000","last_clean":"2023-11-18T19:06:41.579857+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:06:41.579857+0000","last_undegraded":"2023-11-18T19:06:41.579857+0000","last_fullsized":"2023-11-18T19:06:41.579857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582912+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:06:41.582912+0000","last_peered":"2023-11-18T19:06:41.582912+0000","last_clean":"2023-11-18T19:06:41.582912+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:06:41.582912+0000","last_undegraded":"2023-11-18T19:06:41.582912+0000","last_fullsized":"2023-11-18T19:06:41.582912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572727+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:06:41.572727+0000","last_peered":"2023-11-18T19:06:41.572727+0000","last_clean":"2023-11-18T19:06:41.572727+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:06:41.572727+0000","last_undegraded":"2023-11-18T19:06:41.572727+0000","last_fullsized":"2023-11-18T19:06:41.572727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591508+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:06:41.591508+0000","last_peered":"2023-11-18T19:06:41.591508+0000","last_clean":"2023-11-18T19:06:41.591508+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:06:41.591508+0000","last_undegraded":"2023-11-18T19:06:41.591508+0000","last_fullsized":"2023-11-18T19:06:41.591508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611823+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:06:42.611823+0000","last_peered":"2023-11-18T19:06:42.611823+0000","last_clean":"2023-11-18T19:06:42.611823+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:06:42.611823+0000","last_undegraded":"2023-11-18T19:06:42.611823+0000","last_fullsized":"2023-11-18T19:06:42.611823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584083+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:06:41.584083+0000","last_peered":"2023-11-18T19:06:41.584083+0000","last_clean":"2023-11-18T19:06:41.584083+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:06:41.584083+0000","last_undegraded":"2023-11-18T19:06:41.584083+0000","last_fullsized":"2023-11-18T19:06:41.584083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589767+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:06:41.589767+0000","last_peered":"2023-11-18T19:06:41.589767+0000","last_clean":"2023-11-18T19:06:41.589767+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:06:41.589767+0000","last_undegraded":"2023-11-18T19:06:41.589767+0000","last_fullsized":"2023-11-18T19:06:41.589767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561860+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:06:43.561860+0000","last_peered":"2023-11-18T19:06:43.561860+0000","last_clean":"2023-11-18T19:06:43.561860+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:06:43.561860+0000","last_undegraded":"2023-11-18T19:06:43.561860+0000","last_fullsized":"2023-11-18T19:06:43.561860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582668+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:06:41.582668+0000","last_peered":"2023-11-18T19:06:41.582668+0000","last_clean":"2023-11-18T19:06:41.582668+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:06:41.582668+0000","last_undegraded":"2023-11-18T19:06:41.582668+0000","last_fullsized":"2023-11-18T19:06:41.582668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604540+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:06:41.604540+0000","last_peered":"2023-11-18T19:06:41.604540+0000","last_clean":"2023-11-18T19:06:41.604540+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:06:41.604540+0000","last_undegraded":"2023-11-18T19:06:41.604540+0000","last_fullsized":"2023-11-18T19:06:41.604540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571628+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:06:41.571628+0000","last_peered":"2023-11-18T19:06:41.571628+0000","last_clean":"2023-11-18T19:06:41.571628+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:06:41.571628+0000","last_undegraded":"2023-11-18T19:06:41.571628+0000","last_fullsized":"2023-11-18T19:06:41.571628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.583899+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:06:41.583899+0000","last_peered":"2023-11-18T19:06:41.583899+0000","last_clean":"2023-11-18T19:06:41.583899+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:06:41.583899+0000","last_undegraded":"2023-11-18T19:06:41.583899+0000","last_fullsized":"2023-11-18T19:06:41.583899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584150+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:06:41.584150+0000","last_peered":"2023-11-18T19:06:41.584150+0000","last_clean":"2023-11-18T19:06:41.584150+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:06:41.584150+0000","last_undegraded":"2023-11-18T19:06:41.584150+0000","last_fullsized":"2023-11-18T19:06:41.584150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580014+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:06:41.580014+0000","last_peered":"2023-11-18T19:06:41.580014+0000","last_clean":"2023-11-18T19:06:41.580014+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:06:41.580014+0000","last_undegraded":"2023-11-18T19:06:41.580014+0000","last_fullsized":"2023-11-18T19:06:41.580014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584222+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:06:41.584222+0000","last_peered":"2023-11-18T19:06:41.584222+0000","last_clean":"2023-11-18T19:06:41.584222+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:06:41.584222+0000","last_undegraded":"2023-11-18T19:06:41.584222+0000","last_fullsized":"2023-11-18T19:06:41.584222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595920+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:06:41.595920+0000","last_peered":"2023-11-18T19:06:41.595920+0000","last_clean":"2023-11-18T19:06:41.595920+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:06:41.595920+0000","last_undegraded":"2023-11-18T19:06:41.595920+0000","last_fullsized":"2023-11-18T19:06:41.595920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572929+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:06:41.572929+0000","last_peered":"2023-11-18T19:06:41.572929+0000","last_clean":"2023-11-18T19:06:41.572929+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:06:41.572929+0000","last_undegraded":"2023-11-18T19:06:41.572929+0000","last_fullsized":"2023-11-18T19:06:41.572929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580481+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:06:41.580481+0000","last_peered":"2023-11-18T19:06:41.580481+0000","last_clean":"2023-11-18T19:06:41.580481+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:06:41.580481+0000","last_undegraded":"2023-11-18T19:06:41.580481+0000","last_fullsized":"2023-11-18T19:06:41.580481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589699+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:06:41.589699+0000","last_peered":"2023-11-18T19:06:41.589699+0000","last_clean":"2023-11-18T19:06:41.589699+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:06:41.589699+0000","last_undegraded":"2023-11-18T19:06:41.589699+0000","last_fullsized":"2023-11-18T19:06:41.589699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591289+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:06:41.591289+0000","last_peered":"2023-11-18T19:06:41.591289+0000","last_clean":"2023-11-18T19:06:41.591289+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:06:41.591289+0000","last_undegraded":"2023-11-18T19:06:41.591289+0000","last_fullsized":"2023-11-18T19:06:41.591289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588400+0000","last_change":"2023-11-18T19:06:37.568642+0000","last_active":"2023-11-18T19:06:41.588400+0000","last_peered":"2023-11-18T19:06:41.588400+0000","last_clean":"2023-11-18T19:06:41.588400+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:06:41.588400+0000","last_undegraded":"2023-11-18T19:06:41.588400+0000","last_fullsized":"2023-11-18T19:06:41.588400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574387+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:06:41.574387+0000","last_peered":"2023-11-18T19:06:41.574387+0000","last_clean":"2023-11-18T19:06:41.574387+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:06:41.574387+0000","last_undegraded":"2023-11-18T19:06:41.574387+0000","last_fullsized":"2023-11-18T19:06:41.574387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606645+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:06:41.606645+0000","last_peered":"2023-11-18T19:06:41.606645+0000","last_clean":"2023-11-18T19:06:41.606645+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:06:41.606645+0000","last_undegraded":"2023-11-18T19:06:41.606645+0000","last_fullsized":"2023-11-18T19:06:41.606645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575789+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:06:41.575789+0000","last_peered":"2023-11-18T19:06:41.575789+0000","last_clean":"2023-11-18T19:06:41.575789+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:06:41.575789+0000","last_undegraded":"2023-11-18T19:06:41.575789+0000","last_fullsized":"2023-11-18T19:06:41.575789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572996+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:06:41.572996+0000","last_peered":"2023-11-18T19:06:41.572996+0000","last_clean":"2023-11-18T19:06:41.572996+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:06:41.572996+0000","last_undegraded":"2023-11-18T19:06:41.572996+0000","last_fullsized":"2023-11-18T19:06:41.572996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580120+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:06:41.580120+0000","last_peered":"2023-11-18T19:06:41.580120+0000","last_clean":"2023-11-18T19:06:41.580120+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:06:41.580120+0000","last_undegraded":"2023-11-18T19:06:41.580120+0000","last_fullsized":"2023-11-18T19:06:41.580120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579307+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:06:41.579307+0000","last_peered":"2023-11-18T19:06:41.579307+0000","last_clean":"2023-11-18T19:06:41.579307+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:06:41.579307+0000","last_undegraded":"2023-11-18T19:06:41.579307+0000","last_fullsized":"2023-11-18T19:06:41.579307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580691+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:06:41.580691+0000","last_peered":"2023-11-18T19:06:41.580691+0000","last_clean":"2023-11-18T19:06:41.580691+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:06:41.580691+0000","last_undegraded":"2023-11-18T19:06:41.580691+0000","last_fullsized":"2023-11-18T19:06:41.580691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588307+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:06:41.588307+0000","last_peered":"2023-11-18T19:06:41.588307+0000","last_clean":"2023-11-18T19:06:41.588307+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:06:41.588307+0000","last_undegraded":"2023-11-18T19:06:41.588307+0000","last_fullsized":"2023-11-18T19:06:41.588307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587696+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:06:41.587696+0000","last_peered":"2023-11-18T19:06:41.587696+0000","last_clean":"2023-11-18T19:06:41.587696+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:06:41.587696+0000","last_undegraded":"2023-11-18T19:06:41.587696+0000","last_fullsized":"2023-11-18T19:06:41.587696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587712+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:06:41.587712+0000","last_peered":"2023-11-18T19:06:41.587712+0000","last_clean":"2023-11-18T19:06:41.587712+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:06:41.587712+0000","last_undegraded":"2023-11-18T19:06:41.587712+0000","last_fullsized":"2023-11-18T19:06:41.587712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592211+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:06:41.592211+0000","last_peered":"2023-11-18T19:06:41.592211+0000","last_clean":"2023-11-18T19:06:41.592211+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:06:41.592211+0000","last_undegraded":"2023-11-18T19:06:41.592211+0000","last_fullsized":"2023-11-18T19:06:41.592211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579563+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:06:41.579563+0000","last_peered":"2023-11-18T19:06:41.579563+0000","last_clean":"2023-11-18T19:06:41.579563+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:06:41.579563+0000","last_undegraded":"2023-11-18T19:06:41.579563+0000","last_fullsized":"2023-11-18T19:06:41.579563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581411+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:06:41.581411+0000","last_peered":"2023-11-18T19:06:41.581411+0000","last_clean":"2023-11-18T19:06:41.581411+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:06:41.581411+0000","last_undegraded":"2023-11-18T19:06:41.581411+0000","last_fullsized":"2023-11-18T19:06:41.581411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584038+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:06:41.584038+0000","last_peered":"2023-11-18T19:06:41.584038+0000","last_clean":"2023-11-18T19:06:41.584038+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:06:41.584038+0000","last_undegraded":"2023-11-18T19:06:41.584038+0000","last_fullsized":"2023-11-18T19:06:41.584038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580068+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:06:41.580068+0000","last_peered":"2023-11-18T19:06:41.580068+0000","last_clean":"2023-11-18T19:06:41.580068+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:06:41.580068+0000","last_undegraded":"2023-11-18T19:06:41.580068+0000","last_fullsized":"2023-11-18T19:06:41.580068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584628+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:06:41.584628+0000","last_peered":"2023-11-18T19:06:41.584628+0000","last_clean":"2023-11-18T19:06:41.584628+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:06:41.584628+0000","last_undegraded":"2023-11-18T19:06:41.584628+0000","last_fullsized":"2023-11-18T19:06:41.584628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591038+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:06:41.591038+0000","last_peered":"2023-11-18T19:06:41.591038+0000","last_clean":"2023-11-18T19:06:41.591038+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:06:41.591038+0000","last_undegraded":"2023-11-18T19:06:41.591038+0000","last_fullsized":"2023-11-18T19:06:41.591038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594622+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:06:41.594622+0000","last_peered":"2023-11-18T19:06:41.594622+0000","last_clean":"2023-11-18T19:06:41.594622+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:06:41.594622+0000","last_undegraded":"2023-11-18T19:06:41.594622+0000","last_fullsized":"2023-11-18T19:06:41.594622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588068+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:06:41.588068+0000","last_peered":"2023-11-18T19:06:41.588068+0000","last_clean":"2023-11-18T19:06:41.588068+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:06:41.588068+0000","last_undegraded":"2023-11-18T19:06:41.588068+0000","last_fullsized":"2023-11-18T19:06:41.588068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7609999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":700553,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":110675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.766}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":700531,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.792}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:07:03.054 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-18T19:07:03.055 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-18T19:07:03.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-18T19:07:03.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-18T19:07:03.055 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-18T19:07:03.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.318+0000 7f6f72cbb640 1 Processor -- start 2023-11-18T19:07:03.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.318+0000 7f6f72cbb640 1 -- start start 2023-11-18T19:07:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.320+0000 7f6f72cbb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f6c155310 0x7f6f6c0a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.320+0000 7f6f72cbb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c0a9540 con 0x7f6f6c14eb20 2023-11-18T19:07:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.320+0000 7f6f72cbb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c155790 con 0x7f6f6c0a90b0 2023-11-18T19:07:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.320+0000 7f6f72cbb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0aab40 con 0x7f6f6c155310 2023-11-18T19:07:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.320+0000 7f6f6bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f6c155310 0x7f6f6c0a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.320+0000 7f6f70a57640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f6c14eb20 0x7f6f6c0c4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46854/0 (socket says 172.21.15.45:46854) 2023-11-18T19:07:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.320+0000 7f6f70a57640 1 -- 172.21.15.45:0/3409841108 learned_addr learned my addr 172.21.15.45:0/3409841108 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.321+0000 7f6f6bfff640 1 -- 172.21.15.45:0/3409841108 >> v1:172.21.15.135:6789/0 conn(0x7f6f6c0a90b0 legacy=0x7f6f6c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.321+0000 7f6f6bfff640 1 -- 172.21.15.45:0/3409841108 >> v1:172.21.15.45:6789/0 conn(0x7f6f6c14eb20 legacy=0x7f6f6c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.321+0000 7f6f6b7fe640 1 -- 172.21.15.45:0/3409841108 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911544736 0 0) 0x7f6f6c0a9540 con 0x7f6f6c14eb20 2023-11-18T19:07:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.321+0000 7f6f6bfff640 1 -- 172.21.15.45:0/3409841108 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0c21f0 con 0x7f6f6c155310 2023-11-18T19:07:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.323+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/3409841108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c155310 0x7f6f6c0a8b70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f580097a0 tx=0x7f6f5802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e8c99c9c75fa9d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.323+0000 7f6f6b7fe640 1 -- 172.21.15.45:0/3409841108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5802f050 con 0x7f6f6c155310 2023-11-18T19:07:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.323+0000 7f6f6b7fe640 1 -- 172.21.15.45:0/3409841108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58031700 con 0x7f6f6c155310 2023-11-18T19:07:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.323+0000 7f6f6b7fe640 1 -- 172.21.15.45:0/3409841108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58031a90 con 0x7f6f6c155310 2023-11-18T19:07:03.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.324+0000 7f6f72cbb640 1 -- 172.21.15.45:0/3409841108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c155310 msgr2=0x7f6f6c0a8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.324+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/3409841108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c155310 0x7f6f6c0a8b70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f580097a0 tx=0x7f6f5802b7a0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.324+0000 7f6f72cbb640 1 -- 172.21.15.45:0/3409841108 shutdown_connections 2023-11-18T19:07:03.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.324+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/3409841108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c155310 0x7f6f6c0a8b70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.324+0000 7f6f72cbb640 1 -- 172.21.15.45:0/3409841108 >> 172.21.15.45:0/3409841108 conn(0x7f6f6c06a500 msgr2=0x7f6f6c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:03.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.324+0000 7f6f72cbb640 1 -- 172.21.15.45:0/3409841108 shutdown_connections 2023-11-18T19:07:03.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.324+0000 7f6f72cbb640 1 -- 172.21.15.45:0/3409841108 wait complete. 2023-11-18T19:07:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.325+0000 7f6f72cbb640 1 Processor -- start 2023-11-18T19:07:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.326+0000 7f6f72cbb640 1 -- start start 2023-11-18T19:07:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f72cbb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c0a90b0 0x7f6f6c14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f72cbb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c14eb20 0x7f6f6c1eb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f72cbb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f6c155310 0x7f6f6c1eb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f72cbb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0bd860 con 0x7f6f6c14eb20 2023-11-18T19:07:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f72cbb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0bd4a0 con 0x7f6f6c0a90b0 2023-11-18T19:07:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f72cbb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c14c2b0 con 0x7f6f6c155310 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c14eb20 0x7f6f6c1eb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c14eb20 0x7f6f6c1eb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37764/0 (socket says 172.21.15.45:37764) 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f6bfff640 1 -- 172.21.15.45:0/1621289675 learned_addr learned my addr 172.21.15.45:0/1621289675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f70a57640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c0a90b0 0x7f6f6c14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.327+0000 7f6f71258640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f6c155310 0x7f6f6c1eb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f6bfff640 1 -- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f6c155310 msgr2=0x7f6f6c1eb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f6c155310 0x7f6f6c1eb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f6bfff640 1 -- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c0a90b0 msgr2=0x7f6f6c14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c0a90b0 0x7f6f6c14b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f6bfff640 1 -- 172.21.15.45:0/1621289675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58009400 con 0x7f6f6c14eb20 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f71258640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f6c155310 0x7f6f6c1eb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c14eb20 0x7f6f6c1eb470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f580098c0 tx=0x7f6f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f697fa640 1 -- 172.21.15.45:0/1621289675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58033c30 con 0x7f6f6c14eb20 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f697fa640 1 -- 172.21.15.45:0/1621289675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58033d90 con 0x7f6f6c14eb20 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f697fa640 1 -- 172.21.15.45:0/1621289675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5803d6b0 con 0x7f6f6c14eb20 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.328+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c1ebef0 con 0x7f6f6c14eb20 2023-11-18T19:07:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.329+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c0a8260 con 0x7f6f6c14eb20 2023-11-18T19:07:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.330+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c0747c0 con 0x7f6f6c14eb20 2023-11-18T19:07:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.330+0000 7f6f697fa640 1 -- 172.21.15.45:0/1621289675 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f5803a040 con 0x7f6f6c14eb20 2023-11-18T19:07:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.331+0000 7f6f697fa640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f5006ae40 0x7f6f5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.332+0000 7f6f697fa640 1 -- 172.21.15.45:0/1621289675 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f580ab8f0 con 0x7f6f6c14eb20 2023-11-18T19:07:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.332+0000 7f6f70a57640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f5006ae40 0x7f6f5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.333+0000 7f6f70a57640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f5006ae40 0x7f6f5006d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f60000f60 tx=0x7f6f60007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:03.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.337+0000 7f6f697fa640 1 -- 172.21.15.45:0/1621289675 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f580766a0 con 0x7f6f6c14eb20 2023-11-18T19:07:03.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.579+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6f6c0c02a0 con 0x7f6f6c14eb20 2023-11-18T19:07:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.582+0000 7f6f697fa640 1 -- 172.21.15.45:0/1621289675 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171030 (secure 0 0 0) 0x7f6f58079cc0 con 0x7f6f6c14eb20 2023-11-18T19:07:03.586 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:03.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f5006ae40 msgr2=0x7f6f5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f5006ae40 0x7f6f5006d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f60000f60 tx=0x7f6f60007b50 comp rx=0 tx=0).stop 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c14eb20 msgr2=0x7f6f6c1eb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c14eb20 0x7f6f6c1eb470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f580098c0 tx=0x7f6f580046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 shutdown_connections 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f5006ae40 0x7f6f5006d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f6c155310 0x7f6f6c1eb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6c14eb20 0x7f6f6c1eb470 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 --2- 172.21.15.45:0/1621289675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6c0a90b0 0x7f6f6c14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 >> 172.21.15.45:0/1621289675 conn(0x7f6f6c06a500 msgr2=0x7f6f6c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:03.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 shutdown_connections 2023-11-18T19:07:03.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.586+0000 7f6f72cbb640 1 -- 172.21.15.45:0/1621289675 wait complete. 2023-11-18T19:07:03.606 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2457944943},{"type":"v1","addr":"172.21.15.45:6833","nonce":2457944943}]},"active_addr":"172.21.15.45:6833/2457944943","active_change":"2023-11-18T19:06:23.138017+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1931149258}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1018200643}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3696311717}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":75772107}]}]} 2023-11-18T19:07:03.609 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-18T19:07:03.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-18T19:07:03.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:07:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.828+0000 7f9f48533640 1 Processor -- start 2023-11-18T19:07:03.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.829+0000 7f9f48533640 1 -- start start 2023-11-18T19:07:03.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.830+0000 7f9f48533640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9f40151c00 0x7f9f400c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.830+0000 7f9f48533640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400ca200 con 0x7f9f400bd590 2023-11-18T19:07:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.830+0000 7f9f48533640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f40151fe0 con 0x7f9f400c7e00 2023-11-18T19:07:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.830+0000 7f9f48533640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400c5610 con 0x7f9f40151c00 2023-11-18T19:07:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f462cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9f40151c00 0x7f9f400c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f462cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9f40151c00 0x7f9f400c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42662/0 (socket says 172.21.15.45:42662) 2023-11-18T19:07:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f462cf640 1 -- 172.21.15.45:0/1716293512 learned_addr learned my addr 172.21.15.45:0/1716293512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:03.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f452cd640 1 -- 172.21.15.45:0/1716293512 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596406228 0 0) 0x7f9f400ca200 con 0x7f9f400bd590 2023-11-18T19:07:03.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f452cd640 1 -- 172.21.15.45:0/1716293512 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f2c003520 con 0x7f9f400bd590 2023-11-18T19:07:03.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f462cf640 1 -- 172.21.15.45:0/1716293512 >> v1:172.21.15.135:6789/0 conn(0x7f9f400c7e00 legacy=0x7f9f401545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f462cf640 1 -- 172.21.15.45:0/1716293512 >> v1:172.21.15.45:6789/0 conn(0x7f9f400bd590 legacy=0x7f9f4015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.831+0000 7f9f462cf640 1 -- 172.21.15.45:0/1716293512 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f401586d0 con 0x7f9f40151c00 2023-11-18T19:07:03.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.833+0000 7f9f462cf640 1 --2- 172.21.15.45:0/1716293512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400c4880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009870 tx=0x7f9f3c02b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72dce6c23df1f9ca server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:03.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.833+0000 7f9f452cd640 1 -- 172.21.15.45:0/1716293512 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c030850 con 0x7f9f40151c00 2023-11-18T19:07:03.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.833+0000 7f9f452cd640 1 -- 172.21.15.45:0/1716293512 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0309b0 con 0x7f9f40151c00 2023-11-18T19:07:03.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.833+0000 7f9f452cd640 1 -- 172.21.15.45:0/1716293512 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c030d40 con 0x7f9f40151c00 2023-11-18T19:07:03.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.834+0000 7f9f48533640 1 -- 172.21.15.45:0/1716293512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 msgr2=0x7f9f400c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.834+0000 7f9f48533640 1 --2- 172.21.15.45:0/1716293512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400c4880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009870 tx=0x7f9f3c02b990 comp rx=0 tx=0).stop 2023-11-18T19:07:03.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.834+0000 7f9f48533640 1 -- 172.21.15.45:0/1716293512 shutdown_connections 2023-11-18T19:07:03.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.834+0000 7f9f48533640 1 --2- 172.21.15.45:0/1716293512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400c4880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.834+0000 7f9f48533640 1 -- 172.21.15.45:0/1716293512 >> 172.21.15.45:0/1716293512 conn(0x7f9f400663d0 msgr2=0x7f9f400667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:03.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.834+0000 7f9f48533640 1 -- 172.21.15.45:0/1716293512 shutdown_connections 2023-11-18T19:07:03.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.834+0000 7f9f48533640 1 -- 172.21.15.45:0/1716293512 wait complete. 2023-11-18T19:07:03.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.836+0000 7f9f48533640 1 Processor -- start 2023-11-18T19:07:03.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.837+0000 7f9f48533640 1 -- start start 2023-11-18T19:07:03.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f48533640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f400bd590 0x7f9f401471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f48533640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f400c7e00 0x7f9f40147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f48533640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400be120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f48533640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40155ce0 con 0x7f9f400bd590 2023-11-18T19:07:03.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f48533640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f401eac60 con 0x7f9f40151c00 2023-11-18T19:07:03.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f48533640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400c03f0 con 0x7f9f400c7e00 2023-11-18T19:07:03.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f462cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f400bd590 0x7f9f401471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f462cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f400bd590 0x7f9f401471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37774/0 (socket says 172.21.15.45:37774) 2023-11-18T19:07:03.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f462cf640 1 -- 172.21.15.45:0/2921436336 learned_addr learned my addr 172.21.15.45:0/2921436336 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:03.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f46ad0640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.838+0000 7f9f45ace640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f400c7e00 0x7f9f40147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f462cf640 1 -- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f400c7e00 msgr2=0x7f9f40147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f462cf640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f400c7e00 0x7f9f40147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f462cf640 1 -- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 msgr2=0x7f9f400be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f462cf640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400be120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f462cf640 1 -- 172.21.15.45:0/2921436336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0094d0 con 0x7f9f400bd590 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f46ad0640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f45ace640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f400c7e00 0x7f9f40147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f462cf640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f400bd590 0x7f9f401471e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c000c00 tx=0x7f9f3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f36ffd640 1 -- 172.21.15.45:0/2921436336 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c039a90 con 0x7f9f400bd590 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f36ffd640 1 -- 172.21.15.45:0/2921436336 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c039c10 con 0x7f9f400bd590 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f36ffd640 1 -- 172.21.15.45:0/2921436336 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c043410 con 0x7f9f400bd590 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.839+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f400c06d0 con 0x7f9f400bd590 2023-11-18T19:07:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.840+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f400c0080 con 0x7f9f400bd590 2023-11-18T19:07:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.841+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f400747c0 con 0x7f9f400bd590 2023-11-18T19:07:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.842+0000 7f9f36ffd640 1 -- 172.21.15.45:0/2921436336 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f3c02e070 con 0x7f9f400bd590 2023-11-18T19:07:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.842+0000 7f9f36ffd640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f2406ae40 0x7f9f2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.843+0000 7f9f36ffd640 1 -- 172.21.15.45:0/2921436336 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f3c0ab730 con 0x7f9f400bd590 2023-11-18T19:07:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.843+0000 7f9f45ace640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f2406ae40 0x7f9f2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:03.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.844+0000 7f9f45ace640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f2406ae40 0x7f9f2406d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f40155c70 tx=0x7f9f30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:03.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:03.847+0000 7f9f36ffd640 1 -- 172.21.15.45:0/2921436336 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f3c0764e0 con 0x7f9f400bd590 2023-11-18T19:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.047+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f401579a0 con 0x7f9f400bd590 2023-11-18T19:07:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.050+0000 7f9f36ffd640 1 -- 172.21.15.45:0/2921436336 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f9f3c048090 con 0x7f9f400bd590 2023-11-18T19:07:04.052 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:04.052 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:07:04.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f2406ae40 msgr2=0x7f9f2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f2406ae40 0x7f9f2406d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f40155c70 tx=0x7f9f30009040 comp rx=0 tx=0).stop 2023-11-18T19:07:04.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f400bd590 msgr2=0x7f9f401471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f400bd590 0x7f9f401471e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c000c00 tx=0x7f9f3c004730 comp rx=0 tx=0).stop 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 shutdown_connections 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f40151c00 0x7f9f400be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f2406ae40 0x7f9f2406d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f400c7e00 0x7f9f40147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 --2- 172.21.15.45:0/2921436336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f400bd590 0x7f9f401471e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 >> 172.21.15.45:0/2921436336 conn(0x7f9f400663d0 msgr2=0x7f9f400667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 shutdown_connections 2023-11-18T19:07:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.053+0000 7f9f48533640 1 -- 172.21.15.45:0/2921436336 wait complete. 2023-11-18T19:07:04.076 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-18T19:07:04.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:07:04.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.307+0000 7fc20fede640 1 Processor -- start 2023-11-18T19:07:04.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.307+0000 7fc20fede640 1 -- start start 2023-11-18T19:07:04.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.309+0000 7fc20fede640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 0x7fc2080a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.309+0000 7fc20fede640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2080a5270 con 0x7fc2080c4fc0 2023-11-18T19:07:04.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.309+0000 7fc20fede640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2080a54a0 con 0x7fc2080c5440 2023-11-18T19:07:04.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.309+0000 7fc20fede640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20806d5d0 con 0x7fc20814c4e0 2023-11-18T19:07:04.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.309+0000 7fc20d479640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc2080c4fc0 0x7fc208152320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46886/0 (socket says 172.21.15.45:46886) 2023-11-18T19:07:04.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.309+0000 7fc20d479640 1 -- 172.21.15.45:0/3985455174 learned_addr learned my addr 172.21.15.45:0/3985455174 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.309+0000 7fc20dc7a640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 0x7fc2080a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802851320 0 0) 0x7fc2080a5270 con 0x7fc2080c4fc0 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f4003520 con 0x7fc2080c4fc0 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4218739026 0 0) 0x7fc1f4003520 con 0x7fc2080c4fc0 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 msgr2=0x7fc2080a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 0x7fc2080a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 >> v1:172.21.15.135:6789/0 conn(0x7fc2080c5440 legacy=0x7fc208152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20806d8b0 con 0x7fc2080c4fc0 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fc1f8001670 con 0x7fc2080c4fc0 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 >> v1:172.21.15.45:6789/0 conn(0x7fc2080c4fc0 legacy=0x7fc208152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40039a0 0x7fc1f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f40047c0 0x7fc1f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 0x7fc1f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20806d5d0 con 0x7fc1f40047c0 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f400ba60 con 0x7fc1f40039a0 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.310+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f400bc20 con 0x7fc20814c4e0 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20d479640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f40047c0 0x7fc1f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20dc7a640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40039a0 0x7fc1f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20e47b640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 0x7fc1f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20d479640 1 -- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 msgr2=0x7fc1f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20d479640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 0x7fc1f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20d479640 1 -- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40039a0 msgr2=0x7fc1f4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20d479640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40039a0 0x7fc1f4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20d479640 1 -- 172.21.15.45:0/3985455174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4003520 con 0x7fc1f40047c0 2023-11-18T19:07:04.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.311+0000 7fc20e47b640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc20814c4e0 0x7fc1f4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.313+0000 7fc20d479640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f40047c0 0x7fc1f4004c40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8001eb0 tx=0x7fc1f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec6b54a943629e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.313+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8005ad0 con 0x7fc1f40047c0 2023-11-18T19:07:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.313+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8005c30 con 0x7fc1f40047c0 2023-11-18T19:07:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.313+0000 7fc20cc78640 1 -- 172.21.15.45:0/3985455174 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f802c7c0 con 0x7fc1f40047c0 2023-11-18T19:07:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.314+0000 7fc20fede640 1 -- 172.21.15.45:0/3985455174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f40047c0 msgr2=0x7fc1f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.314+0000 7fc20fede640 1 --2- 172.21.15.45:0/3985455174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f40047c0 0x7fc1f4004c40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8001eb0 tx=0x7fc1f40057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.314+0000 7fc20e47b640 1 -- 172.21.15.45:0/3985455174 reap_dead start 2023-11-18T19:07:04.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.314+0000 7fc20fede640 1 -- 172.21.15.45:0/3985455174 shutdown_connections 2023-11-18T19:07:04.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.314+0000 7fc20fede640 1 -- 172.21.15.45:0/3985455174 >> 172.21.15.45:0/3985455174 conn(0x7fc20806a500 msgr2=0x7fc20806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.314+0000 7fc20fede640 1 -- 172.21.15.45:0/3985455174 shutdown_connections 2023-11-18T19:07:04.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.314+0000 7fc20fede640 1 -- 172.21.15.45:0/3985455174 wait complete. 2023-11-18T19:07:04.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.316+0000 7fc20fede640 1 Processor -- start 2023-11-18T19:07:04.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.316+0000 7fc20fede640 1 -- start start 2023-11-18T19:07:04.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.317+0000 7fc20fede640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40047c0 0x7fc208072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.317+0000 7fc20fede640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2080aa480 0x7fc2081510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.317+0000 7fc20fede640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc208144bf0 0x7fc208145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.317+0000 7fc20fede640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20806ff30 con 0x7fc2080aa480 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.317+0000 7fc20fede640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc208070c60 con 0x7fc1f40047c0 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.317+0000 7fc20fede640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2081519a0 con 0x7fc208144bf0 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2080aa480 0x7fc2081510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2080aa480 0x7fc2081510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37792/0 (socket says 172.21.15.45:37792) 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 -- 172.21.15.45:0/1716461427 learned_addr learned my addr 172.21.15.45:0/1716461427 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20dc7a640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40047c0 0x7fc208072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20e47b640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc208144bf0 0x7fc208145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 -- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc208144bf0 msgr2=0x7fc208145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc208144bf0 0x7fc208145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 -- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40047c0 msgr2=0x7fc208072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40047c0 0x7fc208072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20d479640 1 -- 172.21.15.45:0/1716461427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208070180 con 0x7fc2080aa480 2023-11-18T19:07:04.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20dc7a640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40047c0 0x7fc208072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:04.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.318+0000 7fc20e47b640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc208144bf0 0x7fc208145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.319+0000 7fc20d479640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2080aa480 0x7fc2081510e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc1f802c360 tx=0x7fc1f8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.319+0000 7fc1fe7fc640 1 -- 172.21.15.45:0/1716461427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f803c040 con 0x7fc2080aa480 2023-11-18T19:07:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.319+0000 7fc1fe7fc640 1 -- 172.21.15.45:0/1716461427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f802cbd0 con 0x7fc2080aa480 2023-11-18T19:07:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.319+0000 7fc1fe7fc640 1 -- 172.21.15.45:0/1716461427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8007070 con 0x7fc2080aa480 2023-11-18T19:07:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.319+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc208070460 con 0x7fc2080aa480 2023-11-18T19:07:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.319+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2080729d0 con 0x7fc2080aa480 2023-11-18T19:07:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.320+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc208067940 con 0x7fc2080aa480 2023-11-18T19:07:04.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.321+0000 7fc1fe7fc640 1 -- 172.21.15.45:0/1716461427 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1f8032070 con 0x7fc2080aa480 2023-11-18T19:07:04.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.323+0000 7fc1fe7fc640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1ec06ae70 0x7fc1ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.323+0000 7fc1fe7fc640 1 -- 172.21.15.45:0/1716461427 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1f80aaa10 con 0x7fc2080aa480 2023-11-18T19:07:04.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.323+0000 7fc20dc7a640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1ec06ae70 0x7fc1ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.324+0000 7fc20dc7a640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1ec06ae70 0x7fc1ec06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc2080a4d20 tx=0x7fc204008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.327+0000 7fc1fe7fc640 1 -- 172.21.15.45:0/1716461427 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1f80757c0 con 0x7fc2080aa480 2023-11-18T19:07:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.523+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2080747c0 con 0x7fc2080aa480 2023-11-18T19:07:04.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.527+0000 7fc1fe7fc640 1 -- 172.21.15.45:0/1716461427 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7fc1f8046090 con 0x7fc2080aa480 2023-11-18T19:07:04.528 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:04.529 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:07:04.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.529+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1ec06ae70 msgr2=0x7fc1ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.529+0000 7fc20fede640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1ec06ae70 0x7fc1ec06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc2080a4d20 tx=0x7fc204008040 comp rx=0 tx=0).stop 2023-11-18T19:07:04.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2080aa480 msgr2=0x7fc2081510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2080aa480 0x7fc2081510e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc1f802c360 tx=0x7fc1f8001930 comp rx=0 tx=0).stop 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 shutdown_connections 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1ec06ae70 0x7fc1ec06d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc208144bf0 0x7fc208145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2080aa480 0x7fc2081510e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 --2- 172.21.15.45:0/1716461427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40047c0 0x7fc208072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 >> 172.21.15.45:0/1716461427 conn(0x7fc20806a500 msgr2=0x7fc208149a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 shutdown_connections 2023-11-18T19:07:04.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.530+0000 7fc20fede640 1 -- 172.21.15.45:0/1716461427 wait complete. 2023-11-18T19:07:04.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-18T19:07:04.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-18T19:07:04.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-18T19:07:04.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-18T19:07:04.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-18T19:07:04.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-18T19:07:04.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-18T19:07:04.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-18T19:07:04.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.860+0000 7f5206e6f640 1 Processor -- start 2023-11-18T19:07:04.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.860+0000 7f5206e6f640 1 -- start start 2023-11-18T19:07:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.862+0000 7f5206e6f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f520006e020 0x7f52001588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.864+0000 7f625fd90640 1 Processor -- start 2023-11-18T19:07:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.862+0000 7f5206e6f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000aa3c0 con 0x7f52000a8b70 2023-11-18T19:07:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.862+0000 7f5206e6f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000ab0d0 con 0x7f5200156050 2023-11-18T19:07:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.862+0000 7f5206e6f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000aac40 con 0x7f520006e020 2023-11-18T19:07:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.863+0000 7f5204c0b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f5200156050 0x7f52000c4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:37232/0 (socket says 172.21.15.45:37232) 2023-11-18T19:07:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.863+0000 7f5204c0b640 1 -- 172.21.15.45:0/134493058 learned_addr learned my addr 172.21.15.45:0/134493058 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.863+0000 7f51f7fff640 1 --2- 172.21.15.45:0/134493058 >> v2:172.21.15.135:3300/0 conn(0x7f520006e020 0x7f52001588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.864+0000 7f51fffff640 1 -- 172.21.15.45:0/134493058 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101018575 0 0) 0x7f51e8001110 con 0x7f5200156050 2023-11-18T19:07:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.864+0000 7f51fffff640 1 -- 172.21.15.45:0/134493058 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec003520 con 0x7f5200156050 2023-11-18T19:07:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.865+0000 7f51f7fff640 1 -- 172.21.15.45:0/134493058 >> v1:172.21.15.135:6789/0 conn(0x7f5200156050 legacy=0x7f52000c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.865+0000 7f51f7fff640 1 -- 172.21.15.45:0/134493058 >> v1:172.21.15.45:6789/0 conn(0x7f52000a8b70 legacy=0x7f5200158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.865+0000 7f51f7fff640 1 -- 172.21.15.45:0/134493058 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52000724a0 con 0x7f520006e020 2023-11-18T19:07:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.864+0000 7f625fd90640 1 -- start start 2023-11-18T19:07:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.866+0000 7f625fd90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500d3c00 0x7f625004ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.866+0000 7f625fd90640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6250047620 con 0x7f625004b170 2023-11-18T19:07:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.866+0000 7f625fd90640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62500d6590 con 0x7f62500dec80 2023-11-18T19:07:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.866+0000 7f625fd90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6250046540 con 0x7f62500d3c00 2023-11-18T19:07:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.867+0000 7f625d32b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f625004b170 0x7f62500d6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46896/0 (socket says 172.21.15.45:46896) 2023-11-18T19:07:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.867+0000 7f625db2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500d3c00 0x7f625004ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.867+0000 7f625db2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500d3c00 0x7f625004ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50318/0 (socket says 172.21.15.45:50318) 2023-11-18T19:07:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.867+0000 7f625db2c640 1 -- 172.21.15.45:0/3835594809 learned_addr learned my addr 172.21.15.45:0/3835594809 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.868+0000 7f51f7fff640 1 --2- 172.21.15.45:0/134493058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f520006e020 0x7f52001588b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009d90 tx=0x7f51f002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72a5623ec516610e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.868+0000 7f51fffff640 1 -- 172.21.15.45:0/134493058 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f002cbd0 con 0x7f520006e020 2023-11-18T19:07:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.868+0000 7f625db2c640 1 -- 172.21.15.45:0/3835594809 >> v1:172.21.15.135:6789/0 conn(0x7f62500dec80 legacy=0x7f62500e1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.869+0000 7f51fffff640 1 -- 172.21.15.45:0/134493058 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f002cd30 con 0x7f520006e020 2023-11-18T19:07:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.869+0000 7f625cb2a640 1 -- 172.21.15.45:0/3835594809 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902647869 0 0) 0x7f62500d6590 con 0x7f62500dec80 2023-11-18T19:07:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.869+0000 7f51fffff640 1 -- 172.21.15.45:0/134493058 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f002cea0 con 0x7f520006e020 2023-11-18T19:07:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.869+0000 7f625db2c640 1 -- 172.21.15.45:0/3835594809 >> v1:172.21.15.45:6789/0 conn(0x7f625004b170 legacy=0x7f62500d6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.869+0000 7f625db2c640 1 -- 172.21.15.45:0/3835594809 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250046890 con 0x7f62500d3c00 2023-11-18T19:07:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.870+0000 7f5206e6f640 1 -- 172.21.15.45:0/134493058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f520006e020 msgr2=0x7f52001588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.870+0000 7f5206e6f640 1 --2- 172.21.15.45:0/134493058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f520006e020 0x7f52001588b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009d90 tx=0x7f51f002be20 comp rx=0 tx=0).stop 2023-11-18T19:07:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.870+0000 7f5206e6f640 1 -- 172.21.15.45:0/134493058 shutdown_connections 2023-11-18T19:07:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.870+0000 7f5206e6f640 1 --2- 172.21.15.45:0/134493058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f520006e020 0x7f52001588b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.870+0000 7f5206e6f640 1 -- 172.21.15.45:0/134493058 >> 172.21.15.45:0/134493058 conn(0x7f52000a7870 msgr2=0x7f52000a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.871+0000 7f5206e6f640 1 -- 172.21.15.45:0/134493058 shutdown_connections 2023-11-18T19:07:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.871+0000 7f5206e6f640 1 -- 172.21.15.45:0/134493058 wait complete. 2023-11-18T19:07:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.871+0000 7f625db2c640 1 --2- 172.21.15.45:0/3835594809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500d3c00 0x7f625004ac30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f62480098a0 tx=0x7f624802b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a1b987b0b3b038 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.872+0000 7f625cb2a640 1 -- 172.21.15.45:0/3835594809 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248004230 con 0x7f62500d3c00 2023-11-18T19:07:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.872+0000 7f625cb2a640 1 -- 172.21.15.45:0/3835594809 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624802e050 con 0x7f62500d3c00 2023-11-18T19:07:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.872+0000 7f625cb2a640 1 -- 172.21.15.45:0/3835594809 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248003610 con 0x7f62500d3c00 2023-11-18T19:07:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.873+0000 7f625fd90640 1 -- 172.21.15.45:0/3835594809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500d3c00 msgr2=0x7f625004ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.873+0000 7f625fd90640 1 --2- 172.21.15.45:0/3835594809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500d3c00 0x7f625004ac30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f62480098a0 tx=0x7f624802b7e0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.874+0000 7f625fd90640 1 -- 172.21.15.45:0/3835594809 shutdown_connections 2023-11-18T19:07:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.874+0000 7f625fd90640 1 --2- 172.21.15.45:0/3835594809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500d3c00 0x7f625004ac30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.874+0000 7f625fd90640 1 -- 172.21.15.45:0/3835594809 >> 172.21.15.45:0/3835594809 conn(0x7f6250005e50 msgr2=0x7f6250006260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.874+0000 7f625fd90640 1 -- 172.21.15.45:0/3835594809 shutdown_connections 2023-11-18T19:07:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.874+0000 7f16d2f16640 1 Processor -- start 2023-11-18T19:07:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.874+0000 7f16d2f16640 1 -- start start 2023-11-18T19:07:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.875+0000 7f625fd90640 1 -- 172.21.15.45:0/3835594809 wait complete. 2023-11-18T19:07:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.875+0000 7f5206e6f640 1 Processor -- start 2023-11-18T19:07:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.876+0000 7f5206e6f640 1 -- start start 2023-11-18T19:07:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.876+0000 7f16d2f16640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16c40dbcb0 0x7f16c4047470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.876+0000 7f16d2f16640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c400a3f0 con 0x7f16c400a880 2023-11-18T19:07:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.876+0000 7f16d2f16640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c400bb20 con 0x7f16c40df150 2023-11-18T19:07:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.876+0000 7f16d2f16640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c4048030 con 0x7f16c40dbcb0 2023-11-18T19:07:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f16d1f14640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16c40dbcb0 0x7f16c4047470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f5206e6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520006e020 0x7f52001f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f5206e6f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52000a8b70 0x7f520006c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f5206e6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200156050 0x7f52001edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f5206e6f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520015bf40 con 0x7f520006e020 2023-11-18T19:07:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f5206e6f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52001f24e0 con 0x7f5200156050 2023-11-18T19:07:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f5206e6f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52001f1550 con 0x7f52000a8b70 2023-11-18T19:07:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f16d1f14640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16c40dbcb0 0x7f16c4047470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37808/0 (socket says 172.21.15.45:37808) 2023-11-18T19:07:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.877+0000 7f16d1f14640 1 -- 172.21.15.45:0/2231186836 learned_addr learned my addr 172.21.15.45:0/2231186836 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.878+0000 7f5204c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520006e020 0x7f52001f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.878+0000 7f5204c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520006e020 0x7f52001f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37818/0 (socket says 172.21.15.45:37818) 2023-11-18T19:07:04.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.878+0000 7f5204c0b640 1 -- 172.21.15.45:0/921286394 learned_addr learned my addr 172.21.15.45:0/921286394 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f520540c640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200156050 0x7f52001edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f51f7fff640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52000a8b70 0x7f520006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f625fd90640 1 Processor -- start 2023-11-18T19:07:04.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.880+0000 7f625fd90640 1 -- start start 2023-11-18T19:07:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.880+0000 7f51f7fff640 1 -- 172.21.15.45:0/921286394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200156050 msgr2=0x7f52001edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.880+0000 7f51f7fff640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200156050 0x7f52001edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.880+0000 7f51f7fff640 1 -- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520006e020 msgr2=0x7f52001f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.880+0000 7f51f7fff640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520006e020 0x7f52001f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.880+0000 7f51f7fff640 1 -- 172.21.15.45:0/921286394 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009a70 con 0x7f52000a8b70 2023-11-18T19:07:04.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.878+0000 7f85aa4e0640 1 Processor -- start 2023-11-18T19:07:04.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f85aa4e0640 1 -- start start 2023-11-18T19:07:04.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f51f7fff640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52000a8b70 0x7f520006c740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f52000a84f0 tx=0x7f51f0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f625fd90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f625004b170 0x7f62500dc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f625fd90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62500d3c00 0x7f62500d8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f625fd90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500dec80 0x7f6250030170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f625fd90640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500dd590 con 0x7f625004b170 2023-11-18T19:07:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f625fd90640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500ddac0 con 0x7f62500d3c00 2023-11-18T19:07:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f625fd90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62500d8c10 con 0x7f62500dec80 2023-11-18T19:07:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f85aa4e0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f85a41563e0 0x7f85a40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f85aa4e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85aa4e0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85a40ca850 0x7f85a4159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f16d1f14640 1 -- 172.21.15.45:0/2231186836 >> v1:172.21.15.135:6789/0 conn(0x7f16c40df150 legacy=0x7f16c4006e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f16d1f14640 1 -- 172.21.15.45:0/2231186836 >> v1:172.21.15.45:6789/0 conn(0x7f16c400a880 legacy=0x7f16c400acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85aa4e0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a415d1c0 con 0x7f85a40ca850 2023-11-18T19:07:04.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f16d1f14640 1 -- 172.21.15.45:0/2231186836 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c400a0c0 con 0x7f16c40dbcb0 2023-11-18T19:07:04.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.881+0000 7f16d1f14640 1 --2- 172.21.15.45:0/2231186836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 0x7f16c4047470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009870 tx=0x7f16bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2ebf0b2f49f3b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.879+0000 7f16d0f12640 1 -- 172.21.15.45:0/2231186836 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669327692 0 0) 0x7f16c400bb20 con 0x7f16c40df150 2023-11-18T19:07:04.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85aa4e0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a41567c0 con 0x7f85a41563e0 2023-11-18T19:07:04.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85aa4e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a4158cd0 con 0x7f85a40c7f30 2023-11-18T19:07:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f002cea0 con 0x7f52000a8b70 2023-11-18T19:07:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f003e610 con 0x7f52000a8b70 2023-11-18T19:07:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f003e9a0 con 0x7f52000a8b70 2023-11-18T19:07:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f625db2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f625004b170 0x7f62500dc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f625db2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f625004b170 0x7f62500dc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37834/0 (socket says 172.21.15.45:37834) 2023-11-18T19:07:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f625db2c640 1 -- 172.21.15.45:0/4049225213 learned_addr learned my addr 172.21.15.45:0/4049225213 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85a3fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f85a41563e0 0x7f85a40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85a8a7d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85a40ca850 0x7f85a4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85a8a7d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85a40ca850 0x7f85a4159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37850/0 (socket says 172.21.15.45:37850) 2023-11-18T19:07:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85a8a7d640 1 -- 172.21.15.45:0/1871391844 learned_addr learned my addr 172.21.15.45:0/1871391844 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f85a37fe640 1 --2- 172.21.15.45:0/1871391844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.882+0000 7f625e32d640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500dec80 0x7f6250030170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f625d32b640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62500d3c00 0x7f62500d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f16d0f12640 1 -- 172.21.15.45:0/2231186836 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc031870 con 0x7f16c40dbcb0 2023-11-18T19:07:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f16d0f12640 1 -- 172.21.15.45:0/2231186836 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0319d0 con 0x7f16c40dbcb0 2023-11-18T19:07:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f5206e6f640 1 -- 172.21.15.45:0/921286394 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520015c370 con 0x7f52000a8b70 2023-11-18T19:07:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f16d0f12640 1 -- 172.21.15.45:0/2231186836 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc031d60 con 0x7f16c40dbcb0 2023-11-18T19:07:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f5206e6f640 1 -- 172.21.15.45:0/921286394 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52001f17a0 con 0x7f52000a8b70 2023-11-18T19:07:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f625db2c640 1 -- 172.21.15.45:0/4049225213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500dec80 msgr2=0x7f6250030170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f625db2c640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62500dec80 0x7f6250030170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f625db2c640 1 -- 172.21.15.45:0/4049225213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62500d3c00 msgr2=0x7f62500d8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f625db2c640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62500d3c00 0x7f62500d8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.883+0000 7f625db2c640 1 -- 172.21.15.45:0/4049225213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480094d0 con 0x7f625004b170 2023-11-18T19:07:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f625db2c640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f625004b170 0x7f62500dc8a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f62480090b0 tx=0x7f62480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f16d2f16640 1 -- 172.21.15.45:0/2231186836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 msgr2=0x7f16c4047470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f16d2f16640 1 --2- 172.21.15.45:0/2231186836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 0x7f16c4047470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009870 tx=0x7f16bc02b910 comp rx=0 tx=0).stop 2023-11-18T19:07:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f85a37fe640 1 -- 172.21.15.45:0/1871391844 >> v2:172.21.15.135:3300/0 conn(0x7f85a41563e0 msgr2=0x7f85a40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f85a37fe640 1 --2- 172.21.15.45:0/1871391844 >> v2:172.21.15.135:3300/0 conn(0x7f85a41563e0 0x7f85a40ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f85a37fe640 1 -- 172.21.15.45:0/1871391844 >> v2:172.21.15.45:3300/0 conn(0x7f85a40ca850 msgr2=0x7f85a4159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f85a37fe640 1 --2- 172.21.15.45:0/1871391844 >> v2:172.21.15.45:3300/0 conn(0x7f85a40ca850 0x7f85a4159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f85a37fe640 1 -- 172.21.15.45:0/1871391844 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40c8ac0 con 0x7f85a40c7f30 2023-11-18T19:07:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.884+0000 7f85a3fff640 1 --2- 172.21.15.45:0/1871391844 >> v2:172.21.15.135:3300/0 conn(0x7f85a41563e0 0x7f85a40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51d8000fc0 con 0x7f52000a8b70 2023-11-18T19:07:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248030710 con 0x7f625004b170 2023-11-18T19:07:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6248030890 con 0x7f625004b170 2023-11-18T19:07:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248030c40 con 0x7f625004b170 2023-11-18T19:07:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f16d2f16640 1 -- 172.21.15.45:0/2231186836 shutdown_connections 2023-11-18T19:07:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f16d2f16640 1 --2- 172.21.15.45:0/2231186836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 0x7f16c4047470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f16d2f16640 1 -- 172.21.15.45:0/2231186836 >> 172.21.15.45:0/2231186836 conn(0x7f16c4048220 msgr2=0x7f16c4048630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62500dd7e0 con 0x7f625004b170 2023-11-18T19:07:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f16d2f16640 1 -- 172.21.15.45:0/2231186836 shutdown_connections 2023-11-18T19:07:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62500dc0a0 con 0x7f625004b170 2023-11-18T19:07:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.886+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6250009680 con 0x7f625004b170 2023-11-18T19:07:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.885+0000 7f16d2f16640 1 -- 172.21.15.45:0/2231186836 wait complete. 2023-11-18T19:07:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.887+0000 7f85a37fe640 1 --2- 172.21.15.45:0/1871391844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41590e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85a40c7af0 tx=0x7f859c02b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bdb8a30452edce0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.888+0000 7f85a2ffd640 1 -- 172.21.15.45:0/1871391844 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c031710 con 0x7f85a40c7f30 2023-11-18T19:07:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.888+0000 7f85a2ffd640 1 -- 172.21.15.45:0/1871391844 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c02f050 con 0x7f85a40c7f30 2023-11-18T19:07:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.888+0000 7f85a2ffd640 1 -- 172.21.15.45:0/1871391844 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c031a90 con 0x7f85a40c7f30 2023-11-18T19:07:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.888+0000 7f16d2f16640 1 Processor -- start 2023-11-18T19:07:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.887+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51f003b050 con 0x7f52000a8b70 2023-11-18T19:07:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f16d2f16640 1 -- start start 2023-11-18T19:07:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f51fdffb640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f51e006ae90 0x7f51e006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f85aa4e0640 1 -- 172.21.15.45:0/1871391844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 msgr2=0x7f85a41590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f85aa4e0640 1 --2- 172.21.15.45:0/1871391844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41590e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85a40c7af0 tx=0x7f859c02b7b0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51f00ac3a0 con 0x7f52000a8b70 2023-11-18T19:07:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6248039040 con 0x7f625004b170 2023-11-18T19:07:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f51fdffb640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f51e00744d0 0x7f51e0076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 --> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51e0076fe0 con 0x7f51e00744d0 2023-11-18T19:07:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f85aa4e0640 1 -- 172.21.15.45:0/1871391844 shutdown_connections 2023-11-18T19:07:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f85aa4e0640 1 --2- 172.21.15.45:0/1871391844 >> v2:172.21.15.45:3300/0 conn(0x7f85a40ca850 0x7f85a4159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f85aa4e0640 1 --2- 172.21.15.45:0/1871391844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41590e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f85aa4e0640 1 --2- 172.21.15.45:0/1871391844 >> v2:172.21.15.135:3300/0 conn(0x7f85a41563e0 0x7f85a40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f85aa4e0640 1 -- 172.21.15.45:0/1871391844 >> 172.21.15.45:0/1871391844 conn(0x7f85a40663d0 msgr2=0x7f85a40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f85aa4e0640 1 -- 172.21.15.45:0/1871391844 shutdown_connections 2023-11-18T19:07:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f85aa4e0640 1 -- 172.21.15.45:0/1871391844 wait complete. 2023-11-18T19:07:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.890+0000 7f624e7fc640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f623c06ae90 0x7f623c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.889+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51f00ac840 con 0x7f52000a8b70 2023-11-18T19:07:04.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.891+0000 7f16d2f16640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c400a880 0x7f16c4045850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.891+0000 7f16d2f16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 0x7f16c40e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.891+0000 7f16d2f16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40df150 0x7f16c4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.891+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62480aba90 con 0x7f625004b170 2023-11-18T19:07:04.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.891+0000 7f520540c640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f51e00744d0 0x7f51e0076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f16d2f16640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c4041db0 con 0x7f16c40dbcb0 2023-11-18T19:07:04.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f16d1f14640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c400a880 0x7f16c4045850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f16d1f14640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c400a880 0x7f16c4045850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50356/0 (socket says 172.21.15.45:50356) 2023-11-18T19:07:04.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f16d1f14640 1 -- 172.21.15.45:0/3348925220 learned_addr learned my addr 172.21.15.45:0/3348925220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40d86a0 con 0x7f16c40df150 2023-11-18T19:07:04.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c4045200 con 0x7f16c400a880 2023-11-18T19:07:04.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f5204c0b640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f51e006ae90 0x7f51e006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f16d2715640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40df150 0x7f16c4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f625d32b640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f623c06ae90 0x7f623c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.892+0000 7f520540c640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f51e00744d0 0x7f51e0076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.893+0000 7f16d1713640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 0x7f16c40e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.893+0000 7f85aa4e0640 1 Processor -- start 2023-11-18T19:07:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.893+0000 7f5204c0b640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f51e006ae90 0x7f51e006d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001370 tx=0x7f51e8007c70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.893+0000 7f16d2715640 1 -- 172.21.15.45:0/3348925220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c400a880 msgr2=0x7f16c4045850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f16d2715640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c400a880 0x7f16c4045850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f85aa4e0640 1 -- start start 2023-11-18T19:07:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f16d2715640 1 -- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 msgr2=0x7f16c40e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f16d2715640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 0x7f16c40e0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f16d2715640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0094d0 con 0x7f16c40df150 2023-11-18T19:07:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f16d1f14640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16c400a880 0x7f16c4045850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f16d1713640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16c40dbcb0 0x7f16c40e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== osd.0 v2:172.21.15.45:6800/2175017614 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f51e0076fe0 con 0x7f51e00744d0 2023-11-18T19:07:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f624e7fc640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f623c0744d0 0x7f623c076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f66198e7640 1 Processor -- start 2023-11-18T19:07:04.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f66198e7640 1 -- start start 2023-11-18T19:07:04.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f85aa4e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f625e32d640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f623c0744d0 0x7f623c076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 --> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f623c076fe0 con 0x7f623c0744d0 2023-11-18T19:07:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f85aa4e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a40ca850 0x7f85a40c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f625d32b640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f623c06ae90 0x7f623c06d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6254007fd0 tx=0x7f6254007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.894+0000 7f16d2715640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40df150 0x7f16c4040f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16cc064320 tx=0x7f16cc067f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc06bc60 con 0x7f16c40df150 2023-11-18T19:07:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc06bde0 con 0x7f16c40df150 2023-11-18T19:07:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc072400 con 0x7f16c40df150 2023-11-18T19:07:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c40d88f0 con 0x7f16c40df150 2023-11-18T19:07:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.895+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c403ff90 con 0x7f16c40df150 2023-11-18T19:07:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f85aa4e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a41563e0 0x7f85a40c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f85aa4e0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a415aaa0 con 0x7f85a40ca850 2023-11-18T19:07:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f85aa4e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40c35d0 con 0x7f85a41563e0 2023-11-18T19:07:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f85aa4e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a4159e90 con 0x7f85a40c7f30 2023-11-18T19:07:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f85a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a40ca850 0x7f85a40c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62480abf30 con 0x7f625004b170 2023-11-18T19:07:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.896+0000 7f625e32d640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f623c0744d0 0x7f623c076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a40ca850 0x7f85a40c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37864/0 (socket says 172.21.15.45:37864) 2023-11-18T19:07:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a37fe640 1 -- 172.21.15.45:0/3613622570 learned_addr learned my addr 172.21.15.45:0/3613622570 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a8a7d640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a41563e0 0x7f85a40c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a37fe640 1 -- 172.21.15.45:0/3613622570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 msgr2=0x7f85a41525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a37fe640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85a40c7f30 0x7f85a41525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f66198e7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66140a4d40 0x7f6614150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f66198e7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66140c0f00 0x7f66141514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f66198e7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66140c1cf0 con 0x7f66140a8470 2023-11-18T19:07:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f66198e7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66140c3c00 con 0x7f66140a4d40 2023-11-18T19:07:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f66198e7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66140c1f20 con 0x7f66140c0f00 2023-11-18T19:07:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a37fe640 1 -- 172.21.15.45:0/3613622570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a41563e0 msgr2=0x7f85a40c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a37fe640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85a41563e0 0x7f85a40c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.897+0000 7f85a37fe640 1 -- 172.21.15.45:0/3613622570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c009400 con 0x7f85a40ca850 2023-11-18T19:07:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.898+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== osd.1 v2:172.21.15.45:6816/370738576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f623c076fe0 con 0x7f623c0744d0 2023-11-18T19:07:04.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.898+0000 7f66137fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66140c0f00 0x7f66141514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.898+0000 7f66127fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66140a4d40 0x7f6614150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.898+0000 7f66137fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66140c0f00 0x7f66141514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42734/0 (socket says 172.21.15.45:42734) 2023-11-18T19:07:04.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.898+0000 7f66137fe640 1 -- 172.21.15.45:0/3147462795 learned_addr learned my addr 172.21.15.45:0/3147462795 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.898+0000 7fd2b759e640 1 Processor -- start 2023-11-18T19:07:04.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.898+0000 7f85a37fe640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a40ca850 0x7f85a40c3cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f859c02bdc0 tx=0x7f859c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.899+0000 7fcebe790640 1 Processor -- start 2023-11-18T19:07:04.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.899+0000 7f66137fe640 1 -- 172.21.15.45:0/3147462795 >> v2:172.21.15.45:3300/0 conn(0x7f66140a4d40 msgr2=0x7f6614150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.899+0000 7fd2b759e640 1 -- start start 2023-11-18T19:07:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.899+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c03d880 con 0x7f85a40ca850 2023-11-18T19:07:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7f66137fe640 1 --2- 172.21.15.45:0/3147462795 >> v2:172.21.15.45:3300/0 conn(0x7f66140a4d40 0x7f6614150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7f66137fe640 1 -- 172.21.15.45:0/3147462795 >> v1:172.21.15.135:6789/0 conn(0x7f66140a8470 legacy=0x7f661406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7f66137fe640 1 -- 172.21.15.45:0/3147462795 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66140c2200 con 0x7f66140c0f00 2023-11-18T19:07:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7fd2b759e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b806b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7fd2b759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2b80c0e40 0x7fd2b806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.899+0000 7fcebe790640 1 -- start start 2023-11-18T19:07:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fcebe790640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb806c840 0x7fceb80c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fcebe790640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fceb8155430 0x7fceb80ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fcebe790640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80c4ef0 con 0x7fceb814e8b0 2023-11-18T19:07:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fcebe790640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb8155010 con 0x7fceb8155430 2023-11-18T19:07:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fcebe790640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80c5400 con 0x7fceb806c840 2023-11-18T19:07:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c009400 con 0x7f85a40ca850 2023-11-18T19:07:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a415a450 con 0x7f85a40ca850 2023-11-18T19:07:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.900+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c03d9e0 con 0x7f85a40ca850 2023-11-18T19:07:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c03d880 con 0x7f85a40ca850 2023-11-18T19:07:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fceb7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fceb814e8b0 0x7fceb8157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46940/0 (socket says 172.21.15.45:46940) 2023-11-18T19:07:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fceb7fff640 1 -- 172.21.15.45:0/193374581 learned_addr learned my addr 172.21.15.45:0/193374581 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fd2b759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b80c2240 con 0x7fd2b806c9e0 2023-11-18T19:07:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fd2b759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b8072af0 con 0x7fd2b80c0e40 2023-11-18T19:07:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7fd2b759e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b806bf90 con 0x7fd2b8155df0 2023-11-18T19:07:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7f66127fc640 1 --2- 172.21.15.45:0/3147462795 >> v2:172.21.15.45:3300/0 conn(0x7f66140a4d40 0x7f6614150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.902+0000 7fceaf7fe640 1 --2- 172.21.15.45:0/193374581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb806c840 0x7fceb80c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.901+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16cc072620 con 0x7f16c40df150 2023-11-18T19:07:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.902+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16c40dc090 con 0x7f16c40df150 2023-11-18T19:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.902+0000 7f16c27fc640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16b006af10 0x7f16b006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16cc103380 con 0x7f16c40df150 2023-11-18T19:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7f16d1f14640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16b006af10 0x7f16b006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7f16c27fc640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7f16b00744d0 0x7f16b0076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16b0076fe0 con 0x7f16b00744d0 2023-11-18T19:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16cc0cdf50 con 0x7f16c40df150 2023-11-18T19:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.902+0000 7fd2b659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b806b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fd2b659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b806b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50374/0 (socket says 172.21.15.45:50374) 2023-11-18T19:07:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fd2b659c640 1 -- 172.21.15.45:0/3872337544 learned_addr learned my addr 172.21.15.45:0/3872337544 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fceaf7fe640 1 -- 172.21.15.45:0/193374581 >> v2:172.21.15.45:3300/0 conn(0x7fceb8155430 msgr2=0x7fceb80ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fceaf7fe640 1 --2- 172.21.15.45:0/193374581 >> v2:172.21.15.45:3300/0 conn(0x7fceb8155430 0x7fceb80ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fceaf7fe640 1 -- 172.21.15.45:0/193374581 >> v1:172.21.15.45:6789/0 conn(0x7fceb814e8b0 legacy=0x7fceb8157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fceaf7fe640 1 -- 172.21.15.45:0/193374581 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80c6350 con 0x7fceb806c840 2023-11-18T19:07:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fd2b5d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2b80c0e40 0x7fd2b806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.903+0000 7fd2b6d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2b806c9e0 0x7fd2b80c39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46926/0 (socket says 172.21.15.45:46926) 2023-11-18T19:07:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.905+0000 7fceaf7fe640 1 --2- 172.21.15.45:0/193374581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb806c840 0x7fceb80c49b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcea00097a0 tx=0x7fcea002b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b431eb3da35c6b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.904+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8588000fc0 con 0x7f85a40ca850 2023-11-18T19:07:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.905+0000 7f16d1713640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7f16b00744d0 0x7f16b0076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.905+0000 7f66137fe640 1 --2- 172.21.15.45:0/3147462795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140c0f00 0x7f66141514a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66140a4cd0 tx=0x7f660c02b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=324b4a1810ae69d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.904+0000 7fd2b659c640 1 -- 172.21.15.45:0/3872337544 >> v2:172.21.15.45:3300/0 conn(0x7fd2b80c0e40 msgr2=0x7fd2b806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.904+0000 7fd2b659c640 1 --2- 172.21.15.45:0/3872337544 >> v2:172.21.15.45:3300/0 conn(0x7fd2b80c0e40 0x7fd2b806c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.904+0000 7fd2b659c640 1 -- 172.21.15.45:0/3872337544 >> v1:172.21.15.45:6789/0 conn(0x7fd2b806c9e0 legacy=0x7fd2b80c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.904+0000 7fd2b659c640 1 -- 172.21.15.45:0/3872337544 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b815c8b0 con 0x7fd2b8155df0 2023-11-18T19:07:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.905+0000 7fceb77fe640 1 -- 172.21.15.45:0/193374581 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0030710 con 0x7fceb806c840 2023-11-18T19:07:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f859c03a040 con 0x7f85a40ca850 2023-11-18T19:07:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7fceb77fe640 1 -- 172.21.15.45:0/193374581 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea002e050 con 0x7fceb806c840 2023-11-18T19:07:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7fceb77fe640 1 -- 172.21.15.45:0/193374581 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0030ad0 con 0x7fceb806c840 2023-11-18T19:07:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f6611ffb640 1 -- 172.21.15.45:0/3147462795 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c030710 con 0x7f66140c0f00 2023-11-18T19:07:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f6611ffb640 1 -- 172.21.15.45:0/3147462795 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c02e050 con 0x7f66140c0f00 2023-11-18T19:07:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f6611ffb640 1 -- 172.21.15.45:0/3147462795 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c030a90 con 0x7f66140c0f00 2023-11-18T19:07:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f16d1f14640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16b006af10 0x7f16b006d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16bc02b950 tx=0x7f16bc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f207ab0f640 1 Processor -- start 2023-11-18T19:07:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f16d1713640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7f16b00744d0 0x7f16b0076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7fcebe790640 1 -- 172.21.15.45:0/193374581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb806c840 msgr2=0x7fceb80c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f85a0ff9640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f858406aea0 0x7f858406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f66198e7640 1 -- 172.21.15.45:0/3147462795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140c0f00 msgr2=0x7f66141514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f66198e7640 1 --2- 172.21.15.45:0/3147462795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140c0f00 0x7f66141514a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66140a4cd0 tx=0x7f660c02b750 comp rx=0 tx=0).stop 2023-11-18T19:07:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f859c0ab4b0 con 0x7f85a40ca850 2023-11-18T19:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.906+0000 7f207ab0f640 1 -- start start 2023-11-18T19:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f207ab0f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2074072600 0x7f20740c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f207ab0f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f207415c830 0x7f207415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f207ab0f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207406c510 con 0x7f207415c450 2023-11-18T19:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.907+0000 7f207ab0f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207406c760 con 0x7f207415c830 2023-11-18T19:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f207ab0f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207406ca40 con 0x7f2074072600 2023-11-18T19:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f85a0ff9640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f8584074460 0x7f85840768a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 --> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8584076f70 con 0x7f8584074460 2023-11-18T19:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f859c0adad0 con 0x7f85a40ca850 2023-11-18T19:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7fd2b659c640 1 --2- 172.21.15.45:0/3872337544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b806b890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=333f79c9cbac4a42 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f20788ab640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f207415c450 0x7f20740c1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46950/0 (socket says 172.21.15.45:46950) 2023-11-18T19:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f20788ab640 1 -- 172.21.15.45:0/3853755949 learned_addr learned my addr 172.21.15.45:0/3853755949 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f66198e7640 1 -- 172.21.15.45:0/3147462795 shutdown_connections 2023-11-18T19:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f66198e7640 1 --2- 172.21.15.45:0/3147462795 >> v2:172.21.15.45:3300/0 conn(0x7f66140a4d40 0x7f6614150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f66198e7640 1 --2- 172.21.15.45:0/3147462795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140c0f00 0x7f66141514a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f66198e7640 1 -- 172.21.15.45:0/3147462795 >> 172.21.15.45:0/3147462795 conn(0x7f66140a7980 msgr2=0x7f66140a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f20790ac640 1 --2- 172.21.15.45:0/3853755949 >> v2:172.21.15.45:3300/0 conn(0x7f207415c830 0x7f207415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f2073fff640 1 --2- 172.21.15.45:0/3853755949 >> v2:172.21.15.135:3300/0 conn(0x7f2074072600 0x7f20740c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7f85a3fff640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f858406aea0 0x7f858406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7f85a8a7d640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f8584074460 0x7f85840768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fcebe790640 1 --2- 172.21.15.45:0/193374581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb806c840 0x7fceb80c49b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcea00097a0 tx=0x7fcea002b730 comp rx=0 tx=0).stop 2023-11-18T19:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fcebe790640 1 -- 172.21.15.45:0/193374581 shutdown_connections 2023-11-18T19:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fcebe790640 1 --2- 172.21.15.45:0/193374581 >> v2:172.21.15.45:3300/0 conn(0x7fceb8155430 0x7fceb80ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fcebe790640 1 --2- 172.21.15.45:0/193374581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb806c840 0x7fceb80c49b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fcebe790640 1 -- 172.21.15.45:0/193374581 >> 172.21.15.45:0/193374581 conn(0x7fceb80663d0 msgr2=0x7fceb80667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7f20737fe640 1 -- 172.21.15.45:0/3853755949 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881287085 0 0) 0x7f207406c510 con 0x7f207415c450 2023-11-18T19:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7f85a8a7d640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f8584074460 0x7f85840768a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fcebe790640 1 -- 172.21.15.45:0/193374581 shutdown_connections 2023-11-18T19:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fcebe790640 1 -- 172.21.15.45:0/193374581 wait complete. 2023-11-18T19:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.908+0000 7fd2b559a640 1 -- 172.21.15.45:0/3872337544 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a802ca80 con 0x7fd2b8155df0 2023-11-18T19:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7f66198e7640 1 -- 172.21.15.45:0/3147462795 shutdown_connections 2023-11-18T19:07:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fd2b559a640 1 -- 172.21.15.45:0/3872337544 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a802cbe0 con 0x7fd2b8155df0 2023-11-18T19:07:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.909+0000 7fd2b559a640 1 -- 172.21.15.45:0/3872337544 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80343f0 con 0x7fd2b8155df0 2023-11-18T19:07:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.910+0000 7f85a3fff640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f858406aea0 0x7f858406d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f85a40ac730 tx=0x7f858c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.910+0000 7fd2b759e640 1 -- 172.21.15.45:0/3872337544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 msgr2=0x7fd2b806b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.910+0000 7fd2b759e640 1 --2- 172.21.15.45:0/3872337544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b806b890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a802bee0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.910+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== osd.2 v2:172.21.15.45:6824/3279045870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f16b0076fe0 con 0x7f16b00744d0 2023-11-18T19:07:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.910+0000 7f20737fe640 1 -- 172.21.15.45:0/3853755949 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2064003520 con 0x7f207415c450 2023-11-18T19:07:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.911+0000 7f2073fff640 1 -- 172.21.15.45:0/3853755949 >> v2:172.21.15.45:3300/0 conn(0x7f207415c830 msgr2=0x7f207415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.911+0000 7f20737fe640 1 -- 172.21.15.45:0/3853755949 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141611660 0 0) 0x7f2064003520 con 0x7f207415c450 2023-11-18T19:07:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.911+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== osd.3 v2:172.21.15.45:6808/2848358823 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8584076f70 con 0x7f8584074460 2023-11-18T19:07:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.911+0000 7f2073fff640 1 --2- 172.21.15.45:0/3853755949 >> v2:172.21.15.45:3300/0 conn(0x7f207415c830 0x7f207415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.911+0000 7f2073fff640 1 -- 172.21.15.45:0/3853755949 >> v1:172.21.15.45:6789/0 conn(0x7f207415c450 legacy=0x7f20740c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.911+0000 7f2073fff640 1 -- 172.21.15.45:0/3853755949 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740c1080 con 0x7f2074072600 2023-11-18T19:07:04.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.912+0000 7fd2b759e640 1 -- 172.21.15.45:0/3872337544 shutdown_connections 2023-11-18T19:07:04.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.912+0000 7fd2b759e640 1 --2- 172.21.15.45:0/3872337544 >> v2:172.21.15.45:3300/0 conn(0x7fd2b80c0e40 0x7fd2b806c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.912+0000 7fd2b759e640 1 --2- 172.21.15.45:0/3872337544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b806b890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.912+0000 7fd2b759e640 1 -- 172.21.15.45:0/3872337544 >> 172.21.15.45:0/3872337544 conn(0x7fd2b80a78a0 msgr2=0x7fd2b80a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.910+0000 7f66198e7640 1 -- 172.21.15.45:0/3147462795 wait complete. 2023-11-18T19:07:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.912+0000 7f66198e7640 1 Processor -- start 2023-11-18T19:07:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.913+0000 7f66198e7640 1 -- start start 2023-11-18T19:07:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.913+0000 7fcebe790640 1 Processor -- start 2023-11-18T19:07:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.913+0000 7fcebe790640 1 -- start start 2023-11-18T19:07:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fcebe790640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb806c840 0x7fceb80c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fcebe790640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb814e8b0 0x7fceb81468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fcebe790640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb8155430 0x7fceb81446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fcebe790640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81ea2c0 con 0x7fceb8155430 2023-11-18T19:07:04.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fcebe790640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8153230 con 0x7fceb806c840 2023-11-18T19:07:04.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fcebe790640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81589a0 con 0x7fceb814e8b0 2023-11-18T19:07:04.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.913+0000 7fd2b759e640 1 -- 172.21.15.45:0/3872337544 shutdown_connections 2023-11-18T19:07:04.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.913+0000 7fd2b759e640 1 -- 172.21.15.45:0/3872337544 wait complete. 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.913+0000 7f20790ac640 1 --2- 172.21.15.45:0/3853755949 >> v2:172.21.15.45:3300/0 conn(0x7f207415c830 0x7f207415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7f2073fff640 1 --2- 172.21.15.45:0/3853755949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2074072600 0x7f20740c3ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2074066dd0 tx=0x7f206002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1de023b6d5115832 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7f66198e7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66140a4d40 0x7f66141615d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7f66198e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140a8470 0x7f66140a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7f66198e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66140c0f00 0x7f66140a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7f66198e7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140aa8c0 con 0x7f66140c0f00 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7f66198e7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614150b60 con 0x7f66140a8470 2023-11-18T19:07:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7f66198e7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66140ab3e0 con 0x7f66140a4d40 2023-11-18T19:07:04.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fceb7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb806c840 0x7fceb80c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fcebcd2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb8155430 0x7fceb81446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fceb7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb806c840 0x7fceb80c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42744/0 (socket says 172.21.15.45:42744) 2023-11-18T19:07:04.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.915+0000 7fceb7fff640 1 -- 172.21.15.45:0/101366851 learned_addr learned my addr 172.21.15.45:0/101366851 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fceaf7fe640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb814e8b0 0x7fceb81468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fd2b759e640 1 Processor -- start 2023-11-18T19:07:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7f66127fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140a8470 0x7f66140a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fcebcd2d640 1 -- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb814e8b0 msgr2=0x7fceb81468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fcebcd2d640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fceb814e8b0 0x7fceb81468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fcebcd2d640 1 -- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb806c840 msgr2=0x7fceb80c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fcebcd2d640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fceb806c840 0x7fceb80c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fcebcd2d640 1 -- 172.21.15.45:0/101366851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0009400 con 0x7fceb8155430 2023-11-18T19:07:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7fd2b759e640 1 -- start start 2023-11-18T19:07:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7f66127fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140a8470 0x7f66140a8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42760/0 (socket says 172.21.15.45:42760) 2023-11-18T19:07:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.916+0000 7f66127fc640 1 -- 172.21.15.45:0/527402559 learned_addr learned my addr 172.21.15.45:0/527402559 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7fcebcd2d640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb8155430 0x7fceb81446c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fceb000b390 tx=0x7fceb000b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f20737fe640 1 -- 172.21.15.45:0/3853755949 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068001670 con 0x7f2074072600 2023-11-18T19:07:04.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f20737fe640 1 -- 172.21.15.45:0/3853755949 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060031540 con 0x7f2074072600 2023-11-18T19:07:04.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f20737fe640 1 -- 172.21.15.45:0/3853755949 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060031910 con 0x7f2074072600 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f66127fc640 1 -- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66140a4d40 msgr2=0x7f66141615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f66127fc640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66140a4d40 0x7f66141615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f66127fc640 1 -- 172.21.15.45:0/527402559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66140c0f00 msgr2=0x7f66140a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f66127fc640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66140c0f00 0x7f66140a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.917+0000 7f66127fc640 1 -- 172.21.15.45:0/527402559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0094d0 con 0x7f66140a8470 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7f66127fc640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140a8470 0x7f66140a8cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f660800e730 tx=0x7f660800ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0011830 con 0x7fceb8155430 2023-11-18T19:07:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0011990 con 0x7fceb8155430 2023-11-18T19:07:04.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0011d20 con 0x7fceb8155430 2023-11-18T19:07:04.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fd2b759e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b806c9e0 0x7fd2b81f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fd2b759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b80c0e40 0x7fd2b81f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fd2b759e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b81f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fd2b759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b81570d0 con 0x7fd2b80c0e40 2023-11-18T19:07:04.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fd2b759e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b81fa480 con 0x7fd2b806c9e0 2023-11-18T19:07:04.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7fd2b759e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b81fa760 con 0x7fd2b8155df0 2023-11-18T19:07:04.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7f207ab0f640 1 -- 172.21.15.45:0/3853755949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2074072600 msgr2=0x7f20740c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7f207ab0f640 1 --2- 172.21.15.45:0/3853755949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2074072600 0x7f20740c3ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2074066dd0 tx=0x7f206002b860 comp rx=0 tx=0).stop 2023-11-18T19:07:04.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.918+0000 7f207ab0f640 1 -- 172.21.15.45:0/3853755949 shutdown_connections 2023-11-18T19:07:04.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8158420 con 0x7fceb8155430 2023-11-18T19:07:04.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb81586c0 con 0x7fceb8155430 2023-11-18T19:07:04.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7fd2b659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b806c9e0 0x7fd2b81f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7fd2b659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b806c9e0 0x7fd2b81f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42776/0 (socket says 172.21.15.45:42776) 2023-11-18T19:07:04.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7fd2b659c640 1 -- 172.21.15.45:0/1153630546 learned_addr learned my addr 172.21.15.45:0/1153630546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7f207ab0f640 1 --2- 172.21.15.45:0/3853755949 >> v2:172.21.15.45:3300/0 conn(0x7f207415c830 0x7f207415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7f207ab0f640 1 --2- 172.21.15.45:0/3853755949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2074072600 0x7f20740c3ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7f207ab0f640 1 -- 172.21.15.45:0/3853755949 >> 172.21.15.45:0/3853755949 conn(0x7f20740a7980 msgr2=0x7f20740a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7fd2b5d9b640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b80c0e40 0x7fd2b81f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7f207ab0f640 1 -- 172.21.15.45:0/3853755949 shutdown_connections 2023-11-18T19:07:04.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.919+0000 7f207ab0f640 1 -- 172.21.15.45:0/3853755949 wait complete. 2023-11-18T19:07:04.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.920+0000 7fd2b6d9d640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b81f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.920+0000 7fd2b5d9b640 1 -- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 msgr2=0x7fd2b81f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.920+0000 7fd2b5d9b640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b81f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.921+0000 7fd2b5d9b640 1 -- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b806c9e0 msgr2=0x7fd2b81f9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.921+0000 7fd2b5d9b640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b806c9e0 0x7fd2b81f9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.921+0000 7fd2b5d9b640 1 -- 172.21.15.45:0/1153630546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8009b30 con 0x7fd2b80c0e40 2023-11-18T19:07:04.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.921+0000 7f207ab0f640 1 Processor -- start 2023-11-18T19:07:04.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.921+0000 7fd2b659c640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b806c9e0 0x7fd2b81f9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:04.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.921+0000 7fd2b6d9d640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2b8155df0 0x7fd2b81f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:04.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7f207ab0f640 1 -- start start 2023-11-18T19:07:04.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608004230 con 0x7f66140a8470 2023-11-18T19:07:04.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608004390 con 0x7f66140a8470 2023-11-18T19:07:04.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800c8d0 con 0x7f66140a8470 2023-11-18T19:07:04.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7fd2b5d9b640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b80c0e40 0x7fd2b81f7960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000e850 tx=0x7fd2b000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00095b0 con 0x7fd2b80c0e40 2023-11-18T19:07:04.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b000c940 con 0x7fd2b80c0e40 2023-11-18T19:07:04.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000ccd0 con 0x7fd2b80c0e40 2023-11-18T19:07:04.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b8157320 con 0x7fd2b80c0e40 2023-11-18T19:07:04.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b80ab900 con 0x7fd2b80c0e40 2023-11-18T19:07:04.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f207ab0f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2074072600 0x7f207413ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f207ab0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207415c450 0x7f207415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f207ab0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207415c830 0x7f207415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f207ab0f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207414a5d0 con 0x7f207415c450 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f207ab0f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740714d0 con 0x7f207415c830 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f207ab0f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20740a9320 con 0x7f2074072600 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f20788ab640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2074072600 0x7f207413ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f20788ab640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2074072600 0x7f207413ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50400/0 (socket says 172.21.15.45:50400) 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.923+0000 7f20788ab640 1 -- 172.21.15.45:0/415564917 learned_addr learned my addr 172.21.15.45:0/415564917 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66140aaad0 con 0x7f66140a8470 2023-11-18T19:07:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.922+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66140ab070 con 0x7f66140a8470 2023-11-18T19:07:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.924+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fceb8154950 con 0x7fceb8155430 2023-11-18T19:07:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.924+0000 7f20790ac640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207415c830 0x7f207415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.924+0000 7f20788ab640 1 -- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207415c830 msgr2=0x7f207415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.924+0000 7f20788ab640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207415c830 0x7f207415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.924+0000 7f20788ab640 1 -- 172.21.15.45:0/415564917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207415c450 msgr2=0x7f207415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.924+0000 7f20788ab640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f207415c450 0x7f207415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.924+0000 7f20788ab640 1 -- 172.21.15.45:0/415564917 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c009a70 con 0x7f2074072600 2023-11-18T19:07:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.925+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fceb001a400 con 0x7fceb8155430 2023-11-18T19:07:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.926+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65f4000fc0 con 0x7f66140a8470 2023-11-18T19:07:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.926+0000 7f20788ab640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2074072600 0x7f207413ac20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f206800c780 tx=0x7f206800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.926+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068005ad0 con 0x7f2074072600 2023-11-18T19:07:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.926+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2068005c30 con 0x7f2074072600 2023-11-18T19:07:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.926+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2060009400 con 0x7f2074072600 2023-11-18T19:07:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.927+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068007070 con 0x7f2074072600 2023-11-18T19:07:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.927+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207415a840 con 0x7f2074072600 2023-11-18T19:07:04.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.927+0000 7fceb57fa640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae90 0x7fce9806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.928+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fceb0089820 con 0x7fceb8155430 2023-11-18T19:07:04.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.928+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f207406d070 con 0x7f2074072600 2023-11-18T19:07:04.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.928+0000 7fceb7fff640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae90 0x7fce9806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.928+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2b815c260 con 0x7fd2b80c0e40 2023-11-18T19:07:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.928+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f660800ca30 con 0x7f66140a8470 2023-11-18T19:07:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.929+0000 7fceb57fa640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7fce98074450 0x7fce98076890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.929+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 --> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce98076f60 con 0x7fce98074450 2023-11-18T19:07:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.929+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb0054580 con 0x7fceb8155430 2023-11-18T19:07:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.930+0000 7fceb7fff640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae90 0x7fce9806d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fceb8152bc0 tx=0x7fcea8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.930+0000 7fceaf7fe640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7fce98074450 0x7fce98076890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.930+0000 7f65fbfff640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f660006af40 0x7f660006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.930+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6608089490 con 0x7f66140a8470 2023-11-18T19:07:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.930+0000 7f65fbfff640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f6600074500 0x7f6600076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.930+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 --> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6600077010 con 0x7f6600074500 2023-11-18T19:07:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.930+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66080542c0 con 0x7f66140a8470 2023-11-18T19:07:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.931+0000 7f6612ffd640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f660006af40 0x7f660006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.932+0000 7f66137fe640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f6600074500 0x7f6600076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.932+0000 7fceaf7fe640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7fce98074450 0x7fce98076890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.931+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2b0013470 con 0x7fd2b80c0e40 2023-11-18T19:07:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7f6612ffd640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f660006af40 0x7f660006d400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66040012e0 tx=0x7f6604007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7fd2aeffd640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd29806af10 0x7fd29806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2b00899e0 con 0x7fd2b80c0e40 2023-11-18T19:07:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.931+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f20680071d0 con 0x7f2074072600 2023-11-18T19:07:04.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7f20717fa640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205806ae70 0x7f205806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7f66137fe640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f6600074500 0x7f6600076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2068089840 con 0x7f2074072600 2023-11-18T19:07:04.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7f20717fa640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7f20580744b0 0x7f20580768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 --> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2058076fc0 con 0x7f20580744b0 2023-11-18T19:07:04.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.933+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2068089bf0 con 0x7f2074072600 2023-11-18T19:07:04.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.934+0000 7f2073fff640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205806ae70 0x7f205806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.934+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 --> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6250005350 con 0x7f623c0744d0 2023-11-18T19:07:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.934+0000 7fd2aeffd640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7fd298074550 0x7fd298076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.934+0000 7fd2b659c640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd29806af10 0x7fd29806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.934+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 --> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd298077060 con 0x7fd298074550 2023-11-18T19:07:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.934+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2b008e2a0 con 0x7fd2b80c0e40 2023-11-18T19:07:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.935+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== osd.5 v2:172.21.15.135:6821/1627929657 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fce98076f60 con 0x7fce98074450 2023-11-18T19:07:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.935+0000 7f624e7fc640 1 -- 172.21.15.45:0/4049225213 <== osd.1 v2:172.21.15.45:6816/370738576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6250005350 con 0x7f623c0744d0 2023-11-18T19:07:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.935+0000 7fd2b6d9d640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7fd298074550 0x7fd298076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f623c0744d0 msgr2=0x7f623c076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f625fd90640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f623c0744d0 0x7f623c076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.935+0000 7fd2b659c640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd29806af10 0x7fd29806d3d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f20790ac640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7f20580744b0 0x7f20580768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f2073fff640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205806ae70 0x7f205806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2060035000 tx=0x7f2060030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f623c06ae90 msgr2=0x7f623c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f625fd90640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f623c06ae90 0x7f623c06d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6254007fd0 tx=0x7f6254007c20 comp rx=0 tx=0).stop 2023-11-18T19:07:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f625004b170 msgr2=0x7f62500dc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f625fd90640 1 --2- 172.21.15.45:0/4049225213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f625004b170 0x7f62500dc8a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f62480090b0 tx=0x7f62480046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f625e32d640 1 -- 172.21.15.45:0/4049225213 reap_dead start 2023-11-18T19:07:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.936+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== osd.4 v2:172.21.15.135:6800/2682063335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6600077010 con 0x7f6600074500 2023-11-18T19:07:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.937+0000 7fd2b6d9d640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7fd298074550 0x7fd298076990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.937+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 --> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8588002cb0 con 0x7f8584074460 2023-11-18T19:07:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.938+0000 7f85a0ff9640 1 -- 172.21.15.45:0/3613622570 <== osd.3 v2:172.21.15.45:6808/2848358823 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8588002cb0 con 0x7f8584074460 2023-11-18T19:07:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.938+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 shutdown_connections 2023-11-18T19:07:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.938+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 >> 172.21.15.45:0/4049225213 conn(0x7f6250005e50 msgr2=0x7f6250049590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.938+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 shutdown_connections 2023-11-18T19:07:04.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.938+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f8584074460 msgr2=0x7f85840768a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.938+0000 7f85aa4e0640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f8584074460 0x7f85840768a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.938+0000 7f625fd90640 1 -- 172.21.15.45:0/4049225213 wait complete. 2023-11-18T19:07:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 --> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51d8002cb0 con 0x7f51e00744d0 2023-11-18T19:07:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f858406aea0 msgr2=0x7f858406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f858406aea0 0x7f858406d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f85a40ac730 tx=0x7f858c008040 comp rx=0 tx=0).stop 2023-11-18T19:07:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a40ca850 msgr2=0x7f85a40c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 --2- 172.21.15.45:0/3613622570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85a40ca850 0x7f85a40c3cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f859c02bdc0 tx=0x7f859c0046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85a8a7d640 1 -- 172.21.15.45:0/3613622570 reap_dead start 2023-11-18T19:07:04.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f20790ac640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7f20580744b0 0x7f20580768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:04.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 shutdown_connections 2023-11-18T19:07:04.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 >> 172.21.15.45:0/3613622570 conn(0x7f85a40663d0 msgr2=0x7f85a40667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 shutdown_connections 2023-11-18T19:07:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.939+0000 7f85aa4e0640 1 -- 172.21.15.45:0/3613622570 wait complete. 2023-11-18T19:07:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f51fdffb640 1 -- 172.21.15.45:0/921286394 <== osd.0 v2:172.21.15.45:6800/2175017614 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f51d8002cb0 con 0x7f51e00744d0 2023-11-18T19:07:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== osd.6 v2:172.21.15.135:6808/1077987781 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd298077060 con 0x7fd298074550 2023-11-18T19:07:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f51e00744d0 msgr2=0x7f51e0076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f51f6ffd640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f51e00744d0 0x7f51e0076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f51e006ae90 msgr2=0x7f51e006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f51f6ffd640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f51e006ae90 0x7f51e006d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001370 tx=0x7f51e8007c70 comp rx=0 tx=0).stop 2023-11-18T19:07:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52000a8b70 msgr2=0x7f520006c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f51f6ffd640 1 --2- 172.21.15.45:0/921286394 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52000a8b70 0x7f520006c740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f52000a84f0 tx=0x7f51f0004a40 comp rx=0 tx=0).stop 2023-11-18T19:07:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.943+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 --> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16c4047d50 con 0x7f16b00744d0 2023-11-18T19:07:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.940+0000 7f520540c640 1 -- 172.21.15.45:0/921286394 reap_dead start 2023-11-18T19:07:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.943+0000 7f16c27fc640 1 -- 172.21.15.45:0/3348925220 <== osd.2 v2:172.21.15.45:6824/3279045870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16b0076fe0 con 0x7f16b00744d0 2023-11-18T19:07:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.943+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 shutdown_connections 2023-11-18T19:07:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.943+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 >> 172.21.15.45:0/921286394 conn(0x7f52000a7870 msgr2=0x7f52000c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.943+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== osd.7 v2:172.21.15.135:6816/745158176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2058076fc0 con 0x7f20580744b0 2023-11-18T19:07:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.944+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 shutdown_connections 2023-11-18T19:07:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.944+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7f16b00744d0 msgr2=0x7f16b0076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.944+0000 7f16d2f16640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7f16b00744d0 0x7f16b0076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.944+0000 7f51f6ffd640 1 -- 172.21.15.45:0/921286394 wait complete. 2023-11-18T19:07:04.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.945+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16b006af10 msgr2=0x7f16b006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.945+0000 7f16d2f16640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16b006af10 0x7f16b006d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16bc02b950 tx=0x7f16bc03c040 comp rx=0 tx=0).stop 2023-11-18T19:07:04.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.945+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40df150 msgr2=0x7f16c4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.945+0000 7f16d2f16640 1 --2- 172.21.15.45:0/3348925220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16c40df150 0x7f16c4040f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16cc064320 tx=0x7f16cc067f00 comp rx=0 tx=0).stop 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.948+0000 7f16d2715640 1 -- 172.21.15.45:0/3348925220 reap_dead start 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.948+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 shutdown_connections 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.948+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 >> 172.21.15.45:0/3348925220 conn(0x7f16c4048220 msgr2=0x7f16c402b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.948+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 shutdown_connections 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.949+0000 7f16d2f16640 1 -- 172.21.15.45:0/3348925220 wait complete. 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.967+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 --> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fceb814ec90 con 0x7fce98074450 2023-11-18T19:07:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.968+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 --> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65f4002cb0 con 0x7f6600074500 2023-11-18T19:07:04.981 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:04.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T19:07:04.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.969+0000 7fceb57fa640 1 -- 172.21.15.45:0/101366851 <== osd.5 v2:172.21.15.135:6821/1627929657 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcea00309b0 con 0x7fce98074450 2023-11-18T19:07:04.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.969+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7fce98074450 msgr2=0x7fce98076890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.969+0000 7fcebe790640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7fce98074450 0x7fce98076890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae90 msgr2=0x7fce9806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebe790640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fce9806ae90 0x7fce9806d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fceb8152bc0 tx=0x7fcea8009040 comp rx=0 tx=0).stop 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb8155430 msgr2=0x7fceb81446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebe790640 1 --2- 172.21.15.45:0/101366851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb8155430 0x7fceb81446c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fceb000b390 tx=0x7fceb000b850 comp rx=0 tx=0).stop 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebcd2d640 1 -- 172.21.15.45:0/101366851 reap_dead start 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 shutdown_connections 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 >> 172.21.15.45:0/101366851 conn(0x7fceb80663d0 msgr2=0x7fceb81536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7f65fbfff640 1 -- 172.21.15.45:0/527402559 <== osd.4 v2:172.21.15.135:6800/2682063335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65f4002cb0 con 0x7f6600074500 2023-11-18T19:07:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 --> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2b815bf80 con 0x7fd298074550 2023-11-18T19:07:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.970+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 shutdown_connections 2023-11-18T19:07:04.985 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:04.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T19:07:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7fcebe790640 1 -- 172.21.15.45:0/101366851 wait complete. 2023-11-18T19:07:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f6600074500 msgr2=0x7f6600076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f6600074500 0x7f6600076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f660006af40 msgr2=0x7f660006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f660006af40 0x7f660006d400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66040012e0 tx=0x7f6604007d10 comp rx=0 tx=0).stop 2023-11-18T19:07:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140a8470 msgr2=0x7f66140a8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 --2- 172.21.15.45:0/527402559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66140a8470 0x7f66140a8cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f660800e730 tx=0x7f660800ebf0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.987 INFO:teuthology.orchestra.run.smithi045.stdout:64424509450 2023-11-18T19:07:04.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T19:07:04.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7fd2aeffd640 1 -- 172.21.15.45:0/1153630546 <== osd.6 v2:172.21.15.135:6808/1077987781 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2a0001330 con 0x7fd298074550 2023-11-18T19:07:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66137fe640 1 -- 172.21.15.45:0/527402559 reap_dead start 2023-11-18T19:07:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 shutdown_connections 2023-11-18T19:07:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.971+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 >> 172.21.15.45:0/527402559 conn(0x7f66140a7980 msgr2=0x7f6614070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 shutdown_connections 2023-11-18T19:07:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7f66198e7640 1 -- 172.21.15.45:0/527402559 wait complete. 2023-11-18T19:07:04.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7fd298074550 msgr2=0x7fd298076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7fd2b759e640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7fd298074550 0x7fd298076990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd29806af10 msgr2=0x7fd29806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7fd2b759e640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd29806af10 0x7fd29806d3d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a8030000 comp rx=0 tx=0).stop 2023-11-18T19:07:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b80c0e40 msgr2=0x7fd2b81f7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.972+0000 7fd2b759e640 1 --2- 172.21.15.45:0/1153630546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b80c0e40 0x7fd2b81f7960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000e850 tx=0x7fd2b000ed10 comp rx=0 tx=0).stop 2023-11-18T19:07:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.973+0000 7fd2b6d9d640 1 -- 172.21.15.45:0/1153630546 reap_dead start 2023-11-18T19:07:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.973+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 shutdown_connections 2023-11-18T19:07:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.973+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 >> 172.21.15.45:0/1153630546 conn(0x7fd2b80a78a0 msgr2=0x7fd2b80c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.973+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 shutdown_connections 2023-11-18T19:07:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.973+0000 7fd2b759e640 1 -- 172.21.15.45:0/1153630546 wait complete. 2023-11-18T19:07:04.991 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:04.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T19:07:04.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.977+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 --> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20740747c0 con 0x7f20580744b0 2023-11-18T19:07:04.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.978+0000 7f20717fa640 1 -- 172.21.15.45:0/415564917 <== osd.7 v2:172.21.15.135:6816/745158176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20740747c0 con 0x7f20580744b0 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7f20580744b0 msgr2=0x7f20580768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7f20580744b0 0x7f20580768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205806ae70 msgr2=0x7f205806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f205806ae70 0x7f205806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2060035000 tx=0x7f2060030000 comp rx=0 tx=0).stop 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2074072600 msgr2=0x7f207413ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 --2- 172.21.15.45:0/415564917 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2074072600 0x7f207413ac20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f206800c780 tx=0x7f206800cc40 comp rx=0 tx=0).stop 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f20790ac640 1 -- 172.21.15.45:0/415564917 reap_dead start 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 shutdown_connections 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 >> 172.21.15.45:0/415564917 conn(0x7f20740a7980 msgr2=0x7f20740a5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.979+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 shutdown_connections 2023-11-18T19:07:04.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:04.980+0000 7f207ab0f640 1 -- 172.21.15.45:0/415564917 wait complete. 2023-11-18T19:07:04.995 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:04.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T19:07:04.998 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:04.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T19:07:05.007 INFO:teuthology.orchestra.run.smithi045.stdout:64424509448 2023-11-18T19:07:05.008 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-11-18T19:07:05.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T19:07:05.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T19:07:05.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:07:05.076 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:07:05.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.260+0000 7fdeb4578640 1 Processor -- start 2023-11-18T19:07:05.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.260+0000 7fdeb4578640 1 -- start start 2023-11-18T19:07:05.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.264+0000 7fdeb4578640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdeac0a94d0 0x7fdeac0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.265+0000 7fdeb2314640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fdeac0a51e0 0x7fdeac0c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:37284/0 (socket says 172.21.15.45:37284) 2023-11-18T19:07:05.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.265+0000 7fdeb2314640 1 -- 172.21.15.45:0/3513338855 learned_addr learned my addr 172.21.15.45:0/3513338855 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:05.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.265+0000 7fdeb1b13640 1 --2- 172.21.15.45:0/3513338855 >> v2:172.21.15.135:3300/0 conn(0x7fdeac0a94d0 0x7fdeac0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.266+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac072150 con 0x7fdeac0aad20 2023-11-18T19:07:05.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.266+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0c1f60 con 0x7fdeac0a51e0 2023-11-18T19:07:05.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.266+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac0a9c30 con 0x7fdeac0a94d0 2023-11-18T19:07:05.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.267+0000 7fdeb1312640 1 -- 172.21.15.45:0/3513338855 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198499715 0 0) 0x7fdeac0c1f60 con 0x7fdeac0a51e0 2023-11-18T19:07:05.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.267+0000 7fdeb1312640 1 -- 172.21.15.45:0/3513338855 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde98003520 con 0x7fdeac0a51e0 2023-11-18T19:07:05.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.267+0000 7fdeb1312640 1 -- 172.21.15.45:0/3513338855 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445512227 0 0) 0x7fdeac072150 con 0x7fdeac0aad20 2023-11-18T19:07:05.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.267+0000 7fdeb1312640 1 -- 172.21.15.45:0/3513338855 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeac0c1f60 con 0x7fdeac0aad20 2023-11-18T19:07:05.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.267+0000 7fdeb1b13640 1 -- 172.21.15.45:0/3513338855 >> v1:172.21.15.135:6789/0 conn(0x7fdeac0a51e0 legacy=0x7fdeac0c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.267+0000 7fdeb1b13640 1 -- 172.21.15.45:0/3513338855 >> v1:172.21.15.45:6789/0 conn(0x7fdeac0aad20 legacy=0x7fdeac0c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.267+0000 7fdeb1b13640 1 -- 172.21.15.45:0/3513338855 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0c14e0 con 0x7fdeac0a94d0 2023-11-18T19:07:05.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.270+0000 7fdeb1b13640 1 --2- 172.21.15.45:0/3513338855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac0c43d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0090e0 tx=0x7fde9c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb8c248d8d3a5aae server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.270+0000 7fdeb1312640 1 -- 172.21.15.45:0/3513338855 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c030610 con 0x7fdeac0a94d0 2023-11-18T19:07:05.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.270+0000 7fdeb1312640 1 -- 172.21.15.45:0/3513338855 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c030770 con 0x7fdeac0a94d0 2023-11-18T19:07:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.270+0000 7fdeb1312640 1 -- 172.21.15.45:0/3513338855 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c030b00 con 0x7fdeac0a94d0 2023-11-18T19:07:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.271+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 msgr2=0x7fdeac0c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.271+0000 7fdeb4578640 1 --2- 172.21.15.45:0/3513338855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac0c43d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0090e0 tx=0x7fde9c02b960 comp rx=0 tx=0).stop 2023-11-18T19:07:05.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.273+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 shutdown_connections 2023-11-18T19:07:05.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.273+0000 7fdeb4578640 1 --2- 172.21.15.45:0/3513338855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac0c43d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.273+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 >> 172.21.15.45:0/3513338855 conn(0x7fdeac0c25c0 msgr2=0x7fdeac0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.273+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 shutdown_connections 2023-11-18T19:07:05.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.273+0000 7fdeb4578640 1 -- 172.21.15.45:0/3513338855 wait complete. 2023-11-18T19:07:05.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.276+0000 7fdeb4578640 1 Processor -- start 2023-11-18T19:07:05.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.276+0000 7fdeb4578640 1 -- start start 2023-11-18T19:07:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.278+0000 7fdeb4578640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0a51e0 0x7fdeac1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.279+0000 7fdeb4578640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.279+0000 7fa820e59640 1 Processor -- start 2023-11-18T19:07:05.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.279+0000 7fdeb4578640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeac0aad20 0x7fdeac14ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fa820e59640 1 -- start start 2023-11-18T19:07:05.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb2b15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeac0aad20 0x7fdeac14ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb2b15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeac0aad20 0x7fdeac14ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37958/0 (socket says 172.21.15.45:37958) 2023-11-18T19:07:05.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb1b13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb1b13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42818/0 (socket says 172.21.15.45:42818) 2023-11-18T19:07:05.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb2314640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0a51e0 0x7fdeac1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb2314640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0a51e0 0x7fdeac1524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50402/0 (socket says 172.21.15.45:50402) 2023-11-18T19:07:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb2b15640 1 -- 172.21.15.45:0/2627160354 learned_addr learned my addr 172.21.15.45:0/2627160354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac071460 con 0x7fdeac0aad20 2023-11-18T19:07:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0700d0 con 0x7fdeac0a94d0 2023-11-18T19:07:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0716e0 con 0x7fdeac0a51e0 2023-11-18T19:07:05.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7fdeb1b13640 1 -- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0a51e0 msgr2=0x7fdeac1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.280+0000 7f9a98e4d640 1 Processor -- start 2023-11-18T19:07:05.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.281+0000 7f9a98e4d640 1 -- start start 2023-11-18T19:07:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7fdeb1b13640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0a51e0 0x7fdeac1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7fdeb1b13640 1 -- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeac0aad20 msgr2=0x7fdeac14ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7fdeb1b13640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeac0aad20 0x7fdeac14ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7fdeb1b13640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009c90 con 0x7fdeac0a94d0 2023-11-18T19:07:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7fdeb2314640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0a51e0 0x7fdeac1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:05.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7f9a98e4d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a94070d20 0x7f9a9406fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7fdeb2b15640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeac0aad20 0x7fdeac14ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:05.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.282+0000 7f9a98e4d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a940c1220 0x7f9a94070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.283+0000 7f9a98e4d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a940a5660 con 0x7f9a94071450 2023-11-18T19:07:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.283+0000 7f9a98e4d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a94070a60 con 0x7f9a94070d20 2023-11-18T19:07:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.283+0000 7f9a98e4d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940a5380 con 0x7f9a940c1220 2023-11-18T19:07:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.283+0000 7fdeb1b13640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac154410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0c3550 tx=0x7fde9c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.283+0000 7f9a937fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a94070d20 0x7f9a9406fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.283+0000 7f9a93fff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9a94071450 0x7f9a9408a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:37294/0 (socket says 172.21.15.45:37294) 2023-11-18T19:07:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.283+0000 7f9a93fff640 1 -- 172.21.15.45:0/1867704556 learned_addr learned my addr 172.21.15.45:0/1867704556 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.284+0000 7fa820e59640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa81c0a5390 0x7fa81c0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.284+0000 7f9a92ffd640 1 --2- 172.21.15.45:0/1867704556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a940c1220 0x7f9a94070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.284+0000 7fa820e59640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c4980 0x7fa81c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.284+0000 7fa820e59640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0c2060 con 0x7fa81c0c0b90 2023-11-18T19:07:05.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.284+0000 7fdea2ffd640 1 -- 172.21.15.45:0/2627160354 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c03e040 con 0x7fdeac0a94d0 2023-11-18T19:07:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fa820e59640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0721b0 con 0x7fa81c0a5390 2023-11-18T19:07:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fa820e59640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c071ed0 con 0x7fa81c0c4980 2023-11-18T19:07:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac152ca0 con 0x7fdeac0a94d0 2023-11-18T19:07:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fdea2ffd640 1 -- 172.21.15.45:0/2627160354 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c039a40 con 0x7fdeac0a94d0 2023-11-18T19:07:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7f9a927fc640 1 -- 172.21.15.45:0/1867704556 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450188232 0 0) 0x7f9a940a5660 con 0x7f9a94071450 2023-11-18T19:07:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7f9a927fc640 1 -- 172.21.15.45:0/1867704556 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a80003520 con 0x7f9a94071450 2023-11-18T19:07:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c4980 0x7fa81c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac070320 con 0x7fdeac0a94d0 2023-11-18T19:07:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fdea2ffd640 1 -- 172.21.15.45:0/2627160354 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c039df0 con 0x7fdeac0a94d0 2023-11-18T19:07:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c4980 0x7fa81c15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50426/0 (socket says 172.21.15.45:50426) 2023-11-18T19:07:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fa81bfff640 1 -- 172.21.15.45:0/2639602529 learned_addr learned my addr 172.21.15.45:0/2639602529 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7fa81affd640 1 --2- 172.21.15.45:0/2639602529 >> v2:172.21.15.135:3300/0 conn(0x7fa81c0a5390 0x7fa81c0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7f9a92ffd640 1 -- 172.21.15.45:0/1867704556 >> v2:172.21.15.135:3300/0 conn(0x7f9a94070d20 msgr2=0x7f9a9406fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7f9a92ffd640 1 --2- 172.21.15.45:0/1867704556 >> v2:172.21.15.135:3300/0 conn(0x7f9a94070d20 0x7f9a9406fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7f9a92ffd640 1 -- 172.21.15.45:0/1867704556 >> v1:172.21.15.135:6789/0 conn(0x7f9a94071450 legacy=0x7f9a9408a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.285+0000 7f9a92ffd640 1 -- 172.21.15.45:0/1867704556 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94161cd0 con 0x7f9a940c1220 2023-11-18T19:07:05.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.286+0000 7fa81bfff640 1 -- 172.21.15.45:0/2639602529 >> v2:172.21.15.135:3300/0 conn(0x7fa81c0a5390 msgr2=0x7fa81c0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.286+0000 7fa81bfff640 1 --2- 172.21.15.45:0/2639602529 >> v2:172.21.15.135:3300/0 conn(0x7fa81c0a5390 0x7fa81c0c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.286+0000 7fa81bfff640 1 -- 172.21.15.45:0/2639602529 >> v1:172.21.15.135:6789/0 conn(0x7fa81c0c0b90 legacy=0x7fa81c0c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.286+0000 7fa81affd640 1 --2- 172.21.15.45:0/2639602529 >> v2:172.21.15.135:3300/0 conn(0x7fa81c0a5390 0x7fa81c0c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:05.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.287+0000 7fa81bfff640 1 -- 172.21.15.45:0/2639602529 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0c1d80 con 0x7fa81c0c4980 2023-11-18T19:07:05.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.289+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde94005250 con 0x7fdeac0a94d0 2023-11-18T19:07:05.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.288+0000 7f9a92ffd640 1 --2- 172.21.15.45:0/1867704556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a940c1220 0x7f9a94070220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0097a0 tx=0x7f9a7c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0be96cbde60905 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.288+0000 7f9a927fc640 1 -- 172.21.15.45:0/1867704556 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c031780 con 0x7f9a940c1220 2023-11-18T19:07:05.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.289+0000 7f9a927fc640 1 -- 172.21.15.45:0/1867704556 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c0318e0 con 0x7f9a940c1220 2023-11-18T19:07:05.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.289+0000 7f9a927fc640 1 -- 172.21.15.45:0/1867704556 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c031c70 con 0x7f9a940c1220 2023-11-18T19:07:05.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1867704556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a940c1220 msgr2=0x7f9a94070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1867704556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a940c1220 0x7f9a94070220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0097a0 tx=0x7f9a7c02b820 comp rx=0 tx=0).stop 2023-11-18T19:07:05.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1867704556 shutdown_connections 2023-11-18T19:07:05.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1867704556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a940c1220 0x7f9a94070220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1867704556 >> v2:172.21.15.135:3300/0 conn(0x7f9a94070d20 0x7f9a9406fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1867704556 >> 172.21.15.45:0/1867704556 conn(0x7f9a940a78a0 msgr2=0x7f9a940a7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1867704556 shutdown_connections 2023-11-18T19:07:05.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1867704556 wait complete. 2023-11-18T19:07:05.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7fdea2ffd640 1 -- 172.21.15.45:0/2627160354 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde9c04c3b0 con 0x7fdeac0a94d0 2023-11-18T19:07:05.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.290+0000 7fa81bfff640 1 --2- 172.21.15.45:0/2639602529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c4980 0x7fa81c15adb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa814009e50 tx=0x7fa81402cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89eed0a693cfdca8 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.292+0000 7fdea2ffd640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fde9006ae70 0x7fde9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.293+0000 7f9a98e4d640 1 Processor -- start 2023-11-18T19:07:05.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.292+0000 7fdeb2314640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fde9006ae70 0x7fde9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.293+0000 7f9a98e4d640 1 -- start start 2023-11-18T19:07:05.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.294+0000 7fdeb2314640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fde9006ae70 0x7fde9006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdea8000f60 tx=0x7fdea8007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.295+0000 7fdea2ffd640 1 -- 172.21.15.45:0/2627160354 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde9c0ab8c0 con 0x7fdeac0a94d0 2023-11-18T19:07:05.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.296+0000 7f9a98e4d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a94070d20 0x7f9a940a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.296+0000 7f9a98e4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a94071450 0x7f9a940ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.296+0000 7f9a98e4d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a940c1220 0x7f9a940a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.296+0000 7f9a98e4d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94164460 con 0x7f9a94071450 2023-11-18T19:07:05.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.296+0000 7f9a98e4d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94163c50 con 0x7f9a940c1220 2023-11-18T19:07:05.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.296+0000 7f9a98e4d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94161430 con 0x7f9a94070d20 2023-11-18T19:07:05.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.297+0000 7f9a937fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a94070d20 0x7f9a940a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.297+0000 7f9a93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a940c1220 0x7f9a940a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.297+0000 7f9a93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a940c1220 0x7f9a940a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42838/0 (socket says 172.21.15.45:42838) 2023-11-18T19:07:05.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.297+0000 7f9a93fff640 1 -- 172.21.15.45:0/1003801830 learned_addr learned my addr 172.21.15.45:0/1003801830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.297+0000 7f9a92ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a94071450 0x7f9a940ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.298+0000 7f9a92ffd640 1 -- 172.21.15.45:0/1003801830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a94070d20 msgr2=0x7f9a940a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.298+0000 7f9a92ffd640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a94070d20 0x7f9a940a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.298+0000 7f9a92ffd640 1 -- 172.21.15.45:0/1003801830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a940c1220 msgr2=0x7f9a940a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.298+0000 7f9a92ffd640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a940c1220 0x7f9a940a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.298+0000 7f9a92ffd640 1 -- 172.21.15.45:0/1003801830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c009400 con 0x7f9a94071450 2023-11-18T19:07:05.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7fa81a7fc640 1 -- 172.21.15.45:0/2639602529 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81402da60 con 0x7fa81c0c4980 2023-11-18T19:07:05.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7f513b644640 1 Processor -- start 2023-11-18T19:07:05.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7fa81a7fc640 1 -- 172.21.15.45:0/2639602529 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81402dbc0 con 0x7fa81c0c4980 2023-11-18T19:07:05.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7fa81a7fc640 1 -- 172.21.15.45:0/2639602529 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140353f0 con 0x7fa81c0c4980 2023-11-18T19:07:05.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7f9a92ffd640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a94071450 0x7f9a940ab480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c033000 tx=0x7f9a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7f9a8bfff640 1 -- 172.21.15.45:0/1003801830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c0327d0 con 0x7f9a94071450 2023-11-18T19:07:05.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7f9a8bfff640 1 -- 172.21.15.45:0/1003801830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c044070 con 0x7f9a94071450 2023-11-18T19:07:05.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7f9a8bfff640 1 -- 172.21.15.45:0/1003801830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c032b90 con 0x7f9a94071450 2023-11-18T19:07:05.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.300+0000 7fa820e59640 1 -- 172.21.15.45:0/2639602529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c4980 msgr2=0x7fa81c15adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7fa820e59640 1 --2- 172.21.15.45:0/2639602529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c4980 0x7fa81c15adb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa814009e50 tx=0x7fa81402cec0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.300+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a94163ea0 con 0x7f9a94071450 2023-11-18T19:07:05.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7fa820e59640 1 -- 172.21.15.45:0/2639602529 shutdown_connections 2023-11-18T19:07:05.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7fa820e59640 1 --2- 172.21.15.45:0/2639602529 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c4980 0x7fa81c15adb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7fa820e59640 1 --2- 172.21.15.45:0/2639602529 >> v2:172.21.15.135:3300/0 conn(0x7fa81c0a5390 0x7fa81c0c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7fa820e59640 1 -- 172.21.15.45:0/2639602529 >> 172.21.15.45:0/2639602529 conn(0x7fa81c0c2660 msgr2=0x7fa81c0c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.299+0000 7f513b644640 1 -- start start 2023-11-18T19:07:05.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7f513b644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f5134150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7f513b644640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51340a4d40 0x7f51341514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7f513b644640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51340c0f00 0x7f51340c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7f513b644640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340c1cf0 con 0x7f51340a4d40 2023-11-18T19:07:05.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7f513b644640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340c24e0 con 0x7f51340c0f00 2023-11-18T19:07:05.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.301+0000 7f513b644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51340c3c00 con 0x7f513406d180 2023-11-18T19:07:05.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.302+0000 7fa820e59640 1 -- 172.21.15.45:0/2639602529 shutdown_connections 2023-11-18T19:07:05.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.302+0000 7f51393e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f5134150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.303+0000 7f5139be1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51340c0f00 0x7f51340c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.302+0000 7fa820e59640 1 -- 172.21.15.45:0/2639602529 wait complete. 2023-11-18T19:07:05.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.302+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a94164cd0 con 0x7f9a94071450 2023-11-18T19:07:05.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.303+0000 7f5139be1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f51340c0f00 0x7f51340c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42840/0 (socket says 172.21.15.45:42840) 2023-11-18T19:07:05.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.303+0000 7f5139be1640 1 -- 172.21.15.45:0/825789857 learned_addr learned my addr 172.21.15.45:0/825789857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.303+0000 7f5138bdf640 1 --2- 172.21.15.45:0/825789857 >> v2:172.21.15.45:3300/0 conn(0x7f51340a4d40 0x7f51341514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.304+0000 7f5139be1640 1 -- 172.21.15.45:0/825789857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 msgr2=0x7f5134150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.304+0000 7f5139be1640 1 --2- 172.21.15.45:0/825789857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f5134150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.304+0000 7f5139be1640 1 -- 172.21.15.45:0/825789857 >> v2:172.21.15.45:3300/0 conn(0x7f51340a4d40 msgr2=0x7f51341514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.304+0000 7f5139be1640 1 --2- 172.21.15.45:0/825789857 >> v2:172.21.15.45:3300/0 conn(0x7f51340a4d40 0x7f51341514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.305+0000 7f5139be1640 1 -- 172.21.15.45:0/825789857 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340c1f20 con 0x7f51340c0f00 2023-11-18T19:07:05.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.306+0000 7f9a8bfff640 1 -- 172.21.15.45:0/1003801830 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a7c032cf0 con 0x7f9a94071450 2023-11-18T19:07:05.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.306+0000 7fa820e59640 1 Processor -- start 2023-11-18T19:07:05.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.306+0000 7fa820e59640 1 -- start start 2023-11-18T19:07:05.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.307+0000 7f5139be1640 1 --2- 172.21.15.45:0/825789857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340c0f00 0x7f51340c43c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f51340c0340 tx=0x7f512402cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ce74efe784ad96e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.306+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94067940 con 0x7f9a94071450 2023-11-18T19:07:05.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.307+0000 7f9a8bfff640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9a7406af40 0x7f9a7406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.308+0000 7f9a8bfff640 1 -- 172.21.15.45:0/1003801830 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a7c0af850 con 0x7f9a94071450 2023-11-18T19:07:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.308+0000 7fa820e59640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa81c0a5390 0x7fa81c14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.308+0000 7fa820e59640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c0b90 0x7fa81c1ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.308+0000 7fa820e59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0c4980 0x7fa81c1edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.308+0000 7fa820e59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1ea100 con 0x7fa81c0c4980 2023-11-18T19:07:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.308+0000 7fa820e59640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c150f80 con 0x7fa81c0a5390 2023-11-18T19:07:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.308+0000 7fa820e59640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1511d0 con 0x7fa81c0c0b90 2023-11-18T19:07:05.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7f9a937fe640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9a7406af40 0x7f9a7406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0c4980 0x7fa81c1edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0c4980 0x7fa81c1edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37984/0 (socket says 172.21.15.45:37984) 2023-11-18T19:07:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 -- 172.21.15.45:0/1794901876 learned_addr learned my addr 172.21.15.45:0/1794901876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 -- 172.21.15.45:0/1794901876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c0b90 msgr2=0x7fa81c1ed9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-18T19:07:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c0b90 0x7fa81c1ed9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.310+0000 7fdea2ffd640 1 -- 172.21.15.45:0/2627160354 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde9c076720 con 0x7fdeac0a94d0 2023-11-18T19:07:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 -- 172.21.15.45:0/1794901876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa81c0a5390 msgr2=0x7fa81c14cf10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-18T19:07:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa81c0a5390 0x7fa81c14cf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.309+0000 7fa81bfff640 1 -- 172.21.15.45:0/1794901876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814009b30 con 0x7fa81c0c4980 2023-11-18T19:07:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.310+0000 7fa81bfff640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0c4980 0x7fa81c1edf00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa814037040 tx=0x7fa814004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.311+0000 7f9a937fe640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9a7406af40 0x7f9a7406d400 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009220 tx=0x7f9a8c006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.311+0000 7f512bfff640 1 -- 172.21.15.45:0/825789857 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512402e8e0 con 0x7f51340c0f00 2023-11-18T19:07:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.311+0000 7f512bfff640 1 -- 172.21.15.45:0/825789857 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512402ea40 con 0x7f51340c0f00 2023-11-18T19:07:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.311+0000 7f512bfff640 1 -- 172.21.15.45:0/825789857 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512402edd0 con 0x7f51340c0f00 2023-11-18T19:07:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.312+0000 7f513b644640 1 -- 172.21.15.45:0/825789857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340c0f00 msgr2=0x7f51340c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.312+0000 7f513b644640 1 --2- 172.21.15.45:0/825789857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340c0f00 0x7f51340c43c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f51340c0340 tx=0x7f512402cb20 comp rx=0 tx=0).stop 2023-11-18T19:07:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.313+0000 7f513b644640 1 -- 172.21.15.45:0/825789857 shutdown_connections 2023-11-18T19:07:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.313+0000 7f513b644640 1 --2- 172.21.15.45:0/825789857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340c0f00 0x7f51340c43c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.313+0000 7f513b644640 1 --2- 172.21.15.45:0/825789857 >> v2:172.21.15.45:3300/0 conn(0x7f51340a4d40 0x7f51341514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.313+0000 7f513b644640 1 --2- 172.21.15.45:0/825789857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f5134150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.313+0000 7f513b644640 1 -- 172.21.15.45:0/825789857 >> 172.21.15.45:0/825789857 conn(0x7f51340a7980 msgr2=0x7f51340a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.313+0000 7f513b644640 1 -- 172.21.15.45:0/825789857 shutdown_connections 2023-11-18T19:07:05.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.313+0000 7f513b644640 1 -- 172.21.15.45:0/825789857 wait complete. 2023-11-18T19:07:05.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.316+0000 7f513b644640 1 Processor -- start 2023-11-18T19:07:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7fa803fff640 1 -- 172.21.15.45:0/1794901876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81403f620 con 0x7fa81c0c4980 2023-11-18T19:07:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7fa803fff640 1 -- 172.21.15.45:0/1794901876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81403f780 con 0x7fa81c0c4980 2023-11-18T19:07:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7fa803fff640 1 -- 172.21.15.45:0/1794901876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81403fb30 con 0x7fa81c0c4980 2023-11-18T19:07:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c1514b0 con 0x7fa81c0c4980 2023-11-18T19:07:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c14d450 con 0x7fa81c0c4980 2023-11-18T19:07:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.316+0000 7f513b644640 1 -- start start 2023-11-18T19:07:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7f513b644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f51341edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7f513b644640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340a4d40 0x7f51341daa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7f513b644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51340c0f00 0x7f51341dafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7f513b644640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51341da600 con 0x7f51340c0f00 2023-11-18T19:07:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7f513b644640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51340bfeb0 con 0x7f51340a4d40 2023-11-18T19:07:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.318+0000 7f513b644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51341ee470 con 0x7f513406d180 2023-11-18T19:07:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.320+0000 7f5138bdf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340a4d40 0x7f51341daa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.320+0000 7f5139be1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51340c0f00 0x7f51341dafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.320+0000 7f51393e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f51341edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.320+0000 7f51393e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f51341edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50458/0 (socket says 172.21.15.45:50458) 2023-11-18T19:07:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.320+0000 7f51393e0640 1 -- 172.21.15.45:0/1352475723 learned_addr learned my addr 172.21.15.45:0/1352475723 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.320+0000 7f5138bdf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340a4d40 0x7f51341daa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42856/0 (socket says 172.21.15.45:42856) 2023-11-18T19:07:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.321+0000 7f51393e0640 1 -- 172.21.15.45:0/1352475723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340a4d40 msgr2=0x7f51341daa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.321+0000 7f51393e0640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340a4d40 0x7f51341daa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.321+0000 7f51393e0640 1 -- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51340c0f00 msgr2=0x7f51341dafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.322+0000 7f51393e0640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51340c0f00 0x7f51341dafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.322+0000 7f51393e0640 1 -- 172.21.15.45:0/1352475723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124009d60 con 0x7f513406d180 2023-11-18T19:07:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.322+0000 7f5139be1640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51340c0f00 0x7f51341dafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.322+0000 7f9a8bfff640 1 -- 172.21.15.45:0/1003801830 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a7c07a5f0 con 0x7f9a94071450 2023-11-18T19:07:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.323+0000 7f51393e0640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f51341edba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f512c00efc0 tx=0x7f512c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.323+0000 7f5129ffb640 1 -- 172.21.15.45:0/1352475723 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c009b80 con 0x7f513406d180 2023-11-18T19:07:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.326+0000 7f5129ffb640 1 -- 172.21.15.45:0/1352475723 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00f040 con 0x7f513406d180 2023-11-18T19:07:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.326+0000 7f5129ffb640 1 -- 172.21.15.45:0/1352475723 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0146a0 con 0x7f513406d180 2023-11-18T19:07:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.326+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51341d9fb0 con 0x7f513406d180 2023-11-18T19:07:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.326+0000 7fa803fff640 1 -- 172.21.15.45:0/1794901876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa81403fc90 con 0x7fa81c0c4980 2023-11-18T19:07:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.326+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51341dcb80 con 0x7f513406d180 2023-11-18T19:07:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.328+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51341d9e10 con 0x7f513406d180 2023-11-18T19:07:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.328+0000 7fa803fff640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa80806af10 0x7fa80806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.329+0000 7fa803fff640 1 -- 172.21.15.45:0/1794901876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8140ac3c0 con 0x7fa81c0c4980 2023-11-18T19:07:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.330+0000 7fa81b7fe640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa80806af10 0x7fa80806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.330+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c1ed6e0 con 0x7fa81c0c4980 2023-11-18T19:07:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.331+0000 7fa81b7fe640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa80806af10 0x7fa80806d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0095f0 tx=0x7fa80c006b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.332+0000 7f5129ffb640 1 -- 172.21.15.45:0/1352475723 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f512c014800 con 0x7f513406d180 2023-11-18T19:07:05.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.334+0000 7f5129ffb640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f511806ae90 0x7f511806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.334+0000 7f5129ffb640 1 -- 172.21.15.45:0/1352475723 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f512c08a1f0 con 0x7f513406d180 2023-11-18T19:07:05.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.335+0000 7f5138bdf640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f511806ae90 0x7f511806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.337+0000 7f5138bdf640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f511806ae90 0x7f511806d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51340ac0a0 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.342+0000 7fa803fff640 1 -- 172.21.15.45:0/1794901876 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa81c1ed6e0 con 0x7fa81c0c4980 2023-11-18T19:07:05.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.354+0000 7f5129ffb640 1 -- 172.21.15.45:0/1352475723 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51341d9e10 con 0x7f513406d180 2023-11-18T19:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.379+0000 7f4c831ff640 1 Processor -- start 2023-11-18T19:07:05.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.379+0000 7f4c831ff640 1 -- start start 2023-11-18T19:07:05.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.381+0000 7f4c831ff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c7c06a770 0x7f4c7c0c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.381+0000 7f4c831ff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c158a60 con 0x7f4c7c156060 2023-11-18T19:07:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.381+0000 7f4c831ff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c0aae40 con 0x7f4c7c0c04f0 2023-11-18T19:07:05.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.381+0000 7f4c831ff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c1590e0 con 0x7f4c7c06a770 2023-11-18T19:07:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.383+0000 7f4c829fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4c7c156060 0x7f4c7c071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46966/0 (socket says 172.21.15.45:46966) 2023-11-18T19:07:05.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.383+0000 7f4c829fe640 1 -- 172.21.15.45:0/3757674903 learned_addr learned my addr 172.21.15.45:0/3757674903 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935047909 0 0) 0x7f4c7c0aae40 con 0x7f4c7c0c04f0 2023-11-18T19:07:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c64003520 con 0x7f4c7c0c04f0 2023-11-18T19:07:05.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142274446 0 0) 0x7f4c64003520 con 0x7f4c7c0c04f0 2023-11-18T19:07:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 >> v2:172.21.15.45:3300/0 conn(0x7f4c7c06a770 msgr2=0x7f4c7c0c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 --2- 172.21.15.45:0/3757674903 >> v2:172.21.15.45:3300/0 conn(0x7f4c7c06a770 0x7f4c7c0c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 >> v1:172.21.15.45:6789/0 conn(0x7f4c7c156060 legacy=0x7f4c7c071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c158d00 con 0x7f4c7c0c04f0 2023-11-18T19:07:05.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f4c6c001670 con 0x7f4c7c0c04f0 2023-11-18T19:07:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.384+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 >> v1:172.21.15.135:6789/0 conn(0x7f4c7c0c04f0 legacy=0x7f4c7c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c811fb640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c64003970 0x7f4c64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c811fb640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c811fb640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c64005380 0x7f4c6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1590e0 con 0x7f4c64005380 2023-11-18T19:07:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6400c240 con 0x7f4c640047c0 2023-11-18T19:07:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6400c400 con 0x7f4c64003970 2023-11-18T19:07:05.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c819fc640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.385+0000 7f4c829fe640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c64005380 0x7f4c6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.387+0000 7f091658a640 1 Processor -- start 2023-11-18T19:07:05.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.387+0000 7f091658a640 1 -- start start 2023-11-18T19:07:05.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.388+0000 7f4c821fd640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c64003970 0x7f4c64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.388+0000 7f4c819fc640 1 -- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c64003970 msgr2=0x7f4c64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.388+0000 7f4c819fc640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c64003970 0x7f4c64003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.388+0000 7f4c819fc640 1 -- 172.21.15.45:0/3757674903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c64005380 msgr2=0x7f4c6400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f238e541640 1 Processor -- start 2023-11-18T19:07:05.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f091658a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09080d5930 0x7f090800d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f091658a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f090804b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f091658a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f090804bf00 0x7f0908048320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f091658a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0908048e50 con 0x7f09080d5930 2023-11-18T19:07:05.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f091658a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090800c850 con 0x7f090804bf00 2023-11-18T19:07:05.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f091658a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090800cb30 con 0x7f09080d8200 2023-11-18T19:07:05.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.389+0000 7f238e541640 1 -- start start 2023-11-18T19:07:05.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7f090ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09080d5930 0x7f090800d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7f090ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09080d5930 0x7f090800d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38024/0 (socket says 172.21.15.45:38024) 2023-11-18T19:07:05.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7f090ffff640 1 -- 172.21.15.45:0/2118771006 learned_addr learned my addr 172.21.15.45:0/2118771006 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7fac448f2640 1 Processor -- start 2023-11-18T19:07:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7f4c819fc640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c64005380 0x7f4c6400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7f4c819fc640 1 -- 172.21.15.45:0/3757674903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c158d00 con 0x7f4c640047c0 2023-11-18T19:07:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7f4c829fe640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c64005380 0x7f4c6400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7f4c829fe640 1 -- 172.21.15.45:0/3757674903 reap_dead start 2023-11-18T19:07:05.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f090ffff640 1 -- 172.21.15.45:0/2118771006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 msgr2=0x7f090804b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f090ffff640 1 --2- 172.21.15.45:0/2118771006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f090804b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f090ffff640 1 -- 172.21.15.45:0/2118771006 >> v2:172.21.15.135:3300/0 conn(0x7f090804bf00 msgr2=0x7f0908048320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f090ffff640 1 --2- 172.21.15.45:0/2118771006 >> v2:172.21.15.135:3300/0 conn(0x7f090804bf00 0x7f0908048320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f090ffff640 1 -- 172.21.15.45:0/2118771006 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090800ce10 con 0x7f09080d5930 2023-11-18T19:07:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f238e541640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23880a4d40 0x7f2388150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f238e541640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880c0f00 0x7f23881514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f238e541640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23880c1cf0 con 0x7f23880a8470 2023-11-18T19:07:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f238e541640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23880c3c00 con 0x7f23880a4d40 2023-11-18T19:07:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f238e541640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23880c1f20 con 0x7f23880c0f00 2023-11-18T19:07:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f2387fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23880a8470 0x7f238806cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46982/0 (socket says 172.21.15.45:46982) 2023-11-18T19:07:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.391+0000 7f2387fff640 1 -- 172.21.15.45:0/789615093 learned_addr learned my addr 172.21.15.45:0/789615093 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:05.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.390+0000 7fac448f2640 1 -- start start 2023-11-18T19:07:05.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7f23877fe640 1 --2- 172.21.15.45:0/789615093 >> v2:172.21.15.45:3300/0 conn(0x7f23880a4d40 0x7f2388150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7f2386ffd640 1 -- 172.21.15.45:0/789615093 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167499904 0 0) 0x7f23880c1cf0 con 0x7f23880a8470 2023-11-18T19:07:05.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7f2386ffd640 1 -- 172.21.15.45:0/789615093 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2370003520 con 0x7f23880a8470 2023-11-18T19:07:05.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7f4c819fc640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c64004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00c160 tx=0x7f4c640057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5525727ec6a66ed server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7fac448f2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac380474a0 0x7fac38006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7fac448f2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3800a420 con 0x7fac380dbce0 2023-11-18T19:07:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7fac448f2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3800bb50 con 0x7fac380073e0 2023-11-18T19:07:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7fac448f2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac38048060 con 0x7fac380474a0 2023-11-18T19:07:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c007250 con 0x7f4c640047c0 2023-11-18T19:07:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.393+0000 7f238cade640 1 --2- 172.21.15.45:0/789615093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880c0f00 0x7f23881514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7fac3dd9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac380474a0 0x7fac38006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7fac3ed9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fac380073e0 0x7fac3800a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:37320/0 (socket says 172.21.15.45:37320) 2023-11-18T19:07:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7fac3ed9d640 1 -- 172.21.15.45:0/2811182633 learned_addr learned my addr 172.21.15.45:0/2811182633 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7f4c811fb640 1 -- 172.21.15.45:0/3757674903 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0073b0 con 0x7f4c640047c0 2023-11-18T19:07:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7f4c831ff640 1 -- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 msgr2=0x7f4c64004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c64004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00c160 tx=0x7f4c640057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7f4c831ff640 1 -- 172.21.15.45:0/3757674903 shutdown_connections 2023-11-18T19:07:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3757674903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c64004c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7f4c831ff640 1 -- 172.21.15.45:0/3757674903 >> 172.21.15.45:0/3757674903 conn(0x7f4c7c0a78a0 msgr2=0x7f4c7c0a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7f090ffff640 1 --2- 172.21.15.45:0/2118771006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09080d5930 0x7f090800d8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0908041470 tx=0x7f090402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7defc182178e6ea server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7f238cade640 1 -- 172.21.15.45:0/789615093 >> v2:172.21.15.45:3300/0 conn(0x7f23880a4d40 msgr2=0x7f2388150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7f238cade640 1 --2- 172.21.15.45:0/789615093 >> v2:172.21.15.45:3300/0 conn(0x7f23880a4d40 0x7f2388150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7f238cade640 1 -- 172.21.15.45:0/789615093 >> v1:172.21.15.45:6789/0 conn(0x7f23880a8470 legacy=0x7f238806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.394+0000 7f238cade640 1 -- 172.21.15.45:0/789615093 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23880c2200 con 0x7f23880c0f00 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7f090effd640 1 -- 172.21.15.45:0/2118771006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904030800 con 0x7f09080d5930 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7f090effd640 1 -- 172.21.15.45:0/2118771006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904030960 con 0x7f09080d5930 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7f090effd640 1 -- 172.21.15.45:0/2118771006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904030cf0 con 0x7f09080d5930 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328690234 0 0) 0x7fac3800bb50 con 0x7fac380073e0 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.395+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac28003520 con 0x7fac380073e0 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42073032 0 0) 0x7fac3800a420 con 0x7fac380dbce0 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac3800bb50 con 0x7fac380dbce0 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744961910 0 0) 0x7fac28003520 con 0x7fac380073e0 2023-11-18T19:07:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 >> v2:172.21.15.135:3300/0 conn(0x7fac380474a0 msgr2=0x7fac38006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 --2- 172.21.15.45:0/2811182633 >> v2:172.21.15.135:3300/0 conn(0x7fac380474a0 0x7fac38006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 >> v1:172.21.15.45:6789/0 conn(0x7fac380dbce0 legacy=0x7fac380df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3800a0f0 con 0x7fac380073e0 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fac4004f090 con 0x7fac380073e0 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 >> v1:172.21.15.135:6789/0 conn(0x7fac380073e0 legacy=0x7fac3800a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac28003b00 0x7fac28003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280047c0 0x7fac28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac28005180 0x7fac2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38048060 con 0x7fac280047c0 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2800bf40 con 0x7fac28005180 2023-11-18T19:07:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.396+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2800c100 con 0x7fac28003b00 2023-11-18T19:07:05.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.397+0000 7f238cade640 1 --2- 172.21.15.45:0/789615093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880c0f00 0x7f23881514a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23780097a0 tx=0x7f237802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb35e7e35347b92 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.397+0000 7fac3dd9b640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280047c0 0x7fac28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.397+0000 7f4c831ff640 1 -- 172.21.15.45:0/3757674903 shutdown_connections 2023-11-18T19:07:05.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.397+0000 7f4c831ff640 1 -- 172.21.15.45:0/3757674903 wait complete. 2023-11-18T19:07:05.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.397+0000 7fac3ed9d640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac28005180 0x7fac2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7fac3dd9b640 1 -- 172.21.15.45:0/2811182633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac28003b00 msgr2=0x7fac28003ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-18T19:07:05.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7fac3dd9b640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac28003b00 0x7fac28003ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7fac3dd9b640 1 -- 172.21.15.45:0/2811182633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac28005180 msgr2=0x7fac2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:05.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7fac3dd9b640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac28005180 0x7fac2800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7fac3dd9b640 1 -- 172.21.15.45:0/2811182633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3800a0f0 con 0x7fac280047c0 2023-11-18T19:07:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7f2386ffd640 1 -- 172.21.15.45:0/789615093 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780317c0 con 0x7f23880c0f00 2023-11-18T19:07:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7f2386ffd640 1 -- 172.21.15.45:0/789615093 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378031920 con 0x7f23880c0f00 2023-11-18T19:07:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7f2386ffd640 1 -- 172.21.15.45:0/789615093 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378031cf0 con 0x7f23880c0f00 2023-11-18T19:07:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7f091658a640 1 -- 172.21.15.45:0/2118771006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09080d5930 msgr2=0x7f090800d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7f091658a640 1 --2- 172.21.15.45:0/2118771006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09080d5930 0x7f090800d8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0908041470 tx=0x7f090402b940 comp rx=0 tx=0).stop 2023-11-18T19:07:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.399+0000 7fac3ed9d640 1 -- 172.21.15.45:0/2811182633 reap_dead start 2023-11-18T19:07:05.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.400+0000 7f238e541640 1 -- 172.21.15.45:0/789615093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880c0f00 msgr2=0x7f23881514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.400+0000 7f238e541640 1 --2- 172.21.15.45:0/789615093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880c0f00 0x7f23881514a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23780097a0 tx=0x7f237802b860 comp rx=0 tx=0).stop 2023-11-18T19:07:05.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7f091658a640 1 -- 172.21.15.45:0/2118771006 shutdown_connections 2023-11-18T19:07:05.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.398+0000 7f091658a640 1 --2- 172.21.15.45:0/2118771006 >> v2:172.21.15.135:3300/0 conn(0x7f090804bf00 0x7f0908048320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.399+0000 7f091658a640 1 --2- 172.21.15.45:0/2118771006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f090804b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.399+0000 7f091658a640 1 --2- 172.21.15.45:0/2118771006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09080d5930 0x7f090800d8f0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0908041470 tx=0x7f090402b940 comp rx=0 tx=0).stop 2023-11-18T19:07:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.399+0000 7f091658a640 1 -- 172.21.15.45:0/2118771006 >> 172.21.15.45:0/2118771006 conn(0x7f090804d9a0 msgr2=0x7f090804ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.400+0000 7f238e541640 1 -- 172.21.15.45:0/789615093 shutdown_connections 2023-11-18T19:07:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.400+0000 7fac3dd9b640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280047c0 0x7fac28004c40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac34009aa0 tx=0x7fac280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ea39413f026b08 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.400+0000 7f238e541640 1 --2- 172.21.15.45:0/789615093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880c0f00 0x7f23881514a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.400+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3402c5d0 con 0x7fac280047c0 2023-11-18T19:07:05.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.401+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3402c730 con 0x7fac280047c0 2023-11-18T19:07:05.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.401+0000 7fac3d59a640 1 -- 172.21.15.45:0/2811182633 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3402cae0 con 0x7fac280047c0 2023-11-18T19:07:05.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.401+0000 7f091658a640 1 -- 172.21.15.45:0/2118771006 shutdown_connections 2023-11-18T19:07:05.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.401+0000 7f091658a640 1 -- 172.21.15.45:0/2118771006 wait complete. 2023-11-18T19:07:05.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.401+0000 7f238e541640 1 --2- 172.21.15.45:0/789615093 >> v2:172.21.15.45:3300/0 conn(0x7f23880a4d40 0x7f2388150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.402+0000 7f238e541640 1 -- 172.21.15.45:0/789615093 >> 172.21.15.45:0/789615093 conn(0x7f23880a7980 msgr2=0x7f23880a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.402+0000 7fac448f2640 1 -- 172.21.15.45:0/2811182633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280047c0 msgr2=0x7fac28004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.401+0000 7f4c831ff640 1 Processor -- start 2023-11-18T19:07:05.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.401+0000 7f4c831ff640 1 -- start start 2023-11-18T19:07:05.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.402+0000 7fac448f2640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280047c0 0x7fac28004c40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac34009aa0 tx=0x7fac280057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.402+0000 7f238e541640 1 -- 172.21.15.45:0/789615093 shutdown_connections 2023-11-18T19:07:05.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.402+0000 7fac448f2640 1 -- 172.21.15.45:0/2811182633 shutdown_connections 2023-11-18T19:07:05.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.403+0000 7fac448f2640 1 --2- 172.21.15.45:0/2811182633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280047c0 0x7fac28004c40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.403+0000 7fac448f2640 1 -- 172.21.15.45:0/2811182633 >> 172.21.15.45:0/2811182633 conn(0x7fac38048250 msgr2=0x7fac38048660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.403+0000 7fac448f2640 1 -- 172.21.15.45:0/2811182633 shutdown_connections 2023-11-18T19:07:05.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.403+0000 7fac448f2640 1 -- 172.21.15.45:0/2811182633 wait complete. 2023-11-18T19:07:05.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.404+0000 7f238e541640 1 -- 172.21.15.45:0/789615093 wait complete. 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.404+0000 7f4c831ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c7c0a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.404+0000 7f4c831ff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c7c1554f0 0x7f4c7c14ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.404+0000 7f4c831ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c7c154fa0 0x7f4c7c14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.405+0000 7f4c831ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c14b5e0 con 0x7f4c7c154fa0 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.405+0000 7f4c831ff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1eee50 con 0x7f4c640047c0 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.405+0000 7f4c831ff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1ef380 con 0x7f4c7c1554f0 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.404+0000 7f4c821fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c7c0a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.405+0000 7f4c821fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c7c0a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42892/0 (socket says 172.21.15.45:42892) 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.405+0000 7f4c821fd640 1 -- 172.21.15.45:0/3522034568 learned_addr learned my addr 172.21.15.45:0/3522034568 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.406+0000 7f238e541640 1 Processor -- start 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.406+0000 7f091658a640 1 Processor -- start 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.407+0000 7f091658a640 1 -- start start 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f091658a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f090804bf00 0x7f0908009660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f091658a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f0908044440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f091658a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f090802eb60 0x7f0908007b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f091658a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080c30c0 con 0x7f090804bf00 2023-11-18T19:07:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f091658a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080c2b90 con 0x7f090802eb60 2023-11-18T19:07:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f091658a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09080409a0 con 0x7f09080d8200 2023-11-18T19:07:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.407+0000 7fac448f2640 1 Processor -- start 2023-11-18T19:07:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.407+0000 7fac448f2640 1 -- start start 2023-11-18T19:07:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.406+0000 7f4c819fc640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c7c1554f0 0x7f4c7c14ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f4c829fe640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c7c154fa0 0x7f4c7c14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f090f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f0908044440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.407+0000 7f238e541640 1 -- start start 2023-11-18T19:07:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f238e541640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23880a4d40 0x7f2388141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f238e541640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880a8470 0x7f23881543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f238e541640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23880c0f00 0x7f23881548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7fac448f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac280047c0 0x7fac38177960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f238e541640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388152ab0 con 0x7f23880c0f00 2023-11-18T19:07:05.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f238e541640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23881501e0 con 0x7f23880a4d40 2023-11-18T19:07:05.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.408+0000 7f238e541640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23880a9bb0 con 0x7f23880a8470 2023-11-18T19:07:05.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f090f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f0908044440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50500/0 (socket says 172.21.15.45:50500) 2023-11-18T19:07:05.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f090f7fe640 1 -- 172.21.15.45:0/193426983 learned_addr learned my addr 172.21.15.45:0/193426983 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7fac448f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac3803fa70 0x7fac380dd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7fac448f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3802cec0 0x7fac38174ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f4c829fe640 1 -- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c7c1554f0 msgr2=0x7f4c7c14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f4c829fe640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c7c1554f0 0x7f4c7c14ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f4c829fe640 1 -- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 msgr2=0x7f4c7c0a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f4c829fe640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c7c0a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f4c829fe640 1 -- 172.21.15.45:0/3522034568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c1ef0a0 con 0x7f4c7c154fa0 2023-11-18T19:07:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f4c819fc640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c7c1554f0 0x7f4c7c14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:05.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.410+0000 7fac448f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac381774d0 con 0x7fac3802cec0 2023-11-18T19:07:05.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.410+0000 7fac448f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38174410 con 0x7fac3803fa70 2023-11-18T19:07:05.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.410+0000 7fac448f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac381746f0 con 0x7fac280047c0 2023-11-18T19:07:05.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f4c821fd640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c7c0a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:05.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.410+0000 7f4c829fe640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c7c154fa0 0x7f4c7c14b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c156440 tx=0x7f4c700019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f0914b27640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f090802eb60 0x7f0908007b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.409+0000 7f090ffff640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f090804bf00 0x7f0908009660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.410+0000 7fac3ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3802cec0 0x7fac38174ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.410+0000 7fac3ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3802cec0 0x7fac38174ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38070/0 (socket says 172.21.15.45:38070) 2023-11-18T19:07:05.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.410+0000 7fac3ed9d640 1 -- 172.21.15.45:0/2436589847 learned_addr learned my addr 172.21.15.45:0/2436589847 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7fac3e59c640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac280047c0 0x7fac38177960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f238cade640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23880c0f00 0x7f23881548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7fac3dd9b640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac3803fa70 0x7fac380dd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7fac3ed9d640 1 -- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac280047c0 msgr2=0x7fac38177960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7fac3ed9d640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac280047c0 0x7fac38177960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f090ffff640 1 -- 172.21.15.45:0/193426983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 msgr2=0x7f0908044440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f090ffff640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f0908044440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f090ffff640 1 -- 172.21.15.45:0/193426983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f090802eb60 msgr2=0x7f0908007b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f090ffff640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f090802eb60 0x7f0908007b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f090ffff640 1 -- 172.21.15.45:0/193426983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040094d0 con 0x7f090804bf00 2023-11-18T19:07:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7fac3ed9d640 1 -- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac3803fa70 msgr2=0x7fac380dd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7fac3ed9d640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac3803fa70 0x7fac380dd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7fac3ed9d640 1 -- 172.21.15.45:0/2436589847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38176e80 con 0x7fac3802cec0 2023-11-18T19:07:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.412+0000 7fac3ed9d640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3802cec0 0x7fac38174ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fac4004fab0 tx=0x7fac40067fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f23877fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880a8470 0x7f23881543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f2387fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23880a4d40 0x7f2388141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.412+0000 7f2387fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23880a4d40 0x7f2388141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42920/0 (socket says 172.21.15.45:42920) 2023-11-18T19:07:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.412+0000 7fac2effd640 1 -- 172.21.15.45:0/2436589847 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40095480 con 0x7fac3802cec0 2023-11-18T19:07:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.412+0000 7f2387fff640 1 -- 172.21.15.45:0/4200216521 learned_addr learned my addr 172.21.15.45:0/4200216521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:05.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.411+0000 7f238cade640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23880c0f00 0x7f23881548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38078/0 (socket says 172.21.15.45:38078) 2023-11-18T19:07:05.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.413+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac38177160 con 0x7fac3802cec0 2023-11-18T19:07:05.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.413+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac38175220 con 0x7fac3802cec0 2023-11-18T19:07:05.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.413+0000 7fac2effd640 1 -- 172.21.15.45:0/2436589847 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400955e0 con 0x7fac3802cec0 2023-11-18T19:07:05.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.413+0000 7fac2effd640 1 -- 172.21.15.45:0/2436589847 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40095480 con 0x7fac3802cec0 2023-11-18T19:07:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f4c7affd640 1 -- 172.21.15.45:0/3522034568 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70011580 con 0x7f4c7c154fa0 2023-11-18T19:07:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f4c7affd640 1 -- 172.21.15.45:0/3522034568 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c700116e0 con 0x7f4c7c154fa0 2023-11-18T19:07:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f4c7affd640 1 -- 172.21.15.45:0/3522034568 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70011a50 con 0x7f4c7c154fa0 2023-11-18T19:07:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f2387fff640 1 -- 172.21.15.45:0/4200216521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880a8470 msgr2=0x7f23881543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.412+0000 7f090ffff640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f090804bf00 0x7f0908009660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0904033000 tx=0x7f0904004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.413+0000 7f090cff9640 1 -- 172.21.15.45:0/193426983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904047070 con 0x7f090804bf00 2023-11-18T19:07:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.413+0000 7f090cff9640 1 -- 172.21.15.45:0/193426983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904039b60 con 0x7f090804bf00 2023-11-18T19:07:05.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.413+0000 7f090cff9640 1 -- 172.21.15.45:0/193426983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904043400 con 0x7f090804bf00 2023-11-18T19:07:05.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f091658a640 1 -- 172.21.15.45:0/193426983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09080c2de0 con 0x7f090804bf00 2023-11-18T19:07:05.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f091658a640 1 -- 172.21.15.45:0/193426983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0908008040 con 0x7f090804bf00 2023-11-18T19:07:05.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c0a23b0 con 0x7f4c7c154fa0 2023-11-18T19:07:05.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c0a2970 con 0x7f4c7c154fa0 2023-11-18T19:07:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.414+0000 7f2387fff640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880a8470 0x7f23881543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.416+0000 7f2387fff640 1 -- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23880c0f00 msgr2=0x7f23881548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.416+0000 7f2387fff640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23880c0f00 0x7f23881548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.416+0000 7f2387fff640 1 -- 172.21.15.45:0/4200216521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378009400 con 0x7f23880a4d40 2023-11-18T19:07:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.416+0000 7f238cade640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23880c0f00 0x7f23881548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.417+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e8005250 con 0x7f090804bf00 2023-11-18T19:07:05.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.416+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c068410 con 0x7f4c7c154fa0 2023-11-18T19:07:05.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.418+0000 7f2387fff640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23880a4d40 0x7f2388141be0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c460 tx=0x7f237c00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.419+0000 7f2384ff9640 1 -- 172.21.15.45:0/4200216521 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c005ce0 con 0x7f23880a4d40 2023-11-18T19:07:05.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.419+0000 7f2384ff9640 1 -- 172.21.15.45:0/4200216521 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c005e40 con 0x7f23880a4d40 2023-11-18T19:07:05.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.419+0000 7f2384ff9640 1 -- 172.21.15.45:0/4200216521 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c007290 con 0x7f23880a4d40 2023-11-18T19:07:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.419+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23880a9e90 con 0x7f23880a4d40 2023-11-18T19:07:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.418+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24005250 con 0x7fac3802cec0 2023-11-18T19:07:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.421+0000 7f4c7affd640 1 -- 172.21.15.45:0/3522034568 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c70011bb0 con 0x7f4c7c154fa0 2023-11-18T19:07:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.422+0000 7fac2effd640 1 -- 172.21.15.45:0/2436589847 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac400721c0 con 0x7fac3802cec0 2023-11-18T19:07:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.423+0000 7fac2effd640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fac2006aea0 0x7fac2006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.420+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2388153e90 con 0x7f23880a4d40 2023-11-18T19:07:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.422+0000 7f090cff9640 1 -- 172.21.15.45:0/193426983 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f090404c410 con 0x7f090804bf00 2023-11-18T19:07:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.424+0000 7f090cff9640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08f406ae90 0x7f08f406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.424+0000 7f090cff9640 1 -- 172.21.15.45:0/193426983 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f090403e070 con 0x7f090804bf00 2023-11-18T19:07:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.425+0000 7f4c7affd640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4c6806ae90 0x7f4c6806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.425+0000 7f4c7affd640 1 -- 172.21.15.45:0/3522034568 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c70089510 con 0x7f4c7c154fa0 2023-11-18T19:07:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.426+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23880747c0 con 0x7f23880a4d40 2023-11-18T19:07:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.426+0000 7f090f7fe640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08f406ae90 0x7f08f406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.427+0000 7f4c821fd640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4c6806ae90 0x7f4c6806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.427+0000 7f2384ff9640 1 -- 172.21.15.45:0/4200216521 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f237c0073f0 con 0x7f23880a4d40 2023-11-18T19:07:05.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.423+0000 7fac2effd640 1 -- 172.21.15.45:0/2436589847 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac40090070 con 0x7fac3802cec0 2023-11-18T19:07:05.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.428+0000 7fac3e59c640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fac2006aea0 0x7fac2006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.428+0000 7f090f7fe640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08f406ae90 0x7f08f406d350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09080c4b30 tx=0x7f08fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.429+0000 7fac3e59c640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fac2006aea0 0x7fac2006d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac300018e0 tx=0x7fac30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.429+0000 7f4c821fd640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4c6806ae90 0x7f4c6806d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c74004a80 tx=0x7f4c740097f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.430+0000 7f2384ff9640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f237406af10 0x7f237406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:05.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.430+0000 7f2384ff9640 1 -- 172.21.15.45:0/4200216521 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f237c088e50 con 0x7f23880a4d40 2023-11-18T19:07:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.431+0000 7f4c7affd640 1 -- 172.21.15.45:0/3522034568 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c700543f0 con 0x7f4c7c154fa0 2023-11-18T19:07:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.431+0000 7f23877fe640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f237406af10 0x7f237406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.432+0000 7f23877fe640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f237406af10 0x7f237406d3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2388150650 tx=0x7f2380003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.436+0000 7f090cff9640 1 -- 172.21.15.45:0/193426983 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0904077570 con 0x7f090804bf00 2023-11-18T19:07:05.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.441+0000 7fac2effd640 1 -- 172.21.15.45:0/2436589847 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac400ce000 con 0x7fac3802cec0 2023-11-18T19:07:05.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.442+0000 7f2384ff9640 1 -- 172.21.15.45:0/4200216521 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f237c053c80 con 0x7f23880a4d40 2023-11-18T19:07:05.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.751+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde94005500 con 0x7fdeac0a94d0 2023-11-18T19:07:05.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.753+0000 7fdea2ffd640 1 -- 172.21.15.45:0/2627160354 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde9c079d40 con 0x7fdeac0a94d0 2023-11-18T19:07:05.754 INFO:teuthology.orchestra.run.smithi045.stdout:64424509448 2023-11-18T19:07:05.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.752+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9a94164b30 con 0x7f9a94071450 2023-11-18T19:07:05.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.757+0000 7f9a8bfff640 1 -- 172.21.15.45:0/1003801830 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a94164b30 con 0x7f9a94071450 2023-11-18T19:07:05.759 INFO:teuthology.orchestra.run.smithi045.stdout:64424509448 2023-11-18T19:07:05.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.761+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9a7406af40 msgr2=0x7f9a7406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.761+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9a7406af40 0x7f9a7406d400 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009220 tx=0x7f9a8c006a20 comp rx=0 tx=0).stop 2023-11-18T19:07:05.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.761+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a94071450 msgr2=0x7f9a940ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.761+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a94071450 0x7f9a940ab480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c033000 tx=0x7f9a7c0046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.762+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 shutdown_connections 2023-11-18T19:07:05.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.762+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a940c1220 0x7f9a940a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.762+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a94071450 0x7f9a940ab480 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.759+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fde9006ae70 msgr2=0x7fde9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.759+0000 7fdeb4578640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fde9006ae70 0x7fde9006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdea8000f60 tx=0x7fdea8007d70 comp rx=0 tx=0).stop 2023-11-18T19:07:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.762+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9a7406af40 0x7f9a7406d400 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009220 tx=0x7f9a8c006a20 comp rx=0 tx=0).stop 2023-11-18T19:07:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.759+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 msgr2=0x7fdeac154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.759+0000 7fdeb4578640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac154410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0c3550 tx=0x7fde9c004730 comp rx=0 tx=0).stop 2023-11-18T19:07:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.762+0000 7f9a98e4d640 1 --2- 172.21.15.45:0/1003801830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a94070d20 0x7f9a940a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.762+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 >> 172.21.15.45:0/1003801830 conn(0x7f9a940a78a0 msgr2=0x7f9a940bfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 shutdown_connections 2023-11-18T19:07:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7fdeb4578640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeac0aad20 0x7fdeac14ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7fdeb4578640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0a94d0 0x7fdeac154410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7fdeb4578640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fde9006ae70 0x7fde9006d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7fdeb4578640 1 --2- 172.21.15.45:0/2627160354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0a51e0 0x7fdeac1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 >> 172.21.15.45:0/2627160354 conn(0x7fdeac0c25c0 msgr2=0x7fdeac0a7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 shutdown_connections 2023-11-18T19:07:05.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.763+0000 7f9a98e4d640 1 -- 172.21.15.45:0/1003801830 wait complete. 2023-11-18T19:07:05.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.766+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 shutdown_connections 2023-11-18T19:07:05.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.766+0000 7fdeb4578640 1 -- 172.21.15.45:0/2627160354 wait complete. 2023-11-18T19:07:05.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.813+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa81c1ed6e0 con 0x7fa81c0c4980 2023-11-18T19:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.815+0000 7fa803fff640 1 -- 172.21.15.45:0/1794901876 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa81c1ed6e0 con 0x7fa81c0c4980 2023-11-18T19:07:05.817 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:05.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2023-11-18T19:07:05.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2023-11-18T19:07:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.821+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa80806af10 msgr2=0x7fa80806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.821+0000 7fa820e59640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa80806af10 0x7fa80806d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0095f0 tx=0x7fa80c006b50 comp rx=0 tx=0).stop 2023-11-18T19:07:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.821+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0c4980 msgr2=0x7fa81c1edf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.821+0000 7fa820e59640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0c4980 0x7fa81c1edf00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa814037040 tx=0x7fa814004ab0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.822+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 shutdown_connections 2023-11-18T19:07:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.822+0000 7fa820e59640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0c4980 0x7fa81c1edf00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.822+0000 7fa820e59640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa80806af10 0x7fa80806d3d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.822+0000 7fa820e59640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa81c0c0b90 0x7fa81c1ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.822+0000 7fa820e59640 1 --2- 172.21.15.45:0/1794901876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa81c0a5390 0x7fa81c14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.822+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 >> 172.21.15.45:0/1794901876 conn(0x7fa81c0c2660 msgr2=0x7fa81c0c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.823+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 shutdown_connections 2023-11-18T19:07:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.823+0000 7fa820e59640 1 -- 172.21.15.45:0/1794901876 wait complete. 2023-11-18T19:07:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.830+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4c7c0a2b60 con 0x7f4c7c154fa0 2023-11-18T19:07:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.830+0000 7f4c7affd640 1 -- 172.21.15.45:0/3522034568 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c70023020 con 0x7f4c7c154fa0 2023-11-18T19:07:05.832 INFO:teuthology.orchestra.run.smithi045.stdout:55834574856 2023-11-18T19:07:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.832+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4c6806ae90 msgr2=0x7f4c6806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.832+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4c6806ae90 0x7f4c6806d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c74004a80 tx=0x7f4c740097f0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.832+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c7c154fa0 msgr2=0x7f4c7c14b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.832+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c7c154fa0 0x7f4c7c14b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c156440 tx=0x7f4c700019d0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 shutdown_connections 2023-11-18T19:07:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c7c154fa0 0x7f4c7c14b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4c6806ae90 0x7f4c6806d350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c7c1554f0 0x7f4c7c14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 --2- 172.21.15.45:0/3522034568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c640047c0 0x7f4c7c0a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 >> 172.21.15.45:0/3522034568 conn(0x7f4c7c0a78a0 msgr2=0x7f4c7c0c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 shutdown_connections 2023-11-18T19:07:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.833+0000 7f4c831ff640 1 -- 172.21.15.45:0/3522034568 wait complete. 2023-11-18T19:07:05.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2023-11-18T19:07:05.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2023-11-18T19:07:05.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.857+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fac24005500 con 0x7fac3802cec0 2023-11-18T19:07:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.858+0000 7fac2effd640 1 -- 172.21.15.45:0/2436589847 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac400d1620 con 0x7fac3802cec0 2023-11-18T19:07:05.859 INFO:teuthology.orchestra.run.smithi045.stdout:64424509447 2023-11-18T19:07:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.861+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fac2006aea0 msgr2=0x7fac2006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.861+0000 7fac448f2640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fac2006aea0 0x7fac2006d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac300018e0 tx=0x7fac30009040 comp rx=0 tx=0).stop 2023-11-18T19:07:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.861+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3802cec0 msgr2=0x7fac38174ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.861+0000 7fac448f2640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3802cec0 0x7fac38174ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fac4004fab0 tx=0x7fac40067fc0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 shutdown_connections 2023-11-18T19:07:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac3802cec0 0x7fac38174ce0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac3803fa70 0x7fac380dd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fac2006aea0 0x7fac2006d360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 --2- 172.21.15.45:0/2436589847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac280047c0 0x7fac38177960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 >> 172.21.15.45:0/2436589847 conn(0x7fac38048250 msgr2=0x7fac38048630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 shutdown_connections 2023-11-18T19:07:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.862+0000 7fac448f2640 1 -- 172.21.15.45:0/2436589847 wait complete. 2023-11-18T19:07:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.873+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51341d9e10 con 0x7f513406d180 2023-11-18T19:07:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.874+0000 7f5129ffb640 1 -- 172.21.15.45:0/1352475723 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51341d9e10 con 0x7f513406d180 2023-11-18T19:07:05.875 INFO:teuthology.orchestra.run.smithi045.stdout:64424509448 2023-11-18T19:07:05.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f511806ae90 msgr2=0x7f511806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f511806ae90 0x7f511806d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51340ac0a0 tx=0x7f5130008040 comp rx=0 tx=0).stop 2023-11-18T19:07:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 msgr2=0x7f51341edba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f51341edba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f512c00efc0 tx=0x7f512c00c490 comp rx=0 tx=0).stop 2023-11-18T19:07:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 shutdown_connections 2023-11-18T19:07:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51340c0f00 0x7f51341dafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51340a4d40 0x7f51341daa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f511806ae90 0x7f511806d350 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 --2- 172.21.15.45:0/1352475723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f513406d180 0x7f51341edba0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 >> 172.21.15.45:0/1352475723 conn(0x7f51340a7980 msgr2=0x7f51340a56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 shutdown_connections 2023-11-18T19:07:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.877+0000 7f513b644640 1 -- 172.21.15.45:0/1352475723 wait complete. 2023-11-18T19:07:05.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2023-11-18T19:07:05.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2023-11-18T19:07:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.903+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f08e80057d0 con 0x7f090804bf00 2023-11-18T19:07:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.904+0000 7f090cff9640 1 -- 172.21.15.45:0/193426983 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f090407ab90 con 0x7f090804bf00 2023-11-18T19:07:05.907 INFO:teuthology.orchestra.run.smithi045.stdout:64424509448 2023-11-18T19:07:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.907+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08f406ae90 msgr2=0x7f08f406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.907+0000 7f08fa7fc640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08f406ae90 0x7f08f406d350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09080c4b30 tx=0x7f08fc008040 comp rx=0 tx=0).stop 2023-11-18T19:07:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.907+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f090804bf00 msgr2=0x7f0908009660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.907+0000 7f08fa7fc640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f090804bf00 0x7f0908009660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0904033000 tx=0x7f0904004730 comp rx=0 tx=0).stop 2023-11-18T19:07:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 shutdown_connections 2023-11-18T19:07:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f090802eb60 0x7f0908007b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08f406ae90 0x7f08f406d350 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09080d8200 0x7f0908044440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 --2- 172.21.15.45:0/193426983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f090804bf00 0x7f0908009660 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 >> 172.21.15.45:0/193426983 conn(0x7f090804d9a0 msgr2=0x7f090804dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 shutdown_connections 2023-11-18T19:07:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.908+0000 7f08fa7fc640 1 -- 172.21.15.45:0/193426983 wait complete. 2023-11-18T19:07:05.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2023-11-18T19:07:05.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.953+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f23880c0ce0 con 0x7f23880a4d40 2023-11-18T19:07:05.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.954+0000 7f2384ff9640 1 -- 172.21.15.45:0/4200216521 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f237c0572a0 con 0x7f23880a4d40 2023-11-18T19:07:05.956 INFO:teuthology.orchestra.run.smithi045.stdout:64424509448 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f237406af10 msgr2=0x7f237406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f237406af10 0x7f237406d3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2388150650 tx=0x7f2380003990 comp rx=0 tx=0).stop 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23880a4d40 msgr2=0x7f2388141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23880a4d40 0x7f2388141be0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c460 tx=0x7f237c00c920 comp rx=0 tx=0).stop 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 shutdown_connections 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23880c0f00 0x7f23881548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f237406af10 0x7f237406d3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23880a8470 0x7f23881543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 --2- 172.21.15.45:0/4200216521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23880a4d40 0x7f2388141be0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 >> 172.21.15.45:0/4200216521 conn(0x7f23880a7980 msgr2=0x7f2388071100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.958+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 shutdown_connections 2023-11-18T19:07:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:05.959+0000 7f238e541640 1 -- 172.21.15.45:0/4200216521 wait complete. 2023-11-18T19:07:05.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2023-11-18T19:07:06.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-18T19:07:06.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-18T19:07:06.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-18T19:07:06.853 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-18T19:07:06.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-18T19:07:06.907 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-18T19:07:06.935 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-18T19:07:06.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-18T19:07:07.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.107+0000 7f9a16789640 1 Processor -- start 2023-11-18T19:07:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.108+0000 7f9a16789640 1 -- start start 2023-11-18T19:07:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.110+0000 7f9a16789640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a10151d70 0x7f9a100c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.110+0000 7f9a16789640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100c8a10 con 0x7f9a100c6a30 2023-11-18T19:07:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.110+0000 7f9a16789640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10154920 con 0x7f9a100c7f20 2023-11-18T19:07:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.110+0000 7f9a16789640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1006c8b0 con 0x7f9a10151d70 2023-11-18T19:07:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.112+0000 7f9a0ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a10151d70 0x7f9a100c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.112+0000 7f9a0ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a10151d70 0x7f9a100c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38084/0 (socket says 172.21.15.45:38084) 2023-11-18T19:07:07.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.112+0000 7f9a0ffff640 1 -- 172.21.15.45:0/2055570015 learned_addr learned my addr 172.21.15.45:0/2055570015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.114+0000 7f9a0ffff640 1 -- 172.21.15.45:0/2055570015 >> v1:172.21.15.135:6789/0 conn(0x7f9a100c7f20 legacy=0x7f9a100ca520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T19:07:07.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.117+0000 7f9a0ffff640 1 -- 172.21.15.45:0/2055570015 >> v1:172.21.15.45:6789/0 conn(0x7f9a100c6a30 legacy=0x7f9a100c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.117+0000 7f9a0ffff640 1 -- 172.21.15.45:0/2055570015 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10154c00 con 0x7f9a10151d70 2023-11-18T19:07:07.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.128+0000 7f9a0ffff640 1 --2- 172.21.15.45:0/2055570015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a100c8430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009e50 tx=0x7f9a0802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df34378c3d9e35b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.128+0000 7f9a0effd640 1 -- 172.21.15.45:0/2055570015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0802ca80 con 0x7f9a10151d70 2023-11-18T19:07:07.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.130+0000 7f9a0effd640 1 -- 172.21.15.45:0/2055570015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0802cbe0 con 0x7f9a10151d70 2023-11-18T19:07:07.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.130+0000 7f9a0effd640 1 -- 172.21.15.45:0/2055570015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080343f0 con 0x7f9a10151d70 2023-11-18T19:07:07.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.131+0000 7f9a16789640 1 -- 172.21.15.45:0/2055570015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 msgr2=0x7f9a100c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.131+0000 7f9a16789640 1 --2- 172.21.15.45:0/2055570015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a100c8430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009e50 tx=0x7f9a0802bee0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.132+0000 7f9a16789640 1 -- 172.21.15.45:0/2055570015 shutdown_connections 2023-11-18T19:07:07.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.132+0000 7f9a16789640 1 --2- 172.21.15.45:0/2055570015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a100c8430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.132+0000 7f9a16789640 1 -- 172.21.15.45:0/2055570015 >> 172.21.15.45:0/2055570015 conn(0x7f9a10066610 msgr2=0x7f9a10066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.132+0000 7f9a16789640 1 -- 172.21.15.45:0/2055570015 shutdown_connections 2023-11-18T19:07:07.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.132+0000 7f9a16789640 1 -- 172.21.15.45:0/2055570015 wait complete. 2023-11-18T19:07:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.139+0000 7f9a16789640 1 Processor -- start 2023-11-18T19:07:07.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.140+0000 7f9a16789640 1 -- start start 2023-11-18T19:07:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.143+0000 7f9a16789640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a100c6a30 0x7f9a101538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.143+0000 7f9a16789640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a100c7f20 0x7f9a101ec540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.143+0000 7f9a16789640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a101eca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a100c6a30 0x7f9a101538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a100c6a30 0x7f9a101538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42936/0 (socket says 172.21.15.45:42936) 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a0f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a100c7f20 0x7f9a101ec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a0f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a100c7f20 0x7f9a101ec540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50542/0 (socket says 172.21.15.45:50542) 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a16789640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a101eb050 con 0x7f9a10151d70 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a16789640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a101e9b60 con 0x7f9a100c6a30 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a16789640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100aef80 con 0x7f9a100c7f20 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.147+0000 7f9a0ffff640 1 -- 172.21.15.45:0/2152289338 learned_addr learned my addr 172.21.15.45:0/2152289338 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.148+0000 7f9a14d26640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a101eca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.149+0000 7f9a14d26640 1 -- 172.21.15.45:0/2152289338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a100c7f20 msgr2=0x7f9a101ec540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.149+0000 7f9a14d26640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a100c7f20 0x7f9a101ec540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.149+0000 7f9a14d26640 1 -- 172.21.15.45:0/2152289338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a100c6a30 msgr2=0x7f9a101538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.149+0000 7f9a14d26640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a100c6a30 0x7f9a101538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.149+0000 7f9a14d26640 1 -- 172.21.15.45:0/2152289338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009b30 con 0x7f9a10151d70 2023-11-18T19:07:07.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.150+0000 7f9a14d26640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a101eca80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000b410 tx=0x7f9a0000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.151+0000 7f9a0cff9640 1 -- 172.21.15.45:0/2152289338 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00011830 con 0x7f9a10151d70 2023-11-18T19:07:07.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.151+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100af260 con 0x7f9a10151d70 2023-11-18T19:07:07.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.151+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a100af820 con 0x7f9a10151d70 2023-11-18T19:07:07.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.151+0000 7f9a0cff9640 1 -- 172.21.15.45:0/2152289338 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a000119b0 con 0x7f9a10151d70 2023-11-18T19:07:07.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.151+0000 7f9a0cff9640 1 -- 172.21.15.45:0/2152289338 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00011d60 con 0x7f9a10151d70 2023-11-18T19:07:07.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.154+0000 7fa57538a640 1 Processor -- start 2023-11-18T19:07:07.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.154+0000 7fa57538a640 1 -- start start 2023-11-18T19:07:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.156+0000 7fa57538a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5701565d0 0x7fa5700c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.156+0000 7fa57538a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5700724c0 0x7fa5700c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.156+0000 7fa57538a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5700c1590 0x7fa5700c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.156+0000 7fa57538a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa570159530 con 0x7fa5700724c0 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.156+0000 7fa57538a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700c23b0 con 0x7fa5700c1590 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.156+0000 7fa57538a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa570158e70 con 0x7fa5701565d0 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.157+0000 7fa56f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5700c1590 0x7fa5700c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.157+0000 7fa56effd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5701565d0 0x7fa5700c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.157+0000 7fa56f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa5700c1590 0x7fa5700c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42944/0 (socket says 172.21.15.45:42944) 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.157+0000 7fa56f7fe640 1 -- 172.21.15.45:0/1733479160 learned_addr learned my addr 172.21.15.45:0/1733479160 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.157+0000 7fa56e7fc640 1 --2- 172.21.15.45:0/1733479160 >> v2:172.21.15.45:3300/0 conn(0x7fa5700724c0 0x7fa5700c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.158+0000 7ff8aa1a7640 1 Processor -- start 2023-11-18T19:07:07.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.158+0000 7fa56f7fe640 1 -- 172.21.15.45:0/1733479160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5701565d0 msgr2=0x7fa5700c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.158+0000 7fa56f7fe640 1 --2- 172.21.15.45:0/1733479160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5701565d0 0x7fa5700c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.158+0000 7fa56f7fe640 1 -- 172.21.15.45:0/1733479160 >> v2:172.21.15.45:3300/0 conn(0x7fa5700724c0 msgr2=0x7fa5700c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.158+0000 7fa56f7fe640 1 --2- 172.21.15.45:0/1733479160 >> v2:172.21.15.45:3300/0 conn(0x7fa5700724c0 0x7fa5700c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.158+0000 7fa56f7fe640 1 -- 172.21.15.45:0/1733479160 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570159150 con 0x7fa5700c1590 2023-11-18T19:07:07.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.156+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f0005250 con 0x7f9a10151d70 2023-11-18T19:07:07.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.159+0000 7ff8aa1a7640 1 -- start start 2023-11-18T19:07:07.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.161+0000 7ff8aa1a7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff8a4153b10 0x7ff8a4153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.161+0000 7ff8aa1a7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a40a83c0 0x7ff8a4154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.161+0000 7ff8aa1a7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40c5930 con 0x7ff8a40710d0 2023-11-18T19:07:07.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.161+0000 7ff8aa1a7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a4071c70 con 0x7ff8a4153b10 2023-11-18T19:07:07.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.161+0000 7ff8aa1a7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4072290 con 0x7ff8a40a83c0 2023-11-18T19:07:07.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.162+0000 7fa56f7fe640 1 --2- 172.21.15.45:0/1733479160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5700c1590 0x7fa5700c3ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa57006bb20 tx=0x7fa55802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cad226d42aa0929 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.160+0000 7f9a0cff9640 1 -- 172.21.15.45:0/2152289338 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a0001a400 con 0x7f9a10151d70 2023-11-18T19:07:07.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.162+0000 7ff8a89a4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a40a83c0 0x7ff8a4154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.162+0000 7ff8a89a4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a40a83c0 0x7ff8a4154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50558/0 (socket says 172.21.15.45:50558) 2023-11-18T19:07:07.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.162+0000 7ff8a89a4640 1 -- 172.21.15.45:0/4231536510 learned_addr learned my addr 172.21.15.45:0/4231536510 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.162+0000 7ff8a91a5640 1 --2- 172.21.15.45:0/4231536510 >> v2:172.21.15.135:3300/0 conn(0x7ff8a4153b10 0x7ff8a4153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.163+0000 7fa56dffb640 1 -- 172.21.15.45:0/1733479160 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558031780 con 0x7fa5700c1590 2023-11-18T19:07:07.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.165+0000 7fa56dffb640 1 -- 172.21.15.45:0/1733479160 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5580318e0 con 0x7fa5700c1590 2023-11-18T19:07:07.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.165+0000 7fa56dffb640 1 -- 172.21.15.45:0/1733479160 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558031cb0 con 0x7fa5700c1590 2023-11-18T19:07:07.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.163+0000 7ff8a89a4640 1 -- 172.21.15.45:0/4231536510 >> v2:172.21.15.135:3300/0 conn(0x7ff8a4153b10 msgr2=0x7ff8a4153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.163+0000 7ff8a89a4640 1 --2- 172.21.15.45:0/4231536510 >> v2:172.21.15.135:3300/0 conn(0x7ff8a4153b10 0x7ff8a4153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.163+0000 7ff8a89a4640 1 -- 172.21.15.45:0/4231536510 >> v1:172.21.15.135:6789/0 conn(0x7ff8a40710d0 legacy=0x7ff8a4071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.163+0000 7ff8a89a4640 1 -- 172.21.15.45:0/4231536510 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4154ad0 con 0x7ff8a40a83c0 2023-11-18T19:07:07.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.167+0000 7fa57538a640 1 -- 172.21.15.45:0/1733479160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5700c1590 msgr2=0x7fa5700c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.167+0000 7fa57538a640 1 --2- 172.21.15.45:0/1733479160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5700c1590 0x7fa5700c3ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa57006bb20 tx=0x7fa55802b820 comp rx=0 tx=0).stop 2023-11-18T19:07:07.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.167+0000 7ff8a89a4640 1 --2- 172.21.15.45:0/4231536510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a40a83c0 0x7ff8a4154590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff894009870 tx=0x7ff89402dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a003a1c41cd6bffb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.168+0000 7fa57538a640 1 -- 172.21.15.45:0/1733479160 shutdown_connections 2023-11-18T19:07:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.168+0000 7fa57538a640 1 --2- 172.21.15.45:0/1733479160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5700c1590 0x7fa5700c3ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.168+0000 7fa57538a640 1 --2- 172.21.15.45:0/1733479160 >> v2:172.21.15.45:3300/0 conn(0x7fa5700724c0 0x7fa5700c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.168+0000 7fa57538a640 1 --2- 172.21.15.45:0/1733479160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5701565d0 0x7fa5700c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.168+0000 7fa57538a640 1 -- 172.21.15.45:0/1733479160 >> 172.21.15.45:0/1733479160 conn(0x7fa5700a7980 msgr2=0x7fa5700a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.169+0000 7fa57538a640 1 -- 172.21.15.45:0/1733479160 shutdown_connections 2023-11-18T19:07:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.169+0000 7fa57538a640 1 -- 172.21.15.45:0/1733479160 wait complete. 2023-11-18T19:07:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.166+0000 7f9a0cff9640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f99fc06ae40 0x7f99fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.166+0000 7f9a0cff9640 1 -- 172.21.15.45:0/2152289338 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a00089960 con 0x7f9a10151d70 2023-11-18T19:07:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.168+0000 7ff89bfff640 1 -- 172.21.15.45:0/4231536510 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89402f870 con 0x7ff8a40a83c0 2023-11-18T19:07:07.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.170+0000 7ff89bfff640 1 -- 172.21.15.45:0/4231536510 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89402f9d0 con 0x7ff8a40a83c0 2023-11-18T19:07:07.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.170+0000 7ff89bfff640 1 -- 172.21.15.45:0/4231536510 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89402fda0 con 0x7ff8a40a83c0 2023-11-18T19:07:07.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.172+0000 7fa57538a640 1 Processor -- start 2023-11-18T19:07:07.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.173+0000 7fa57538a640 1 -- start start 2023-11-18T19:07:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.173+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/4231536510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a40a83c0 msgr2=0x7ff8a4154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.173+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/4231536510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a40a83c0 0x7ff8a4154590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff894009870 tx=0x7ff89402dab0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/4231536510 shutdown_connections 2023-11-18T19:07:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/4231536510 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a40a83c0 0x7ff8a4154590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/4231536510 >> v2:172.21.15.135:3300/0 conn(0x7ff8a4153b10 0x7ff8a4153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/4231536510 >> 172.21.15.45:0/4231536510 conn(0x7ff8a40a78a0 msgr2=0x7ff8a40a7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.173+0000 7f9a0ffff640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f99fc06ae40 0x7f99fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7fa57538a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700724c0 0x7fa5700c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7fa57538a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5700c1590 0x7fa5700719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7fa57538a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5701565d0 0x7fa570071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.175+0000 7fa57538a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5701f2220 con 0x7fa5700c1590 2023-11-18T19:07:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.175+0000 7fa57538a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5701f2500 con 0x7fa5701565d0 2023-11-18T19:07:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.175+0000 7fa57538a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa570070f10 con 0x7fa5700724c0 2023-11-18T19:07:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.175+0000 7fa56effd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700724c0 0x7fa5700c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.175+0000 7f9a0cff9640 1 -- 172.21.15.45:0/2152289338 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a00054720 con 0x7f9a10151d70 2023-11-18T19:07:07.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.175+0000 7f9a0ffff640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f99fc06ae40 0x7f99fc06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a0802bf20 tx=0x7f9a08030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.176+0000 7fa56e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5700c1590 0x7fa5700719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.176+0000 7fa56effd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700724c0 0x7fa5700c4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50564/0 (socket says 172.21.15.45:50564) 2023-11-18T19:07:07.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.176+0000 7fa56effd640 1 -- 172.21.15.45:0/2025849299 learned_addr learned my addr 172.21.15.45:0/2025849299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.176+0000 7fa56e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5700c1590 0x7fa5700719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38120/0 (socket says 172.21.15.45:38120) 2023-11-18T19:07:07.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.176+0000 7fa56f7fe640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5701565d0 0x7fa570071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.174+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/4231536510 shutdown_connections 2023-11-18T19:07:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.175+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/4231536510 wait complete. 2023-11-18T19:07:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.177+0000 7fa56effd640 1 -- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5701565d0 msgr2=0x7fa570071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.177+0000 7fa56effd640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5701565d0 0x7fa570071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.177+0000 7fa56effd640 1 -- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5700c1590 msgr2=0x7fa5700719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.177+0000 7fa56effd640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5700c1590 0x7fa5700719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.177+0000 7fa56effd640 1 -- 172.21.15.45:0/2025849299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580094d0 con 0x7fa5700724c0 2023-11-18T19:07:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.178+0000 7fa56e7fc640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5700c1590 0x7fa5700719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.178+0000 7fa56f7fe640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5701565d0 0x7fa570071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.179+0000 7f2505778640 1 Processor -- start 2023-11-18T19:07:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.179+0000 7fa56effd640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700724c0 0x7fa5700c4940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa56800e870 tx=0x7fa56800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.180+0000 7fa5677fe640 1 -- 172.21.15.45:0/2025849299 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5680094f0 con 0x7fa5700724c0 2023-11-18T19:07:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.180+0000 7fa5677fe640 1 -- 172.21.15.45:0/2025849299 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800c940 con 0x7fa5700724c0 2023-11-18T19:07:07.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.180+0000 7fa5677fe640 1 -- 172.21.15.45:0/2025849299 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800ccf0 con 0x7fa5700724c0 2023-11-18T19:07:07.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.181+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5700711f0 con 0x7fa5700724c0 2023-11-18T19:07:07.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.181+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5700c4e80 con 0x7fa5700724c0 2023-11-18T19:07:07.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.182+0000 7ff8aa1a7640 1 Processor -- start 2023-11-18T19:07:07.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.179+0000 7f2505778640 1 -- start start 2023-11-18T19:07:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.181+0000 7f2505778640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f250006d180 0x7f2500150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.181+0000 7f2505778640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25000c0f00 0x7f25001514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.181+0000 7f2505778640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000c1cf0 con 0x7f25000a4d40 2023-11-18T19:07:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.181+0000 7f2505778640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25000c24e0 con 0x7f25000c0f00 2023-11-18T19:07:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.181+0000 7f2505778640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25000c3c00 con 0x7f250006d180 2023-11-18T19:07:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.182+0000 7f24fe7fc640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f25000a4d40 0x7f25000c43c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:37352/0 (socket says 172.21.15.45:37352) 2023-11-18T19:07:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.182+0000 7f24fe7fc640 1 -- 172.21.15.45:0/2827753215 learned_addr learned my addr 172.21.15.45:0/2827753215 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.183+0000 7f24ff7fe640 1 --2- 172.21.15.45:0/2827753215 >> v2:172.21.15.45:3300/0 conn(0x7f25000c0f00 0x7f25001514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.183+0000 7f24feffd640 1 --2- 172.21.15.45:0/2827753215 >> v2:172.21.15.135:3300/0 conn(0x7f250006d180 0x7f2500150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.184+0000 7f24ff7fe640 1 -- 172.21.15.45:0/2827753215 >> v2:172.21.15.135:3300/0 conn(0x7f250006d180 msgr2=0x7f2500150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.184+0000 7f24ff7fe640 1 --2- 172.21.15.45:0/2827753215 >> v2:172.21.15.135:3300/0 conn(0x7f250006d180 0x7f2500150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.184+0000 7f24ff7fe640 1 -- 172.21.15.45:0/2827753215 >> v1:172.21.15.135:6789/0 conn(0x7f25000a4d40 legacy=0x7f25000c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.184+0000 7f24ff7fe640 1 -- 172.21.15.45:0/2827753215 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000c1f20 con 0x7f25000c0f00 2023-11-18T19:07:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.184+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa570071710 con 0x7fa5700724c0 2023-11-18T19:07:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.183+0000 7ff8aa1a7640 1 -- start start 2023-11-18T19:07:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8aa1a7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a40710d0 0x7ff8a41e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8aa1a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a40a83c0 0x7ff8a4147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8aa1a7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a4153b10 0x7ff8a4150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8aa1a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4148760 con 0x7ff8a40a83c0 2023-11-18T19:07:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8aa1a7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40a8e40 con 0x7ff8a40710d0 2023-11-18T19:07:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8aa1a7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41482e0 con 0x7ff8a4153b10 2023-11-18T19:07:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8a91a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a40710d0 0x7ff8a41e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8a91a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a40710d0 0x7ff8a41e64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:42968/0 (socket says 172.21.15.45:42968) 2023-11-18T19:07:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.186+0000 7ff8a91a5640 1 -- 172.21.15.45:0/1994821811 learned_addr learned my addr 172.21.15.45:0/1994821811 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.186+0000 7f24ff7fe640 1 --2- 172.21.15.45:0/2827753215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000c0f00 0x7f25001514a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f250006b340 tx=0x7f24f002d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ca4f22dcfd9866 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.185+0000 7ff8a99a6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a4153b10 0x7ff8a4150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7ff8a91a5640 1 -- 172.21.15.45:0/1994821811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a4153b10 msgr2=0x7ff8a4150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7ff8a91a5640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a4153b10 0x7ff8a4150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7ff8a91a5640 1 -- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a40a83c0 msgr2=0x7ff8a4147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7ff8a91a5640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a40a83c0 0x7ff8a4147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7ff8a91a5640 1 -- 172.21.15.45:0/1994821811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940094d0 con 0x7ff8a40710d0 2023-11-18T19:07:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7f24fdffb640 1 -- 172.21.15.45:0/2827753215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0032880 con 0x7f25000c0f00 2023-11-18T19:07:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7f24fdffb640 1 -- 172.21.15.45:0/2827753215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f00329e0 con 0x7f25000c0f00 2023-11-18T19:07:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.187+0000 7f24fdffb640 1 -- 172.21.15.45:0/2827753215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0032d70 con 0x7f25000c0f00 2023-11-18T19:07:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.188+0000 7f2505778640 1 -- 172.21.15.45:0/2827753215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000c0f00 msgr2=0x7f25001514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.188+0000 7f2505778640 1 --2- 172.21.15.45:0/2827753215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000c0f00 0x7f25001514a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f250006b340 tx=0x7f24f002d9c0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.189+0000 7ff8a91a5640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a40710d0 0x7ff8a41e64d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000e870 tx=0x7ff8a000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.188+0000 7fa5677fe640 1 -- 172.21.15.45:0/2025849299 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa568013470 con 0x7fa5700724c0 2023-11-18T19:07:07.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.189+0000 7f2505778640 1 -- 172.21.15.45:0/2827753215 shutdown_connections 2023-11-18T19:07:07.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.189+0000 7f2505778640 1 --2- 172.21.15.45:0/2827753215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000c0f00 0x7f25001514a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.189+0000 7f2505778640 1 --2- 172.21.15.45:0/2827753215 >> v2:172.21.15.135:3300/0 conn(0x7f250006d180 0x7f2500150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.189+0000 7ff899ffb640 1 -- 172.21.15.45:0/1994821811 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00094f0 con 0x7ff8a40710d0 2023-11-18T19:07:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.190+0000 7ff899ffb640 1 -- 172.21.15.45:0/1994821811 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a000c940 con 0x7ff8a40710d0 2023-11-18T19:07:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.190+0000 7ff899ffb640 1 -- 172.21.15.45:0/1994821811 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000ccf0 con 0x7ff8a40710d0 2023-11-18T19:07:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.190+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a414e320 con 0x7ff8a40710d0 2023-11-18T19:07:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.190+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a414e8e0 con 0x7ff8a40710d0 2023-11-18T19:07:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.189+0000 7f2505778640 1 -- 172.21.15.45:0/2827753215 >> 172.21.15.45:0/2827753215 conn(0x7f25000a7980 msgr2=0x7f25000a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.191+0000 7f2505778640 1 -- 172.21.15.45:0/2827753215 shutdown_connections 2023-11-18T19:07:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.192+0000 7f2505778640 1 -- 172.21.15.45:0/2827753215 wait complete. 2023-11-18T19:07:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.189+0000 7fa5677fe640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55006af10 0x7fa55006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.190+0000 7fa5677fe640 1 -- 172.21.15.45:0/2025849299 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa568089900 con 0x7fa5700724c0 2023-11-18T19:07:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.191+0000 7fa56e7fc640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55006af10 0x7fa55006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.192+0000 7fa56e7fc640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55006af10 0x7fa55006d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5700c5640 tx=0x7fa560009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.193+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a4067940 con 0x7ff8a40710d0 2023-11-18T19:07:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.194+0000 7f2505778640 1 Processor -- start 2023-11-18T19:07:07.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.195+0000 7f2505778640 1 -- start start 2023-11-18T19:07:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7f2505778640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f250006d180 0x7f25001e9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.195+0000 7ff899ffb640 1 -- 172.21.15.45:0/1994821811 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8a0013470 con 0x7ff8a40710d0 2023-11-18T19:07:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7ff899ffb640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff88806ae90 0x7ff88806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7ff899ffb640 1 -- 172.21.15.45:0/1994821811 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff8a00898b0 con 0x7ff8a40710d0 2023-11-18T19:07:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7f2505778640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000a4d40 0x7f25000a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7f2505778640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25000c0f00 0x7f2500071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7f2505778640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2500154cf0 con 0x7f25000a4d40 2023-11-18T19:07:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7f24feffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f250006d180 0x7f25001e9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7f2505778640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250014cc70 con 0x7f25000c0f00 2023-11-18T19:07:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.197+0000 7f2505778640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2500071190 con 0x7f250006d180 2023-11-18T19:07:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.198+0000 7f24feffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f250006d180 0x7f25001e9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50584/0 (socket says 172.21.15.45:50584) 2023-11-18T19:07:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.198+0000 7f24feffd640 1 -- 172.21.15.45:0/1806678215 learned_addr learned my addr 172.21.15.45:0/1806678215 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.198+0000 7f24fe7fc640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000a4d40 0x7f25000a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.198+0000 7ff8a89a4640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff88806ae90 0x7ff88806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.198+0000 7f24ff7fe640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25000c0f00 0x7f2500071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.199+0000 7f24feffd640 1 -- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25000c0f00 msgr2=0x7f2500071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.199+0000 7f24feffd640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25000c0f00 0x7f2500071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.199+0000 7f24feffd640 1 -- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000a4d40 msgr2=0x7f25000a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.199+0000 7f24feffd640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000a4d40 0x7f25000a6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.199+0000 7f24feffd640 1 -- 172.21.15.45:0/1806678215 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0009400 con 0x7f250006d180 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.199+0000 7f24fe7fc640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000a4d40 0x7f25000a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.200+0000 7ff8a89a4640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff88806ae90 0x7ff88806d350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff894038000 tx=0x7ff894032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.199+0000 7f24feffd640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f250006d180 0x7f25001e9260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f24f800eb40 tx=0x7f24f8007400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.205+0000 7f24e77fe640 1 -- 172.21.15.45:0/1806678215 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800c990 con 0x7f250006d180 2023-11-18T19:07:07.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.205+0000 7fa5677fe640 1 -- 172.21.15.45:0/2025849299 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa570071710 con 0x7fa5700724c0 2023-11-18T19:07:07.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.205+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2500071470 con 0x7f250006d180 2023-11-18T19:07:07.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.205+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250014d1a0 con 0x7f250006d180 2023-11-18T19:07:07.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.206+0000 7f24e77fe640 1 -- 172.21.15.45:0/1806678215 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800caf0 con 0x7f250006d180 2023-11-18T19:07:07.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.206+0000 7f24e77fe640 1 -- 172.21.15.45:0/1806678215 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800c990 con 0x7f250006d180 2023-11-18T19:07:07.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.209+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e0005250 con 0x7f250006d180 2023-11-18T19:07:07.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.211+0000 7f24e77fe640 1 -- 172.21.15.45:0/1806678215 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24f800cc80 con 0x7f250006d180 2023-11-18T19:07:07.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.213+0000 7f24e77fe640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f24ec06aea0 0x7f24ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.214+0000 7ff899ffb640 1 -- 172.21.15.45:0/1994821811 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8a00547e0 con 0x7ff8a40710d0 2023-11-18T19:07:07.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.214+0000 7f24e77fe640 1 -- 172.21.15.45:0/1806678215 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24f8089d70 con 0x7f250006d180 2023-11-18T19:07:07.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.214+0000 7f24fe7fc640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f24ec06aea0 0x7f24ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.216+0000 7f24fe7fc640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f24ec06aea0 0x7f24ec06d360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f250006cac0 tx=0x7f24f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.226+0000 7f24e77fe640 1 -- 172.21.15.45:0/1806678215 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24f808e070 con 0x7f250006d180 2023-11-18T19:07:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.233+0000 7f5b104c9640 1 Processor -- start 2023-11-18T19:07:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.237+0000 7f5b104c9640 1 -- start start 2023-11-18T19:07:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.239+0000 7f5b104c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b08151d70 0x7f5b080c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.239+0000 7f5b104c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5b080c7f20 0x7f5b080ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.239+0000 7f5b104c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080c8a10 con 0x7f5b080caa60 2023-11-18T19:07:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.239+0000 7f5b104c9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0806c8b0 con 0x7f5b08151d70 2023-11-18T19:07:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.239+0000 7f5b104c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b08154920 con 0x7f5b080c7f20 2023-11-18T19:07:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.240+0000 7f5b0ea66640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5b080caa60 0x7f5b080c6a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47006/0 (socket says 172.21.15.45:47006) 2023-11-18T19:07:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.240+0000 7f5b0ea66640 1 -- 172.21.15.45:0/28723070 learned_addr learned my addr 172.21.15.45:0/28723070 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.240+0000 7f5b0e265640 1 --2- 172.21.15.45:0/28723070 >> v2:172.21.15.45:3300/0 conn(0x7f5b08151d70 0x7f5b080c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.241+0000 7f5b0e265640 1 -- 172.21.15.45:0/28723070 >> v2:172.21.15.135:3300/0 conn(0x7f5b080c7f20 msgr2=0x7f5b080ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.241+0000 7f5b0e265640 1 --2- 172.21.15.45:0/28723070 >> v2:172.21.15.135:3300/0 conn(0x7f5b080c7f20 0x7f5b080ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.241+0000 7f5b0e265640 1 -- 172.21.15.45:0/28723070 >> v1:172.21.15.45:6789/0 conn(0x7f5b080caa60 legacy=0x7f5b080c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.241+0000 7f5b0e265640 1 -- 172.21.15.45:0/28723070 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08154c00 con 0x7f5b08151d70 2023-11-18T19:07:07.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.243+0000 7f5b0e265640 1 --2- 172.21.15.45:0/28723070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b08151d70 0x7f5b080c8430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b080c6880 tx=0x7f5afc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baea58c3f32cc1a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.244+0000 7f5b0d263640 1 -- 172.21.15.45:0/28723070 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc031870 con 0x7f5b08151d70 2023-11-18T19:07:07.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.244+0000 7f5b0d263640 1 -- 172.21.15.45:0/28723070 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0319d0 con 0x7f5b08151d70 2023-11-18T19:07:07.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.244+0000 7f5b0d263640 1 -- 172.21.15.45:0/28723070 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc031da0 con 0x7f5b08151d70 2023-11-18T19:07:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.246+0000 7f5b104c9640 1 -- 172.21.15.45:0/28723070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b08151d70 msgr2=0x7f5b080c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.246+0000 7f5b104c9640 1 --2- 172.21.15.45:0/28723070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b08151d70 0x7f5b080c8430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b080c6880 tx=0x7f5afc02b910 comp rx=0 tx=0).stop 2023-11-18T19:07:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.246+0000 7f5b104c9640 1 -- 172.21.15.45:0/28723070 shutdown_connections 2023-11-18T19:07:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.246+0000 7f5b104c9640 1 --2- 172.21.15.45:0/28723070 >> v2:172.21.15.135:3300/0 conn(0x7f5b080c7f20 0x7f5b080ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.246+0000 7f5b104c9640 1 --2- 172.21.15.45:0/28723070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b08151d70 0x7f5b080c8430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.246+0000 7f5b104c9640 1 -- 172.21.15.45:0/28723070 >> 172.21.15.45:0/28723070 conn(0x7f5b08066610 msgr2=0x7f5b08066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.248+0000 7f5b104c9640 1 -- 172.21.15.45:0/28723070 shutdown_connections 2023-11-18T19:07:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.250+0000 7f5b104c9640 1 -- 172.21.15.45:0/28723070 wait complete. 2023-11-18T19:07:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.252+0000 7f5b104c9640 1 Processor -- start 2023-11-18T19:07:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.256+0000 7f5b104c9640 1 -- start start 2023-11-18T19:07:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.257+0000 7f5b104c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b080c7f20 0x7f5b080aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.257+0000 7f5b104c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080caa60 0x7f5b080aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b104c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08151d70 0x7f5b080abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b104c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0814dae0 con 0x7f5b080caa60 2023-11-18T19:07:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b104c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080ab5f0 con 0x7f5b08151d70 2023-11-18T19:07:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b104c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080be3b0 con 0x7f5b080c7f20 2023-11-18T19:07:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b0e265640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b080c7f20 0x7f5b080aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b0e265640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b080c7f20 0x7f5b080aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:50590/0 (socket says 172.21.15.45:50590) 2023-11-18T19:07:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b0e265640 1 -- 172.21.15.45:0/1634949305 learned_addr learned my addr 172.21.15.45:0/1634949305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.258+0000 7f5b0ea66640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08151d70 0x7f5b080abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.259+0000 7f5b0da64640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080caa60 0x7f5b080aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.260+0000 7f5b0e265640 1 -- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08151d70 msgr2=0x7f5b080abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.260+0000 7f5b0e265640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08151d70 0x7f5b080abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.260+0000 7f5b0e265640 1 -- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080caa60 msgr2=0x7f5b080aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.260+0000 7f5b0e265640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080caa60 0x7f5b080aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.260+0000 7f5b0e265640 1 -- 172.21.15.45:0/1634949305 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009400 con 0x7f5b080c7f20 2023-11-18T19:07:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.265+0000 7f5b0e265640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b080c7f20 0x7f5b080aac40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5afc02bf20 tx=0x7f5afc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.265+0000 7f5afaffd640 1 -- 172.21.15.45:0/1634949305 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc03be70 con 0x7f5b080c7f20 2023-11-18T19:07:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.265+0000 7f5afaffd640 1 -- 172.21.15.45:0/1634949305 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0453f0 con 0x7f5b080c7f20 2023-11-18T19:07:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.265+0000 7f5afaffd640 1 -- 172.21.15.45:0/1634949305 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc045760 con 0x7f5b080c7f20 2023-11-18T19:07:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.265+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b080bdb10 con 0x7f5b080c7f20 2023-11-18T19:07:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.266+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b080be0d0 con 0x7f5b080c7f20 2023-11-18T19:07:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.268+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b080a9a40 con 0x7f5b080c7f20 2023-11-18T19:07:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.269+0000 7f52fd7e4640 1 Processor -- start 2023-11-18T19:07:07.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.270+0000 7f5afaffd640 1 -- 172.21.15.45:0/1634949305 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5afc0458c0 con 0x7f5b080c7f20 2023-11-18T19:07:07.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.270+0000 7f52fd7e4640 1 -- start start 2023-11-18T19:07:07.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.271+0000 7f52fd7e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80aa320 0x7f52f81510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.272+0000 7f52fd7e4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52f80c1270 0x7f52f80c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.272+0000 7f5afaffd640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5aec06ae40 0x7f5aec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.272+0000 7f5afaffd640 1 -- 172.21.15.45:0/1634949305 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5afc02d040 con 0x7f5b080c7f20 2023-11-18T19:07:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.272+0000 7f52fd7e4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f814eb70 con 0x7f52f80c50b0 2023-11-18T19:07:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.272+0000 7f52fd7e4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f8155360 con 0x7f52f80c1270 2023-11-18T19:07:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.272+0000 7f52fd7e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80aa700 con 0x7f52f80aa320 2023-11-18T19:07:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.273+0000 7f52f77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52f80c1270 0x7f52f80c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.273+0000 7f52f7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80aa320 0x7f52f81510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.273+0000 7f52fcfe3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52f80c50b0 0x7f52f8071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47008/0 (socket says 172.21.15.45:47008) 2023-11-18T19:07:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.273+0000 7f52fcfe3640 1 -- 172.21.15.45:0/2834771460 learned_addr learned my addr 172.21.15.45:0/2834771460 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.274+0000 7f52f77fe640 1 -- 172.21.15.45:0/2834771460 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80aa320 msgr2=0x7f52f81510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.274+0000 7f52f77fe640 1 --2- 172.21.15.45:0/2834771460 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80aa320 0x7f52f81510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.274+0000 7f52f77fe640 1 -- 172.21.15.45:0/2834771460 >> v1:172.21.15.45:6789/0 conn(0x7f52f80c50b0 legacy=0x7f52f8071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.274+0000 7f52f77fe640 1 -- 172.21.15.45:0/2834771460 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f8154750 con 0x7f52f80c1270 2023-11-18T19:07:07.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.274+0000 7f5b0da64640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5aec06ae40 0x7f5aec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.275+0000 7f5b0da64640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5aec06ae40 0x7f5aec06d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b080aa2e0 tx=0x7f5b04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.276+0000 7f52f77fe640 1 --2- 172.21.15.45:0/2834771460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c1270 0x7f52f80c4b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097a0 tx=0x7f52e802da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7dafe4835a99a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.276+0000 7f52f6ffd640 1 -- 172.21.15.45:0/2834771460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8031850 con 0x7f52f80c1270 2023-11-18T19:07:07.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.277+0000 7f52f6ffd640 1 -- 172.21.15.45:0/2834771460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e80319b0 con 0x7f52f80c1270 2023-11-18T19:07:07.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.277+0000 7f52fd7e4640 1 -- 172.21.15.45:0/2834771460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c1270 msgr2=0x7f52f80c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.278+0000 7f52f6ffd640 1 -- 172.21.15.45:0/2834771460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8031850 con 0x7f52f80c1270 2023-11-18T19:07:07.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.278+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/2834771460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c1270 0x7f52f80c4b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097a0 tx=0x7f52e802da30 comp rx=0 tx=0).stop 2023-11-18T19:07:07.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.278+0000 7f52fd7e4640 1 -- 172.21.15.45:0/2834771460 shutdown_connections 2023-11-18T19:07:07.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.278+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/2834771460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c1270 0x7f52f80c4b70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.278+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/2834771460 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80aa320 0x7f52f81510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.278+0000 7f52fd7e4640 1 -- 172.21.15.45:0/2834771460 >> 172.21.15.45:0/2834771460 conn(0x7f52f80a7910 msgr2=0x7f52f80a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.278+0000 7f52fd7e4640 1 -- 172.21.15.45:0/2834771460 shutdown_connections 2023-11-18T19:07:07.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.279+0000 7f52fd7e4640 1 -- 172.21.15.45:0/2834771460 wait complete. 2023-11-18T19:07:07.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.281+0000 7f52fd7e4640 1 Processor -- start 2023-11-18T19:07:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.281+0000 7f52fd7e4640 1 -- start start 2023-11-18T19:07:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.283+0000 7f52fd7e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52f80aa320 0x7f52f81eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.283+0000 7f52fd7e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80c1270 0x7f52f806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.283+0000 7f52fd7e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c50b0 0x7f52f8071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.283+0000 7f52fd7e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f81ee5f0 con 0x7f52f80c50b0 2023-11-18T19:07:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.283+0000 7f52fd7e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f806dfc0 con 0x7f52f80aa320 2023-11-18T19:07:07.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.283+0000 7f52fd7e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f806dce0 con 0x7f52f80c1270 2023-11-18T19:07:07.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.284+0000 7f52fcfe3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c50b0 0x7f52f8071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.284+0000 7f52fcfe3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c50b0 0x7f52f8071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38202/0 (socket says 172.21.15.45:38202) 2023-11-18T19:07:07.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.284+0000 7f52fcfe3640 1 -- 172.21.15.45:0/1573791733 learned_addr learned my addr 172.21.15.45:0/1573791733 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.285+0000 7f52fcfe3640 1 -- 172.21.15.45:0/1573791733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80c1270 msgr2=0x7f52f806d6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-18T19:07:07.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.285+0000 7f52fcfe3640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80c1270 0x7f52f806d6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.286+0000 7f5afaffd640 1 -- 172.21.15.45:0/1634949305 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5afc0770b0 con 0x7f5b080c7f20 2023-11-18T19:07:07.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.285+0000 7f52fcfe3640 1 -- 172.21.15.45:0/1573791733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52f80aa320 msgr2=0x7f52f81eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.285+0000 7f52fcfe3640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52f80aa320 0x7f52f81eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.285+0000 7f52fcfe3640 1 -- 172.21.15.45:0/1573791733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8009400 con 0x7f52f80c50b0 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.286+0000 7f52fcfe3640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c50b0 0x7f52f8071c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f52f000ca80 tx=0x7f52f000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.286+0000 7f52f4ff9640 1 -- 172.21.15.45:0/1573791733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f000ac30 con 0x7f52f80c50b0 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.286+0000 7f52f4ff9640 1 -- 172.21.15.45:0/1573791733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f000ad90 con 0x7f52f80c50b0 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.286+0000 7f52f4ff9640 1 -- 172.21.15.45:0/1573791733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0012600 con 0x7f52f80c50b0 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.287+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f81edfa0 con 0x7f52f80c50b0 2023-11-18T19:07:07.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.287+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f806c420 con 0x7f52f80c50b0 2023-11-18T19:07:07.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.291+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f8068410 con 0x7f52f80c50b0 2023-11-18T19:07:07.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.291+0000 7f52f4ff9640 1 -- 172.21.15.45:0/1573791733 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52f0012760 con 0x7f52f80c50b0 2023-11-18T19:07:07.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.293+0000 7f52f4ff9640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.294+0000 7f52f4ff9640 1 -- 172.21.15.45:0/1573791733 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52f0089700 con 0x7f52f80c50b0 2023-11-18T19:07:07.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.299+0000 7f52f7fff640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.301+0000 7f52f4ff9640 1 -- 172.21.15.45:0/1573791733 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52f0054580 con 0x7f52f80c50b0 2023-11-18T19:07:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.301+0000 7f52f7fff640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f52e406ae40 0x7f52e406d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52f81f2500 tx=0x7f52ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.321+0000 7f8affd16640 1 Processor -- start 2023-11-18T19:07:07.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.321+0000 7f8affd16640 1 -- start start 2023-11-18T19:07:07.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.323+0000 7f8affd16640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af80c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.323+0000 7f8affd16640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8af8155280 0x7f8af806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.323+0000 7f8affd16640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af80c49b0 con 0x7f8af80c6ee0 2023-11-18T19:07:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.323+0000 7f8affd16640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af80c4c50 con 0x7f8af8155280 2023-11-18T19:07:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.323+0000 7f8affd16640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80c4f30 con 0x7f8af8152040 2023-11-18T19:07:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.324+0000 7f8afd2b1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8af8155280 0x7f8af806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.324+0000 7f8afd2b1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8af8155280 0x7f8af806c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:43016/0 (socket says 172.21.15.45:43016) 2023-11-18T19:07:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.324+0000 7f8afd2b1640 1 -- 172.21.15.45:0/3924152156 learned_addr learned my addr 172.21.15.45:0/3924152156 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.325+0000 7f8afdab2640 1 --2- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af80c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.326+0000 7f8afd2b1640 1 -- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 msgr2=0x7f8af80c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.326+0000 7f8afd2b1640 1 --2- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af80c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.326+0000 7f8afd2b1640 1 -- 172.21.15.45:0/3924152156 >> v1:172.21.15.45:6789/0 conn(0x7f8af80c6ee0 legacy=0x7f8af8157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.327+0000 7f8afd2b1640 1 -- 172.21.15.45:0/3924152156 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af806bce0 con 0x7f8af8155280 2023-11-18T19:07:07.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.327+0000 7f8afdab2640 1 --2- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af80c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:07.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.329+0000 7f83bde1a640 1 Processor -- start 2023-11-18T19:07:07.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.329+0000 7f83bde1a640 1 -- start start 2023-11-18T19:07:07.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.329+0000 7f8afd2b1640 1 --2- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 0x7f8af806c200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8af400ffd0 tx=0x7f8af4034930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90cf67fefe2deccb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.329+0000 7f8afcab0640 1 -- 172.21.15.45:0/3924152156 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af403a890 con 0x7f8af8155280 2023-11-18T19:07:07.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.330+0000 7f8afcab0640 1 -- 172.21.15.45:0/3924152156 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af403a9f0 con 0x7f8af8155280 2023-11-18T19:07:07.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.330+0000 7f8afcab0640 1 -- 172.21.15.45:0/3924152156 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af403ad80 con 0x7f8af8155280 2023-11-18T19:07:07.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f83bde1a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83b80aab90 0x7f83b80aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f8affd16640 1 -- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 msgr2=0x7f8af806c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f8affd16640 1 --2- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 0x7f8af806c200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8af400ffd0 tx=0x7f8af4034930 comp rx=0 tx=0).stop 2023-11-18T19:07:07.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f8affd16640 1 -- 172.21.15.45:0/3924152156 shutdown_connections 2023-11-18T19:07:07.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f8affd16640 1 --2- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 0x7f8af806c200 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f8affd16640 1 --2- 172.21.15.45:0/3924152156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af80c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.332+0000 7f8affd16640 1 -- 172.21.15.45:0/3924152156 >> 172.21.15.45:0/3924152156 conn(0x7f8af80c9f90 msgr2=0x7f8af80ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f83bde1a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80c59b0 con 0x7f83b80c5e40 2023-11-18T19:07:07.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f83bde1a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80c5190 con 0x7f83b806f400 2023-11-18T19:07:07.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.331+0000 7f83bde1a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80c21e0 con 0x7f83b80aab90 2023-11-18T19:07:07.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.332+0000 7f8affd16640 1 -- 172.21.15.45:0/3924152156 shutdown_connections 2023-11-18T19:07:07.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.332+0000 7f8affd16640 1 -- 172.21.15.45:0/3924152156 wait complete. 2023-11-18T19:07:07.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.332+0000 7f83bce18640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f83b806f400 0x7f83b80c14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:37362/0 (socket says 172.21.15.45:37362) 2023-11-18T19:07:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.332+0000 7f83bce18640 1 -- 172.21.15.45:0/1301272573 learned_addr learned my addr 172.21.15.45:0/1301272573 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.332+0000 7f83b77fe640 1 -- 172.21.15.45:0/1301272573 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296430260 0 0) 0x7f83b80c5190 con 0x7f83b806f400 2023-11-18T19:07:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.333+0000 7f83b77fe640 1 -- 172.21.15.45:0/1301272573 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a4005730 con 0x7f83b806f400 2023-11-18T19:07:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.333+0000 7f83bd619640 1 --2- 172.21.15.45:0/1301272573 >> v2:172.21.15.45:3300/0 conn(0x7f83b80aab90 0x7f83b80aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.333+0000 7f83bd619640 1 -- 172.21.15.45:0/1301272573 >> v1:172.21.15.135:6789/0 conn(0x7f83b806f400 legacy=0x7f83b80c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.333+0000 7f83bd619640 1 -- 172.21.15.45:0/1301272573 >> v1:172.21.15.45:6789/0 conn(0x7f83b80c5e40 legacy=0x7f83b80c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.335+0000 7f8affd16640 1 Processor -- start 2023-11-18T19:07:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.335+0000 7f83b77fe640 1 -- 172.21.15.45:0/1301272573 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673900778 0 0) 0x7f83b80c59b0 con 0x7f83b80c5e40 2023-11-18T19:07:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.335+0000 7f83bd619640 1 -- 172.21.15.45:0/1301272573 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b814ed00 con 0x7f83b80aab90 2023-11-18T19:07:07.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.336+0000 7f8affd16640 1 -- start start 2023-11-18T19:07:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.337+0000 7f8affd16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af80c6ee0 0x7f8af80abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.337+0000 7f8affd16640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.337+0000 7f8affd16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 0x7f8af8148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.337+0000 7f8affd16640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af81469e0 con 0x7f8af80c6ee0 2023-11-18T19:07:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.337+0000 7f8affd16640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8142840 con 0x7f8af8155280 2023-11-18T19:07:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.337+0000 7f8affd16640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80ac370 con 0x7f8af8152040 2023-11-18T19:07:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.338+0000 7f8afdab2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af80c6ee0 0x7f8af80abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.338+0000 7f8afdab2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af80c6ee0 0x7f8af80abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38222/0 (socket says 172.21.15.45:38222) 2023-11-18T19:07:07.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.338+0000 7f8afdab2640 1 -- 172.21.15.45:0/1905842428 learned_addr learned my addr 172.21.15.45:0/1905842428 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.337+0000 7f83bd619640 1 --2- 172.21.15.45:0/1301272573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80aab90 0x7f83b80aafc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83b000ddf0 tx=0x7f83b00342b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17491704a1e84e56 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.339+0000 7f83b77fe640 1 -- 172.21.15.45:0/1301272573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b003c640 con 0x7f83b80aab90 2023-11-18T19:07:07.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.339+0000 7f8afdab2640 1 -- 172.21.15.45:0/1905842428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 msgr2=0x7f8af8142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.339+0000 7f8afdab2640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.339+0000 7f8afdab2640 1 -- 172.21.15.45:0/1905842428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 msgr2=0x7f8af8148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.339+0000 7f8afdab2640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 0x7f8af8148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.339+0000 7f8afdab2640 1 -- 172.21.15.45:0/1905842428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af0009a70 con 0x7f8af80c6ee0 2023-11-18T19:07:07.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.340+0000 7f83b77fe640 1 -- 172.21.15.45:0/1301272573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b003c7a0 con 0x7f83b80aab90 2023-11-18T19:07:07.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.340+0000 7f83b77fe640 1 -- 172.21.15.45:0/1301272573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b003cb30 con 0x7f83b80aab90 2023-11-18T19:07:07.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.340+0000 7f8afdab2640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af80c6ee0 0x7f8af80abbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8af000efc0 tx=0x7f8af000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.341+0000 7f8aee7fc640 1 -- 172.21.15.45:0/1905842428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0014480 con 0x7f8af80c6ee0 2023-11-18T19:07:07.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.341+0000 7f8aee7fc640 1 -- 172.21.15.45:0/1905842428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af000f040 con 0x7f8af80c6ee0 2023-11-18T19:07:07.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.341+0000 7f8aee7fc640 1 -- 172.21.15.45:0/1905842428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0014800 con 0x7f8af80c6ee0 2023-11-18T19:07:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.341+0000 7f83bde1a640 1 -- 172.21.15.45:0/1301272573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80aab90 msgr2=0x7f83b80aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.341+0000 7f83bde1a640 1 --2- 172.21.15.45:0/1301272573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80aab90 0x7f83b80aafc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83b000ddf0 tx=0x7f83b00342b0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.341+0000 7f83bde1a640 1 -- 172.21.15.45:0/1301272573 shutdown_connections 2023-11-18T19:07:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.341+0000 7f83bde1a640 1 --2- 172.21.15.45:0/1301272573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80aab90 0x7f83b80aafc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.342+0000 7f83bde1a640 1 -- 172.21.15.45:0/1301272573 >> 172.21.15.45:0/1301272573 conn(0x7f83b80a8880 msgr2=0x7f83b80a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.342+0000 7f83bde1a640 1 -- 172.21.15.45:0/1301272573 shutdown_connections 2023-11-18T19:07:07.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.342+0000 7f83bde1a640 1 -- 172.21.15.45:0/1301272573 wait complete. 2023-11-18T19:07:07.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.343+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af400fd00 con 0x7f8af80c6ee0 2023-11-18T19:07:07.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.344+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af81ea0c0 con 0x7f8af80c6ee0 2023-11-18T19:07:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.345+0000 7f83bde1a640 1 Processor -- start 2023-11-18T19:07:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.345+0000 7f83bde1a640 1 -- start start 2023-11-18T19:07:07.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.347+0000 7f83bde1a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b806f400 0x7f83b81e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.348+0000 7f83bde1a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80aab90 0x7f83b81530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.348+0000 7f83bde1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80c5e40 0x7f83b814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.348+0000 7f83bde1a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81e6ae0 con 0x7f83b80c5e40 2023-11-18T19:07:07.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.348+0000 7f83bde1a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8154fd0 con 0x7f83b80aab90 2023-11-18T19:07:07.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.348+0000 7f83bde1a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81552b0 con 0x7f83b806f400 2023-11-18T19:07:07.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.349+0000 7f83bd619640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80c5e40 0x7f83b814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.349+0000 7f83bd619640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80c5e40 0x7f83b814a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38234/0 (socket says 172.21.15.45:38234) 2023-11-18T19:07:07.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.349+0000 7f83bd619640 1 -- 172.21.15.45:0/3164459646 learned_addr learned my addr 172.21.15.45:0/3164459646 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:07.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.349+0000 7f83bce18640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b806f400 0x7f83b81e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.349+0000 7f8aee7fc640 1 -- 172.21.15.45:0/1905842428 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8af0014960 con 0x7f8af80c6ee0 2023-11-18T19:07:07.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.349+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af80747c0 con 0x7f8af80c6ee0 2023-11-18T19:07:07.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.350+0000 7f83b7fff640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80aab90 0x7f83b81530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.350+0000 7f83bce18640 1 -- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80aab90 msgr2=0x7f83b81530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.350+0000 7f83bce18640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80aab90 0x7f83b81530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.350+0000 7f83bce18640 1 -- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80c5e40 msgr2=0x7f83b814a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.350+0000 7f83bce18640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80c5e40 0x7f83b814a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.350+0000 7f83bce18640 1 -- 172.21.15.45:0/3164459646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b000da70 con 0x7f83b806f400 2023-11-18T19:07:07.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.351+0000 7f83bce18640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b806f400 0x7f83b81e65a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c3c0 tx=0x7f83a0001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.351+0000 7f83b57fa640 1 -- 172.21.15.45:0/3164459646 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0005ce0 con 0x7f83b806f400 2023-11-18T19:07:07.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.352+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8155590 con 0x7f83b806f400 2023-11-18T19:07:07.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.352+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b81501a0 con 0x7f83b806f400 2023-11-18T19:07:07.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.352+0000 7f83b57fa640 1 -- 172.21.15.45:0/3164459646 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0005e40 con 0x7f83b806f400 2023-11-18T19:07:07.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.352+0000 7f83b57fa640 1 -- 172.21.15.45:0/3164459646 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0005ce0 con 0x7f83b806f400 2023-11-18T19:07:07.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.354+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c005250 con 0x7f83b806f400 2023-11-18T19:07:07.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.356+0000 7f8aee7fc640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8adc06ae90 0x7f8adc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.357+0000 7f83b57fa640 1 -- 172.21.15.45:0/3164459646 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f83a0007070 con 0x7f83b806f400 2023-11-18T19:07:07.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.357+0000 7f8aee7fc640 1 -- 172.21.15.45:0/1905842428 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8af008a860 con 0x7f8af80c6ee0 2023-11-18T19:07:07.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.358+0000 7f83b57fa640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f839806aea0 0x7f839806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:07.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.359+0000 7f8afd2b1640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8adc06ae90 0x7f8adc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.359+0000 7f83b57fa640 1 -- 172.21.15.45:0/3164459646 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83a0088ab0 con 0x7f83b806f400 2023-11-18T19:07:07.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.360+0000 7f83b7fff640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f839806aea0 0x7f839806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:07.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.361+0000 7f83b7fff640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f839806aea0 0x7f839806d360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83b80ac620 tx=0x7f83a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.362+0000 7f8afd2b1640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8adc06ae90 0x7f8adc06d350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8af403f000 tx=0x7f8af4039000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:07.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.363+0000 7f8aee7fc640 1 -- 172.21.15.45:0/1905842428 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8af0055690 con 0x7f8af80c6ee0 2023-11-18T19:07:07.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.371+0000 7f83b57fa640 1 -- 172.21.15.45:0/3164459646 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83a00537f0 con 0x7f83b806f400 2023-11-18T19:07:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.618+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99f00057d0 con 0x7f9a10151d70 2023-11-18T19:07:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.619+0000 7f9a0cff9640 1 -- 172.21.15.45:0/2152289338 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a00015090 con 0x7f9a10151d70 2023-11-18T19:07:07.621 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.620+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa570071710 con 0x7fa5700724c0 2023-11-18T19:07:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.621+0000 7fa5677fe640 1 -- 172.21.15.45:0/2025849299 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa570071710 con 0x7fa5700724c0 2023-11-18T19:07:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.623+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f99fc06ae40 msgr2=0x7f99fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.623+0000 7f9a16789640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f99fc06ae40 0x7f99fc06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a0802bf20 tx=0x7f9a08030000 comp rx=0 tx=0).stop 2023-11-18T19:07:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 msgr2=0x7f9a101eca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a101eca80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000b410 tx=0x7f9a0000b8d0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 shutdown_connections 2023-11-18T19:07:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a10151d70 0x7f9a101eca80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f99fc06ae40 0x7f99fc06d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a100c7f20 0x7f9a101ec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 --2- 172.21.15.45:0/2152289338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a100c6a30 0x7f9a101538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.624+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 >> 172.21.15.45:0/2152289338 conn(0x7f9a10066610 msgr2=0x7f9a1014e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.627 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:07.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.625+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 shutdown_connections 2023-11-18T19:07:07.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.625+0000 7f9a16789640 1 -- 172.21.15.45:0/2152289338 wait complete. 2023-11-18T19:07:07.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.625+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55006af10 msgr2=0x7fa55006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.625+0000 7fa57538a640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55006af10 0x7fa55006d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5700c5640 tx=0x7fa560009830 comp rx=0 tx=0).stop 2023-11-18T19:07:07.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.625+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700724c0 msgr2=0x7fa5700c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.625+0000 7fa57538a640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700724c0 0x7fa5700c4940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa56800e870 tx=0x7fa56800ed30 comp rx=0 tx=0).stop 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.626+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 shutdown_connections 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.626+0000 7fa57538a640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5701565d0 0x7fa570071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.626+0000 7fa57538a640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5700c1590 0x7fa5700719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.626+0000 7fa57538a640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55006af10 0x7fa55006d3d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.626+0000 7fa57538a640 1 --2- 172.21.15.45:0/2025849299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700724c0 0x7fa5700c4940 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.626+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 >> 172.21.15.45:0/2025849299 conn(0x7fa5700a7980 msgr2=0x7fa570157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.627+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 shutdown_connections 2023-11-18T19:07:07.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.627+0000 7fa57538a640 1 -- 172.21.15.45:0/2025849299 wait complete. 2023-11-18T19:07:07.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.628+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff8a40683a0 con 0x7ff8a40710d0 2023-11-18T19:07:07.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.629+0000 7ff899ffb640 1 -- 172.21.15.45:0/1994821811 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8a00547e0 con 0x7ff8a40710d0 2023-11-18T19:07:07.631 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-11-18T19:07:07.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.633+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff88806ae90 msgr2=0x7ff88806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.633+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff88806ae90 0x7ff88806d350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff894038000 tx=0x7ff894032000 comp rx=0 tx=0).stop 2023-11-18T19:07:07.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.633+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a40710d0 msgr2=0x7ff8a41e64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.633+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a40710d0 0x7ff8a41e64d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000e870 tx=0x7ff8a000ed30 comp rx=0 tx=0).stop 2023-11-18T19:07:07.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.634+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 shutdown_connections 2023-11-18T19:07:07.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.634+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff88806ae90 0x7ff88806d350 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.634+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8a4153b10 0x7ff8a4150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.634+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a40a83c0 0x7ff8a4147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.634+0000 7ff8aa1a7640 1 --2- 172.21.15.45:0/1994821811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a40710d0 0x7ff8a41e64d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.634+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 >> 172.21.15.45:0/1994821811 conn(0x7ff8a40a78a0 msgr2=0x7ff8a406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.634+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 shutdown_connections 2023-11-18T19:07:07.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.635+0000 7ff8aa1a7640 1 -- 172.21.15.45:0/1994821811 wait complete. 2023-11-18T19:07:07.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2023-11-18T19:07:07.661 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2023-11-18T19:07:07.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.661+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f24e0005500 con 0x7f250006d180 2023-11-18T19:07:07.663 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-11-18T19:07:07.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.662+0000 7f24e77fe640 1 -- 172.21.15.45:0/1806678215 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24f8054b20 con 0x7f250006d180 2023-11-18T19:07:07.664 INFO:teuthology.orchestra.run.smithi045.stdout:64424509450 2023-11-18T19:07:07.664 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.664+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f24ec06aea0 msgr2=0x7f24ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.664+0000 7f2505778640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f24ec06aea0 0x7f24ec06d360 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f250006cac0 tx=0x7f24f4009040 comp rx=0 tx=0).stop 2023-11-18T19:07:07.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.664+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f250006d180 msgr2=0x7f25001e9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.664+0000 7f2505778640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f250006d180 0x7f25001e9260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f24f800eb40 tx=0x7f24f8007400 comp rx=0 tx=0).stop 2023-11-18T19:07:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 shutdown_connections 2023-11-18T19:07:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25000c0f00 0x7f2500071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25000a4d40 0x7f25000a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f24ec06aea0 0x7f24ec06d360 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 --2- 172.21.15.45:0/1806678215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f250006d180 0x7f25001e9260 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 >> 172.21.15.45:0/1806678215 conn(0x7f25000a7980 msgr2=0x7f25001481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 shutdown_connections 2023-11-18T19:07:07.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.665+0000 7f2505778640 1 -- 172.21.15.45:0/1806678215 wait complete. 2023-11-18T19:07:07.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2023-11-18T19:07:07.684 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.688+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52f81ee730 con 0x7f52f80c50b0 2023-11-18T19:07:07.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.688+0000 7f52f4ff9640 1 -- 172.21.15.45:0/1573791733 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52f0057ba0 con 0x7f52f80c50b0 2023-11-18T19:07:07.689 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:07.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f52e406ae40 msgr2=0x7f52e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f52e406ae40 0x7f52e406d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52f81f2500 tx=0x7f52ec008040 comp rx=0 tx=0).stop 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c50b0 msgr2=0x7f52f8071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c50b0 0x7f52f8071c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f52f000ca80 tx=0x7f52f000cf40 comp rx=0 tx=0).stop 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 shutdown_connections 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52f80c50b0 0x7f52f8071c60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52f80c1270 0x7f52f806d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 --2- 172.21.15.45:0/1573791733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52f80aa320 0x7f52f81eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 >> 172.21.15.45:0/1573791733 conn(0x7f52f80a7910 msgr2=0x7f52f80a6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 shutdown_connections 2023-11-18T19:07:07.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.690+0000 7f52fd7e4640 1 -- 172.21.15.45:0/1573791733 wait complete. 2023-11-18T19:07:07.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.712+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5b080747c0 con 0x7f5b080c7f20 2023-11-18T19:07:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.713+0000 7f5afaffd640 1 -- 172.21.15.45:0/1634949305 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5afc07a6d0 con 0x7f5b080c7f20 2023-11-18T19:07:07.714 INFO:teuthology.orchestra.run.smithi045.stdout:64424509448 2023-11-18T19:07:07.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2023-11-18T19:07:07.717 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.716+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5aec06ae40 msgr2=0x7f5aec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.716+0000 7f5b104c9640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5aec06ae40 0x7f5aec06d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b080aa2e0 tx=0x7f5b04008040 comp rx=0 tx=0).stop 2023-11-18T19:07:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.716+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b080c7f20 msgr2=0x7f5b080aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.716+0000 7f5b104c9640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b080c7f20 0x7f5b080aac40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5afc02bf20 tx=0x7f5afc0046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 shutdown_connections 2023-11-18T19:07:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08151d70 0x7f5b080abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080caa60 0x7f5b080aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5aec06ae40 0x7f5aec06d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 --2- 172.21.15.45:0/1634949305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b080c7f20 0x7f5b080aac40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 >> 172.21.15.45:0/1634949305 conn(0x7f5b08066610 msgr2=0x7f5b0814f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 shutdown_connections 2023-11-18T19:07:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.717+0000 7f5b104c9640 1 -- 172.21.15.45:0/1634949305 wait complete. 2023-11-18T19:07:07.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.738+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f839c005500 con 0x7f83b806f400 2023-11-18T19:07:07.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.739+0000 7f83b57fa640 1 -- 172.21.15.45:0/3164459646 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83a0017070 con 0x7f83b806f400 2023-11-18T19:07:07.740 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f839806aea0 msgr2=0x7f839806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f839806aea0 0x7f839806d360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83b80ac620 tx=0x7f83a8009040 comp rx=0 tx=0).stop 2023-11-18T19:07:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b806f400 msgr2=0x7f83b81e65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b806f400 0x7f83b81e65a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c3c0 tx=0x7f83a0001e70 comp rx=0 tx=0).stop 2023-11-18T19:07:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 shutdown_connections 2023-11-18T19:07:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83b80c5e40 0x7f83b814a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b80aab90 0x7f83b81530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f839806aea0 0x7f839806d360 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 --2- 172.21.15.45:0/3164459646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83b806f400 0x7f83b81e65a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 >> 172.21.15.45:0/3164459646 conn(0x7f83b80a8880 msgr2=0x7f83b80734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2023-11-18T19:07:07.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 shutdown_connections 2023-11-18T19:07:07.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.741+0000 7f83bde1a640 1 -- 172.21.15.45:0/3164459646 wait complete. 2023-11-18T19:07:07.745 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.747+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8af80c7420 con 0x7f8af80c6ee0 2023-11-18T19:07:07.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.747+0000 7f8aee7fc640 1 -- 172.21.15.45:0/1905842428 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8af0058cb0 con 0x7f8af80c6ee0 2023-11-18T19:07:07.749 INFO:teuthology.orchestra.run.smithi045.stdout:64424509449 2023-11-18T19:07:07.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8adc06ae90 msgr2=0x7f8adc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8adc06ae90 0x7f8adc06d350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8af403f000 tx=0x7f8af4039000 comp rx=0 tx=0).stop 2023-11-18T19:07:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af80c6ee0 msgr2=0x7f8af80abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af80c6ee0 0x7f8af80abbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8af000efc0 tx=0x7f8af000c490 comp rx=0 tx=0).stop 2023-11-18T19:07:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 shutdown_connections 2023-11-18T19:07:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af8155280 0x7f8af8148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8adc06ae90 0x7f8adc06d350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af8152040 0x7f8af8142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 --2- 172.21.15.45:0/1905842428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af80c6ee0 0x7f8af80abbf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:07.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 >> 172.21.15.45:0/1905842428 conn(0x7f8af80c9f90 msgr2=0x7f8af8154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:07.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 shutdown_connections 2023-11-18T19:07:07.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:07.750+0000 7f8affd16640 1 -- 172.21.15.45:0/1905842428 wait complete. 2023-11-18T19:07:07.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2023-11-18T19:07:07.759 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2023-11-18T19:07:07.768 DEBUG:teuthology.parallel:result is None 2023-11-18T19:07:07.768 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-18T19:07:07.768 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:07:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.033+0000 7fce0b59e640 1 Processor -- start 2023-11-18T19:07:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.033+0000 7fce0b59e640 1 -- start start 2023-11-18T19:07:08.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce0b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce0c066610 0x7fce0c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce0b59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 0x7fce0c0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce0b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c072420 con 0x7fce0c14fb90 2023-11-18T19:07:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce0b59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c14ff70 con 0x7fce0c066610 2023-11-18T19:07:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce0b59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c06e2f0 con 0x7fce0c06b9e0 2023-11-18T19:07:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce09d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce0c066610 0x7fce0c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce0a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fce0c14fb90 0x7fce0c06d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47028/0 (socket says 172.21.15.45:47028) 2023-11-18T19:07:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce09d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce0c066610 0x7fce0c0712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38236/0 (socket says 172.21.15.45:38236) 2023-11-18T19:07:08.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce09d9b640 1 -- 172.21.15.45:0/1639653446 learned_addr learned my addr 172.21.15.45:0/1639653446 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.035+0000 7fce0ad9d640 1 --2- 172.21.15.45:0/1639653446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 0x7fce0c0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.036+0000 7fce09d9b640 1 -- 172.21.15.45:0/1639653446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 msgr2=0x7fce0c0c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.036+0000 7fce09d9b640 1 --2- 172.21.15.45:0/1639653446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 0x7fce0c0c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.036+0000 7fce09d9b640 1 -- 172.21.15.45:0/1639653446 >> v1:172.21.15.45:6789/0 conn(0x7fce0c14fb90 legacy=0x7fce0c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.036+0000 7fce09d9b640 1 -- 172.21.15.45:0/1639653446 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c072670 con 0x7fce0c066610 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.036+0000 7fce0959a640 1 -- 172.21.15.45:0/1639653446 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380346694 0 0) 0x7fce0c072420 con 0x7fce0c14fb90 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.037+0000 7fce09d9b640 1 --2- 172.21.15.45:0/1639653446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c0712d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce00009870 tx=0x7fce0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937a6083c0c5d4fa server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.037+0000 7fce0959a640 1 -- 172.21.15.45:0/1639653446 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00031640 con 0x7fce0c066610 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.037+0000 7fce0959a640 1 -- 172.21.15.45:0/1639653446 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce000317a0 con 0x7fce0c066610 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.037+0000 7fce0959a640 1 -- 172.21.15.45:0/1639653446 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00031b30 con 0x7fce0c066610 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 -- 172.21.15.45:0/1639653446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 msgr2=0x7fce0c0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 --2- 172.21.15.45:0/1639653446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c0712d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce00009870 tx=0x7fce0002b8f0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 -- 172.21.15.45:0/1639653446 shutdown_connections 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 --2- 172.21.15.45:0/1639653446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 0x7fce0c0c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 --2- 172.21.15.45:0/1639653446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c0712d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 -- 172.21.15.45:0/1639653446 >> 172.21.15.45:0/1639653446 conn(0x7fce0c0c6420 msgr2=0x7fce0c0c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 -- 172.21.15.45:0/1639653446 shutdown_connections 2023-11-18T19:07:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.038+0000 7fce0b59e640 1 -- 172.21.15.45:0/1639653446 wait complete. 2023-11-18T19:07:08.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.039+0000 7fce0b59e640 1 Processor -- start 2023-11-18T19:07:08.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.040+0000 7fce0b59e640 1 -- start start 2023-11-18T19:07:08.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.040+0000 7fce0b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c1edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.040+0000 7fce0b59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 0x7fce0c1442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c14fb90 0x7fce0c1e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1ee450 con 0x7fce0c066610 2023-11-18T19:07:08.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0b59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c5720 con 0x7fce0c14fb90 2023-11-18T19:07:08.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0b59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0c5a00 con 0x7fce0c06b9e0 2023-11-18T19:07:08.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c1edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c1edf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38244/0 (socket says 172.21.15.45:38244) 2023-11-18T19:07:08.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 -- 172.21.15.45:0/3858970772 learned_addr learned my addr 172.21.15.45:0/3858970772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:08.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 -- 172.21.15.45:0/3858970772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 msgr2=0x7fce0c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 0x7fce0c1442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0ad9d640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c14fb90 0x7fce0c1e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 -- 172.21.15.45:0/3858970772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c14fb90 msgr2=0x7fce0c1e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c14fb90 0x7fce0c1e6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.041+0000 7fce0a59c640 1 -- 172.21.15.45:0/3858970772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce000094d0 con 0x7fce0c066610 2023-11-18T19:07:08.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.042+0000 7fce0a59c640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c1edf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00c4d0 tx=0x7fcdfc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.042+0000 7fcdfaffd640 1 -- 172.21.15.45:0/3858970772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0074e0 con 0x7fce0c066610 2023-11-18T19:07:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.042+0000 7fcdfaffd640 1 -- 172.21.15.45:0/3858970772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc007660 con 0x7fce0c066610 2023-11-18T19:07:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.042+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c0c5ce0 con 0x7fce0c066610 2023-11-18T19:07:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.042+0000 7fcdfaffd640 1 -- 172.21.15.45:0/3858970772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc004a20 con 0x7fce0c066610 2023-11-18T19:07:08.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.042+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c144810 con 0x7fce0c066610 2023-11-18T19:07:08.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.043+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c068410 con 0x7fce0c066610 2023-11-18T19:07:08.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.044+0000 7fcdfaffd640 1 -- 172.21.15.45:0/3858970772 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdfc004b80 con 0x7fce0c066610 2023-11-18T19:07:08.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.045+0000 7fcdfaffd640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcdec06ae70 0x7fcdec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.045+0000 7fcdfaffd640 1 -- 172.21.15.45:0/3858970772 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcdfc088f40 con 0x7fce0c066610 2023-11-18T19:07:08.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.046+0000 7fce09d9b640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcdec06ae70 0x7fcdec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.046+0000 7fce09d9b640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcdec06ae70 0x7fcdec06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce00036000 tx=0x7fce00030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:08.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.050+0000 7fcdfaffd640 1 -- 172.21.15.45:0/3858970772 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcdfc053bd0 con 0x7fce0c066610 2023-11-18T19:07:08.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.236+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce0c0c09e0 con 0x7fcdec06ae70 2023-11-18T19:07:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.259+0000 7fcdfaffd640 1 -- 172.21.15.45:0/3858970772 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345181 (secure 0 0 0) 0x7fce0003a420 con 0x7fcdec06ae70 2023-11-18T19:07:08.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:08.267 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:07:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcdec06ae70 msgr2=0x7fcdec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcdec06ae70 0x7fcdec06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce00036000 tx=0x7fce00030000 comp rx=0 tx=0).stop 2023-11-18T19:07:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 msgr2=0x7fce0c1edf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c1edf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00c4d0 tx=0x7fcdfc00c990 comp rx=0 tx=0).stop 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 shutdown_connections 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c14fb90 0x7fce0c1e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcdec06ae70 0x7fcdec06d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce0c06b9e0 0x7fce0c1442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 --2- 172.21.15.45:0/3858970772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce0c066610 0x7fce0c1edf10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 >> 172.21.15.45:0/3858970772 conn(0x7fce0c0c6420 msgr2=0x7fce0c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 shutdown_connections 2023-11-18T19:07:08.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.265+0000 7fce0b59e640 1 -- 172.21.15.45:0/3858970772 wait complete. 2023-11-18T19:07:08.286 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-11-18T19:07:07.177888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222736,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751984,"statfs":{"total":773094113280,"available":772866031616,"internally_reserved":0,"allocated":2457600,"data_stored":2070758,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005692"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595259+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:06:41.595259+0000","last_peered":"2023-11-18T19:06:41.595259+0000","last_clean":"2023-11-18T19:06:41.595259+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:06:41.595259+0000","last_undegraded":"2023-11-18T19:06:41.595259+0000","last_fullsized":"2023-11-18T19:06:41.595259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594762+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:06:41.594762+0000","last_peered":"2023-11-18T19:06:41.594762+0000","last_clean":"2023-11-18T19:06:41.594762+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:06:41.594762+0000","last_undegraded":"2023-11-18T19:06:41.594762+0000","last_fullsized":"2023-11-18T19:06:41.594762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559367+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:06:43.559367+0000","last_peered":"2023-11-18T19:06:43.559367+0000","last_clean":"2023-11-18T19:06:43.559367+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:06:43.559367+0000","last_undegraded":"2023-11-18T19:06:43.559367+0000","last_fullsized":"2023-11-18T19:06:43.559367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595732+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:06:41.595732+0000","last_peered":"2023-11-18T19:06:41.595732+0000","last_clean":"2023-11-18T19:06:41.595732+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:06:41.595732+0000","last_undegraded":"2023-11-18T19:06:41.595732+0000","last_fullsized":"2023-11-18T19:06:41.595732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595986+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:06:41.595986+0000","last_peered":"2023-11-18T19:06:41.595986+0000","last_clean":"2023-11-18T19:06:41.595986+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:06:41.595986+0000","last_undegraded":"2023-11-18T19:06:41.595986+0000","last_fullsized":"2023-11-18T19:06:41.595986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606153+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:06:42.606153+0000","last_peered":"2023-11-18T19:06:42.606153+0000","last_clean":"2023-11-18T19:06:42.606153+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:06:42.606153+0000","last_undegraded":"2023-11-18T19:06:42.606153+0000","last_fullsized":"2023-11-18T19:06:42.606153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587914+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:06:41.587914+0000","last_peered":"2023-11-18T19:06:41.587914+0000","last_clean":"2023-11-18T19:06:41.587914+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:06:41.587914+0000","last_undegraded":"2023-11-18T19:06:41.587914+0000","last_fullsized":"2023-11-18T19:06:41.587914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591833+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:06:41.591833+0000","last_peered":"2023-11-18T19:06:41.591833+0000","last_clean":"2023-11-18T19:06:41.591833+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:06:41.591833+0000","last_undegraded":"2023-11-18T19:06:41.591833+0000","last_fullsized":"2023-11-18T19:06:41.591833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606957+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:06:42.606957+0000","last_peered":"2023-11-18T19:06:42.606957+0000","last_clean":"2023-11-18T19:06:42.606957+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:06:42.606957+0000","last_undegraded":"2023-11-18T19:06:42.606957+0000","last_fullsized":"2023-11-18T19:06:42.606957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588640+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:06:41.588640+0000","last_peered":"2023-11-18T19:06:41.588640+0000","last_clean":"2023-11-18T19:06:41.588640+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:06:41.588640+0000","last_undegraded":"2023-11-18T19:06:41.588640+0000","last_fullsized":"2023-11-18T19:06:41.588640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574155+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:06:41.574155+0000","last_peered":"2023-11-18T19:06:41.574155+0000","last_clean":"2023-11-18T19:06:41.574155+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:06:41.574155+0000","last_undegraded":"2023-11-18T19:06:41.574155+0000","last_fullsized":"2023-11-18T19:06:41.574155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606417+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:06:42.606417+0000","last_peered":"2023-11-18T19:06:42.606417+0000","last_clean":"2023-11-18T19:06:42.606417+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:06:42.606417+0000","last_undegraded":"2023-11-18T19:06:42.606417+0000","last_fullsized":"2023-11-18T19:06:42.606417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572339+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:06:41.572339+0000","last_peered":"2023-11-18T19:06:41.572339+0000","last_clean":"2023-11-18T19:06:41.572339+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:06:41.572339+0000","last_undegraded":"2023-11-18T19:06:41.572339+0000","last_fullsized":"2023-11-18T19:06:41.572339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574750+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:06:41.574750+0000","last_peered":"2023-11-18T19:06:41.574750+0000","last_clean":"2023-11-18T19:06:41.574750+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:06:41.574750+0000","last_undegraded":"2023-11-18T19:06:41.574750+0000","last_fullsized":"2023-11-18T19:06:41.574750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718092+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:06:42.718092+0000","last_peered":"2023-11-18T19:06:42.718092+0000","last_clean":"2023-11-18T19:06:42.718092+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:06:42.718092+0000","last_undegraded":"2023-11-18T19:06:42.718092+0000","last_fullsized":"2023-11-18T19:06:42.718092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606456+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:06:41.606456+0000","last_peered":"2023-11-18T19:06:41.606456+0000","last_clean":"2023-11-18T19:06:41.606456+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:06:41.606456+0000","last_undegraded":"2023-11-18T19:06:41.606456+0000","last_fullsized":"2023-11-18T19:06:41.606456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579797+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:06:41.579797+0000","last_peered":"2023-11-18T19:06:41.579797+0000","last_clean":"2023-11-18T19:06:41.579797+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:06:41.579797+0000","last_undegraded":"2023-11-18T19:06:41.579797+0000","last_fullsized":"2023-11-18T19:06:41.579797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558472+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:06:43.558472+0000","last_peered":"2023-11-18T19:06:43.558472+0000","last_clean":"2023-11-18T19:06:43.558472+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:06:43.558472+0000","last_undegraded":"2023-11-18T19:06:43.558472+0000","last_fullsized":"2023-11-18T19:06:43.558472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592221+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:06:41.592221+0000","last_peered":"2023-11-18T19:06:41.592221+0000","last_clean":"2023-11-18T19:06:41.592221+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:06:41.592221+0000","last_undegraded":"2023-11-18T19:06:41.592221+0000","last_fullsized":"2023-11-18T19:06:41.592221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594052+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:06:41.594052+0000","last_peered":"2023-11-18T19:06:41.594052+0000","last_clean":"2023-11-18T19:06:41.594052+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:06:41.594052+0000","last_undegraded":"2023-11-18T19:06:41.594052+0000","last_fullsized":"2023-11-18T19:06:41.594052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562033+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:06:43.562033+0000","last_peered":"2023-11-18T19:06:43.562033+0000","last_clean":"2023-11-18T19:06:43.562033+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:06:43.562033+0000","last_undegraded":"2023-11-18T19:06:43.562033+0000","last_fullsized":"2023-11-18T19:06:43.562033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571771+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:06:41.571771+0000","last_peered":"2023-11-18T19:06:41.571771+0000","last_clean":"2023-11-18T19:06:41.571771+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:06:41.571771+0000","last_undegraded":"2023-11-18T19:06:41.571771+0000","last_fullsized":"2023-11-18T19:06:41.571771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580390+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:06:41.580390+0000","last_peered":"2023-11-18T19:06:41.580390+0000","last_clean":"2023-11-18T19:06:41.580390+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:06:41.580390+0000","last_undegraded":"2023-11-18T19:06:41.580390+0000","last_fullsized":"2023-11-18T19:06:41.580390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608335+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:06:42.608335+0000","last_peered":"2023-11-18T19:06:42.608335+0000","last_clean":"2023-11-18T19:06:42.608335+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:06:42.608335+0000","last_undegraded":"2023-11-18T19:06:42.608335+0000","last_fullsized":"2023-11-18T19:06:42.608335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594176+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:06:41.594176+0000","last_peered":"2023-11-18T19:06:41.594176+0000","last_clean":"2023-11-18T19:06:41.594176+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:06:41.594176+0000","last_undegraded":"2023-11-18T19:06:41.594176+0000","last_fullsized":"2023-11-18T19:06:41.594176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575911+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:06:41.575911+0000","last_peered":"2023-11-18T19:06:41.575911+0000","last_clean":"2023-11-18T19:06:41.575911+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:06:41.575911+0000","last_undegraded":"2023-11-18T19:06:41.575911+0000","last_fullsized":"2023-11-18T19:06:41.575911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606274+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:06:42.606274+0000","last_peered":"2023-11-18T19:06:42.606274+0000","last_clean":"2023-11-18T19:06:42.606274+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:06:42.606274+0000","last_undegraded":"2023-11-18T19:06:42.606274+0000","last_fullsized":"2023-11-18T19:06:42.606274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595159+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:06:41.595159+0000","last_peered":"2023-11-18T19:06:41.595159+0000","last_clean":"2023-11-18T19:06:41.595159+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:06:41.595159+0000","last_undegraded":"2023-11-18T19:06:41.595159+0000","last_fullsized":"2023-11-18T19:06:41.595159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594379+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:06:41.594379+0000","last_peered":"2023-11-18T19:06:41.594379+0000","last_clean":"2023-11-18T19:06:41.594379+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:06:41.594379+0000","last_undegraded":"2023-11-18T19:06:41.594379+0000","last_fullsized":"2023-11-18T19:06:41.594379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608512+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:06:42.608512+0000","last_peered":"2023-11-18T19:06:42.608512+0000","last_clean":"2023-11-18T19:06:42.608512+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:06:42.608512+0000","last_undegraded":"2023-11-18T19:06:42.608512+0000","last_fullsized":"2023-11-18T19:06:42.608512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584700+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:06:41.584700+0000","last_peered":"2023-11-18T19:06:41.584700+0000","last_clean":"2023-11-18T19:06:41.584700+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:06:41.584700+0000","last_undegraded":"2023-11-18T19:06:41.584700+0000","last_fullsized":"2023-11-18T19:06:41.584700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574502+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:06:41.574502+0000","last_peered":"2023-11-18T19:06:41.574502+0000","last_clean":"2023-11-18T19:06:41.574502+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:06:41.574502+0000","last_undegraded":"2023-11-18T19:06:41.574502+0000","last_fullsized":"2023-11-18T19:06:41.574502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609207+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:06:42.609207+0000","last_peered":"2023-11-18T19:06:42.609207+0000","last_clean":"2023-11-18T19:06:42.609207+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:06:42.609207+0000","last_undegraded":"2023-11-18T19:06:42.609207+0000","last_fullsized":"2023-11-18T19:06:42.609207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584886+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:06:41.584886+0000","last_peered":"2023-11-18T19:06:41.584886+0000","last_clean":"2023-11-18T19:06:41.584886+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:06:41.584886+0000","last_undegraded":"2023-11-18T19:06:41.584886+0000","last_fullsized":"2023-11-18T19:06:41.584886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580430+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:06:41.580430+0000","last_peered":"2023-11-18T19:06:41.580430+0000","last_clean":"2023-11-18T19:06:41.580430+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:06:41.580430+0000","last_undegraded":"2023-11-18T19:06:41.580430+0000","last_fullsized":"2023-11-18T19:06:41.580430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611054+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:06:42.611054+0000","last_peered":"2023-11-18T19:06:42.611054+0000","last_clean":"2023-11-18T19:06:42.611054+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:06:42.611054+0000","last_undegraded":"2023-11-18T19:06:42.611054+0000","last_fullsized":"2023-11-18T19:06:42.611054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579918+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:06:41.579918+0000","last_peered":"2023-11-18T19:06:41.579918+0000","last_clean":"2023-11-18T19:06:41.579918+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:06:41.579918+0000","last_undegraded":"2023-11-18T19:06:41.579918+0000","last_fullsized":"2023-11-18T19:06:41.579918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575468+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:06:41.575468+0000","last_peered":"2023-11-18T19:06:41.575468+0000","last_clean":"2023-11-18T19:06:41.575468+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:06:41.575468+0000","last_undegraded":"2023-11-18T19:06:41.575468+0000","last_fullsized":"2023-11-18T19:06:41.575468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610460+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:06:42.610460+0000","last_peered":"2023-11-18T19:06:42.610460+0000","last_clean":"2023-11-18T19:06:42.610460+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:06:42.610460+0000","last_undegraded":"2023-11-18T19:06:42.610460+0000","last_fullsized":"2023-11-18T19:06:42.610460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579649+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:06:41.579649+0000","last_peered":"2023-11-18T19:06:41.579649+0000","last_clean":"2023-11-18T19:06:41.579649+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:06:41.579649+0000","last_undegraded":"2023-11-18T19:06:41.579649+0000","last_fullsized":"2023-11-18T19:06:41.579649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604625+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:06:41.604625+0000","last_peered":"2023-11-18T19:06:41.604625+0000","last_clean":"2023-11-18T19:06:41.604625+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:06:41.604625+0000","last_undegraded":"2023-11-18T19:06:41.604625+0000","last_fullsized":"2023-11-18T19:06:41.604625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.613259+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:06:42.613259+0000","last_peered":"2023-11-18T19:06:42.613259+0000","last_clean":"2023-11-18T19:06:42.613259+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:06:42.613259+0000","last_undegraded":"2023-11-18T19:06:42.613259+0000","last_fullsized":"2023-11-18T19:06:42.613259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582674+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:06:41.582674+0000","last_peered":"2023-11-18T19:06:41.582674+0000","last_clean":"2023-11-18T19:06:41.582674+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:06:41.582674+0000","last_undegraded":"2023-11-18T19:06:41.582674+0000","last_fullsized":"2023-11-18T19:06:41.582674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573262+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:06:41.573262+0000","last_peered":"2023-11-18T19:06:41.573262+0000","last_clean":"2023-11-18T19:06:41.573262+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:06:41.573262+0000","last_undegraded":"2023-11-18T19:06:41.573262+0000","last_fullsized":"2023-11-18T19:06:41.573262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561489+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:06:43.561489+0000","last_peered":"2023-11-18T19:06:43.561489+0000","last_clean":"2023-11-18T19:06:43.561489+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:06:43.561489+0000","last_undegraded":"2023-11-18T19:06:43.561489+0000","last_fullsized":"2023-11-18T19:06:43.561489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587345+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:06:41.587345+0000","last_peered":"2023-11-18T19:06:41.587345+0000","last_clean":"2023-11-18T19:06:41.587345+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:06:41.587345+0000","last_undegraded":"2023-11-18T19:06:41.587345+0000","last_fullsized":"2023-11-18T19:06:41.587345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574458+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:06:41.574458+0000","last_peered":"2023-11-18T19:06:41.574458+0000","last_clean":"2023-11-18T19:06:41.574458+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:06:41.574458+0000","last_undegraded":"2023-11-18T19:06:41.574458+0000","last_fullsized":"2023-11-18T19:06:41.574458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590707+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:06:41.590707+0000","last_peered":"2023-11-18T19:06:41.590707+0000","last_clean":"2023-11-18T19:06:41.590707+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:06:41.590707+0000","last_undegraded":"2023-11-18T19:06:41.590707+0000","last_fullsized":"2023-11-18T19:06:41.590707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:24:48.318265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718474+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:06:42.718474+0000","last_peered":"2023-11-18T19:06:42.718474+0000","last_clean":"2023-11-18T19:06:42.718474+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:06:42.718474+0000","last_undegraded":"2023-11-18T19:06:42.718474+0000","last_fullsized":"2023-11-18T19:06:42.718474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574260+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:06:41.574260+0000","last_peered":"2023-11-18T19:06:41.574260+0000","last_clean":"2023-11-18T19:06:41.574260+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:06:41.574260+0000","last_undegraded":"2023-11-18T19:06:41.574260+0000","last_fullsized":"2023-11-18T19:06:41.574260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584878+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:06:41.584878+0000","last_peered":"2023-11-18T19:06:41.584878+0000","last_clean":"2023-11-18T19:06:41.584878+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:06:41.584878+0000","last_undegraded":"2023-11-18T19:06:41.584878+0000","last_fullsized":"2023-11-18T19:06:41.584878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606686+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:06:42.606686+0000","last_peered":"2023-11-18T19:06:42.606686+0000","last_clean":"2023-11-18T19:06:42.606686+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:06:42.606686+0000","last_undegraded":"2023-11-18T19:06:42.606686+0000","last_fullsized":"2023-11-18T19:06:42.606686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589667+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:06:41.589667+0000","last_peered":"2023-11-18T19:06:41.589667+0000","last_clean":"2023-11-18T19:06:41.589667+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:06:41.589667+0000","last_undegraded":"2023-11-18T19:06:41.589667+0000","last_fullsized":"2023-11-18T19:06:41.589667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591151+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:06:41.591151+0000","last_peered":"2023-11-18T19:06:41.591151+0000","last_clean":"2023-11-18T19:06:41.591151+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:06:41.591151+0000","last_undegraded":"2023-11-18T19:06:41.591151+0000","last_fullsized":"2023-11-18T19:06:41.591151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.560394+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:06:43.560394+0000","last_peered":"2023-11-18T19:06:43.560394+0000","last_clean":"2023-11-18T19:06:43.560394+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:06:43.560394+0000","last_undegraded":"2023-11-18T19:06:43.560394+0000","last_fullsized":"2023-11-18T19:06:43.560394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588173+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:06:41.588173+0000","last_peered":"2023-11-18T19:06:41.588173+0000","last_clean":"2023-11-18T19:06:41.588173+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:06:41.588173+0000","last_undegraded":"2023-11-18T19:06:41.588173+0000","last_fullsized":"2023-11-18T19:06:41.588173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594281+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:06:41.594281+0000","last_peered":"2023-11-18T19:06:41.594281+0000","last_clean":"2023-11-18T19:06:41.594281+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:06:41.594281+0000","last_undegraded":"2023-11-18T19:06:41.594281+0000","last_fullsized":"2023-11-18T19:06:41.594281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.717717+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:06:42.717717+0000","last_peered":"2023-11-18T19:06:42.717717+0000","last_clean":"2023-11-18T19:06:42.717717+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:06:42.717717+0000","last_undegraded":"2023-11-18T19:06:42.717717+0000","last_fullsized":"2023-11-18T19:06:42.717717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584417+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:06:41.584417+0000","last_peered":"2023-11-18T19:06:41.584417+0000","last_clean":"2023-11-18T19:06:41.584417+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:06:41.584417+0000","last_undegraded":"2023-11-18T19:06:41.584417+0000","last_fullsized":"2023-11-18T19:06:41.584417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588264+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:06:41.588264+0000","last_peered":"2023-11-18T19:06:41.588264+0000","last_clean":"2023-11-18T19:06:41.588264+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:06:41.588264+0000","last_undegraded":"2023-11-18T19:06:41.588264+0000","last_fullsized":"2023-11-18T19:06:41.588264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558034+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:06:43.558034+0000","last_peered":"2023-11-18T19:06:43.558034+0000","last_clean":"2023-11-18T19:06:43.558034+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:06:43.558034+0000","last_undegraded":"2023-11-18T19:06:43.558034+0000","last_fullsized":"2023-11-18T19:06:43.558034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:03.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571644+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:06:41.571644+0000","last_peered":"2023-11-18T19:06:41.571644+0000","last_clean":"2023-11-18T19:06:41.571644+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:06:41.571644+0000","last_undegraded":"2023-11-18T19:06:41.571644+0000","last_fullsized":"2023-11-18T19:06:41.571644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592325+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:06:41.592325+0000","last_peered":"2023-11-18T19:06:41.592325+0000","last_clean":"2023-11-18T19:06:41.592325+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:06:41.592325+0000","last_undegraded":"2023-11-18T19:06:41.592325+0000","last_fullsized":"2023-11-18T19:06:41.592325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562218+0000","last_change":"2023-11-18T19:06:41.614438+0000","last_active":"2023-11-18T19:06:43.562218+0000","last_peered":"2023-11-18T19:06:43.562218+0000","last_clean":"2023-11-18T19:06:43.562218+0000","last_became_active":"2023-11-18T19:06:41.613140+0000","last_became_peered":"2023-11-18T19:06:41.613140+0000","last_unstale":"2023-11-18T19:06:43.562218+0000","last_undegraded":"2023-11-18T19:06:43.562218+0000","last_fullsized":"2023-11-18T19:06:43.562218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:25.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590560+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:06:41.590560+0000","last_peered":"2023-11-18T19:06:41.590560+0000","last_clean":"2023-11-18T19:06:41.590560+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:06:41.590560+0000","last_undegraded":"2023-11-18T19:06:41.590560+0000","last_fullsized":"2023-11-18T19:06:41.590560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581506+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:06:41.581506+0000","last_peered":"2023-11-18T19:06:41.581506+0000","last_clean":"2023-11-18T19:06:41.581506+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:06:41.581506+0000","last_undegraded":"2023-11-18T19:06:41.581506+0000","last_fullsized":"2023-11-18T19:06:41.581506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561030+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:06:43.561030+0000","last_peered":"2023-11-18T19:06:43.561030+0000","last_clean":"2023-11-18T19:06:43.561030+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:06:43.561030+0000","last_undegraded":"2023-11-18T19:06:43.561030+0000","last_fullsized":"2023-11-18T19:06:43.561030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572710+0000","last_change":"2023-11-18T19:06:37.579602+0000","last_active":"2023-11-18T19:06:41.572710+0000","last_peered":"2023-11-18T19:06:41.572710+0000","last_clean":"2023-11-18T19:06:41.572710+0000","last_became_active":"2023-11-18T19:06:37.579178+0000","last_became_peered":"2023-11-18T19:06:37.579178+0000","last_unstale":"2023-11-18T19:06:41.572710+0000","last_undegraded":"2023-11-18T19:06:41.572710+0000","last_fullsized":"2023-11-18T19:06:41.572710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:15.325066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572917+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:06:41.572917+0000","last_peered":"2023-11-18T19:06:41.572917+0000","last_clean":"2023-11-18T19:06:41.572917+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:06:41.572917+0000","last_undegraded":"2023-11-18T19:06:41.572917+0000","last_fullsized":"2023-11-18T19:06:41.572917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610033+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:06:42.610033+0000","last_peered":"2023-11-18T19:06:42.610033+0000","last_clean":"2023-11-18T19:06:42.610033+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:06:42.610033+0000","last_undegraded":"2023-11-18T19:06:42.610033+0000","last_fullsized":"2023-11-18T19:06:42.610033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579551+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:06:41.579551+0000","last_peered":"2023-11-18T19:06:41.579551+0000","last_clean":"2023-11-18T19:06:41.579551+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:06:41.579551+0000","last_undegraded":"2023-11-18T19:06:41.579551+0000","last_fullsized":"2023-11-18T19:06:41.579551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.607281+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:06:41.607281+0000","last_peered":"2023-11-18T19:06:41.607281+0000","last_clean":"2023-11-18T19:06:41.607281+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:06:41.607281+0000","last_undegraded":"2023-11-18T19:06:41.607281+0000","last_fullsized":"2023-11-18T19:06:41.607281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718925+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:06:42.718925+0000","last_peered":"2023-11-18T19:06:42.718925+0000","last_clean":"2023-11-18T19:06:42.718925+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:06:42.718925+0000","last_undegraded":"2023-11-18T19:06:42.718925+0000","last_fullsized":"2023-11-18T19:06:42.718925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587790+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:06:41.587790+0000","last_peered":"2023-11-18T19:06:41.587790+0000","last_clean":"2023-11-18T19:06:41.587790+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:06:41.587790+0000","last_undegraded":"2023-11-18T19:06:41.587790+0000","last_fullsized":"2023-11-18T19:06:41.587790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:57.618128+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:06:57.618128+0000","last_peered":"2023-11-18T19:06:57.618128+0000","last_clean":"2023-11-18T19:06:57.618128+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:06:57.618128+0000","last_undegraded":"2023-11-18T19:06:57.618128+0000","last_fullsized":"2023-11-18T19:06:57.618128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611068+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:06:42.611068+0000","last_peered":"2023-11-18T19:06:42.611068+0000","last_clean":"2023-11-18T19:06:42.611068+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:06:42.611068+0000","last_undegraded":"2023-11-18T19:06:42.611068+0000","last_fullsized":"2023-11-18T19:06:42.611068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.576702+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:06:41.576702+0000","last_peered":"2023-11-18T19:06:41.576702+0000","last_clean":"2023-11-18T19:06:41.576702+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:06:41.576702+0000","last_undegraded":"2023-11-18T19:06:41.576702+0000","last_fullsized":"2023-11-18T19:06:41.576702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606192+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:06:41.606192+0000","last_peered":"2023-11-18T19:06:41.606192+0000","last_clean":"2023-11-18T19:06:41.606192+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:06:41.606192+0000","last_undegraded":"2023-11-18T19:06:41.606192+0000","last_fullsized":"2023-11-18T19:06:41.606192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.607397+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:06:42.607397+0000","last_peered":"2023-11-18T19:06:42.607397+0000","last_clean":"2023-11-18T19:06:42.607397+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:06:42.607397+0000","last_undegraded":"2023-11-18T19:06:42.607397+0000","last_fullsized":"2023-11-18T19:06:42.607397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.596028+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:06:41.596028+0000","last_peered":"2023-11-18T19:06:41.596028+0000","last_clean":"2023-11-18T19:06:41.596028+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:06:41.596028+0000","last_undegraded":"2023-11-18T19:06:41.596028+0000","last_fullsized":"2023-11-18T19:06:41.596028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587870+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:06:41.587870+0000","last_peered":"2023-11-18T19:06:41.587870+0000","last_clean":"2023-11-18T19:06:41.587870+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:06:41.587870+0000","last_undegraded":"2023-11-18T19:06:41.587870+0000","last_fullsized":"2023-11-18T19:06:41.587870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559235+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:06:43.559235+0000","last_peered":"2023-11-18T19:06:43.559235+0000","last_clean":"2023-11-18T19:06:43.559235+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:06:43.559235+0000","last_undegraded":"2023-11-18T19:06:43.559235+0000","last_fullsized":"2023-11-18T19:06:43.559235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584320+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:06:41.584320+0000","last_peered":"2023-11-18T19:06:41.584320+0000","last_clean":"2023-11-18T19:06:41.584320+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:06:41.584320+0000","last_undegraded":"2023-11-18T19:06:41.584320+0000","last_fullsized":"2023-11-18T19:06:41.584320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592273+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:06:41.592273+0000","last_peered":"2023-11-18T19:06:41.592273+0000","last_clean":"2023-11-18T19:06:41.592273+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:06:41.592273+0000","last_undegraded":"2023-11-18T19:06:41.592273+0000","last_fullsized":"2023-11-18T19:06:41.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:08.678189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609111+0000","last_change":"2023-11-18T19:06:41.622287+0000","last_active":"2023-11-18T19:06:42.609111+0000","last_peered":"2023-11-18T19:06:42.609111+0000","last_clean":"2023-11-18T19:06:42.609111+0000","last_became_active":"2023-11-18T19:06:41.618340+0000","last_became_peered":"2023-11-18T19:06:41.618340+0000","last_unstale":"2023-11-18T19:06:42.609111+0000","last_undegraded":"2023-11-18T19:06:42.609111+0000","last_fullsized":"2023-11-18T19:06:42.609111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.614055+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:06:42.614055+0000","last_peered":"2023-11-18T19:06:42.614055+0000","last_clean":"2023-11-18T19:06:42.614055+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:06:42.614055+0000","last_undegraded":"2023-11-18T19:06:42.614055+0000","last_fullsized":"2023-11-18T19:06:42.614055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590846+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:06:41.590846+0000","last_peered":"2023-11-18T19:06:41.590846+0000","last_clean":"2023-11-18T19:06:41.590846+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:06:41.590846+0000","last_undegraded":"2023-11-18T19:06:41.590846+0000","last_fullsized":"2023-11-18T19:06:41.590846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573178+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:06:41.573178+0000","last_peered":"2023-11-18T19:06:41.573178+0000","last_clean":"2023-11-18T19:06:41.573178+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:06:41.573178+0000","last_undegraded":"2023-11-18T19:06:41.573178+0000","last_fullsized":"2023-11-18T19:06:41.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718948+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:06:42.718948+0000","last_peered":"2023-11-18T19:06:42.718948+0000","last_clean":"2023-11-18T19:06:42.718948+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:06:42.718948+0000","last_undegraded":"2023-11-18T19:06:42.718948+0000","last_fullsized":"2023-11-18T19:06:42.718948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579857+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:06:41.579857+0000","last_peered":"2023-11-18T19:06:41.579857+0000","last_clean":"2023-11-18T19:06:41.579857+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:06:41.579857+0000","last_undegraded":"2023-11-18T19:06:41.579857+0000","last_fullsized":"2023-11-18T19:06:41.579857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582912+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:06:41.582912+0000","last_peered":"2023-11-18T19:06:41.582912+0000","last_clean":"2023-11-18T19:06:41.582912+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:06:41.582912+0000","last_undegraded":"2023-11-18T19:06:41.582912+0000","last_fullsized":"2023-11-18T19:06:41.582912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572727+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:06:41.572727+0000","last_peered":"2023-11-18T19:06:41.572727+0000","last_clean":"2023-11-18T19:06:41.572727+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:06:41.572727+0000","last_undegraded":"2023-11-18T19:06:41.572727+0000","last_fullsized":"2023-11-18T19:06:41.572727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591508+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:06:41.591508+0000","last_peered":"2023-11-18T19:06:41.591508+0000","last_clean":"2023-11-18T19:06:41.591508+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:06:41.591508+0000","last_undegraded":"2023-11-18T19:06:41.591508+0000","last_fullsized":"2023-11-18T19:06:41.591508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611823+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:06:42.611823+0000","last_peered":"2023-11-18T19:06:42.611823+0000","last_clean":"2023-11-18T19:06:42.611823+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:06:42.611823+0000","last_undegraded":"2023-11-18T19:06:42.611823+0000","last_fullsized":"2023-11-18T19:06:42.611823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584083+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:06:41.584083+0000","last_peered":"2023-11-18T19:06:41.584083+0000","last_clean":"2023-11-18T19:06:41.584083+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:06:41.584083+0000","last_undegraded":"2023-11-18T19:06:41.584083+0000","last_fullsized":"2023-11-18T19:06:41.584083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589767+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:06:41.589767+0000","last_peered":"2023-11-18T19:06:41.589767+0000","last_clean":"2023-11-18T19:06:41.589767+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:06:41.589767+0000","last_undegraded":"2023-11-18T19:06:41.589767+0000","last_fullsized":"2023-11-18T19:06:41.589767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561860+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:06:43.561860+0000","last_peered":"2023-11-18T19:06:43.561860+0000","last_clean":"2023-11-18T19:06:43.561860+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:06:43.561860+0000","last_undegraded":"2023-11-18T19:06:43.561860+0000","last_fullsized":"2023-11-18T19:06:43.561860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582668+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:06:41.582668+0000","last_peered":"2023-11-18T19:06:41.582668+0000","last_clean":"2023-11-18T19:06:41.582668+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:06:41.582668+0000","last_undegraded":"2023-11-18T19:06:41.582668+0000","last_fullsized":"2023-11-18T19:06:41.582668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604540+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:06:41.604540+0000","last_peered":"2023-11-18T19:06:41.604540+0000","last_clean":"2023-11-18T19:06:41.604540+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:06:41.604540+0000","last_undegraded":"2023-11-18T19:06:41.604540+0000","last_fullsized":"2023-11-18T19:06:41.604540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571628+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:06:41.571628+0000","last_peered":"2023-11-18T19:06:41.571628+0000","last_clean":"2023-11-18T19:06:41.571628+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:06:41.571628+0000","last_undegraded":"2023-11-18T19:06:41.571628+0000","last_fullsized":"2023-11-18T19:06:41.571628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.583899+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:06:41.583899+0000","last_peered":"2023-11-18T19:06:41.583899+0000","last_clean":"2023-11-18T19:06:41.583899+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:06:41.583899+0000","last_undegraded":"2023-11-18T19:06:41.583899+0000","last_fullsized":"2023-11-18T19:06:41.583899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584150+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:06:41.584150+0000","last_peered":"2023-11-18T19:06:41.584150+0000","last_clean":"2023-11-18T19:06:41.584150+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:06:41.584150+0000","last_undegraded":"2023-11-18T19:06:41.584150+0000","last_fullsized":"2023-11-18T19:06:41.584150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580014+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:06:41.580014+0000","last_peered":"2023-11-18T19:06:41.580014+0000","last_clean":"2023-11-18T19:06:41.580014+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:06:41.580014+0000","last_undegraded":"2023-11-18T19:06:41.580014+0000","last_fullsized":"2023-11-18T19:06:41.580014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584222+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:06:41.584222+0000","last_peered":"2023-11-18T19:06:41.584222+0000","last_clean":"2023-11-18T19:06:41.584222+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:06:41.584222+0000","last_undegraded":"2023-11-18T19:06:41.584222+0000","last_fullsized":"2023-11-18T19:06:41.584222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595920+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:06:41.595920+0000","last_peered":"2023-11-18T19:06:41.595920+0000","last_clean":"2023-11-18T19:06:41.595920+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:06:41.595920+0000","last_undegraded":"2023-11-18T19:06:41.595920+0000","last_fullsized":"2023-11-18T19:06:41.595920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572929+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:06:41.572929+0000","last_peered":"2023-11-18T19:06:41.572929+0000","last_clean":"2023-11-18T19:06:41.572929+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:06:41.572929+0000","last_undegraded":"2023-11-18T19:06:41.572929+0000","last_fullsized":"2023-11-18T19:06:41.572929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580481+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:06:41.580481+0000","last_peered":"2023-11-18T19:06:41.580481+0000","last_clean":"2023-11-18T19:06:41.580481+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:06:41.580481+0000","last_undegraded":"2023-11-18T19:06:41.580481+0000","last_fullsized":"2023-11-18T19:06:41.580481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589699+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:06:41.589699+0000","last_peered":"2023-11-18T19:06:41.589699+0000","last_clean":"2023-11-18T19:06:41.589699+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:06:41.589699+0000","last_undegraded":"2023-11-18T19:06:41.589699+0000","last_fullsized":"2023-11-18T19:06:41.589699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591289+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:06:41.591289+0000","last_peered":"2023-11-18T19:06:41.591289+0000","last_clean":"2023-11-18T19:06:41.591289+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:06:41.591289+0000","last_undegraded":"2023-11-18T19:06:41.591289+0000","last_fullsized":"2023-11-18T19:06:41.591289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588400+0000","last_change":"2023-11-18T19:06:37.568642+0000","last_active":"2023-11-18T19:06:41.588400+0000","last_peered":"2023-11-18T19:06:41.588400+0000","last_clean":"2023-11-18T19:06:41.588400+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:06:41.588400+0000","last_undegraded":"2023-11-18T19:06:41.588400+0000","last_fullsized":"2023-11-18T19:06:41.588400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574387+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:06:41.574387+0000","last_peered":"2023-11-18T19:06:41.574387+0000","last_clean":"2023-11-18T19:06:41.574387+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:06:41.574387+0000","last_undegraded":"2023-11-18T19:06:41.574387+0000","last_fullsized":"2023-11-18T19:06:41.574387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606645+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:06:41.606645+0000","last_peered":"2023-11-18T19:06:41.606645+0000","last_clean":"2023-11-18T19:06:41.606645+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:06:41.606645+0000","last_undegraded":"2023-11-18T19:06:41.606645+0000","last_fullsized":"2023-11-18T19:06:41.606645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575789+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:06:41.575789+0000","last_peered":"2023-11-18T19:06:41.575789+0000","last_clean":"2023-11-18T19:06:41.575789+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:06:41.575789+0000","last_undegraded":"2023-11-18T19:06:41.575789+0000","last_fullsized":"2023-11-18T19:06:41.575789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572996+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:06:41.572996+0000","last_peered":"2023-11-18T19:06:41.572996+0000","last_clean":"2023-11-18T19:06:41.572996+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:06:41.572996+0000","last_undegraded":"2023-11-18T19:06:41.572996+0000","last_fullsized":"2023-11-18T19:06:41.572996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580120+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:06:41.580120+0000","last_peered":"2023-11-18T19:06:41.580120+0000","last_clean":"2023-11-18T19:06:41.580120+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:06:41.580120+0000","last_undegraded":"2023-11-18T19:06:41.580120+0000","last_fullsized":"2023-11-18T19:06:41.580120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579307+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:06:41.579307+0000","last_peered":"2023-11-18T19:06:41.579307+0000","last_clean":"2023-11-18T19:06:41.579307+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:06:41.579307+0000","last_undegraded":"2023-11-18T19:06:41.579307+0000","last_fullsized":"2023-11-18T19:06:41.579307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580691+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:06:41.580691+0000","last_peered":"2023-11-18T19:06:41.580691+0000","last_clean":"2023-11-18T19:06:41.580691+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:06:41.580691+0000","last_undegraded":"2023-11-18T19:06:41.580691+0000","last_fullsized":"2023-11-18T19:06:41.580691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588307+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:06:41.588307+0000","last_peered":"2023-11-18T19:06:41.588307+0000","last_clean":"2023-11-18T19:06:41.588307+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:06:41.588307+0000","last_undegraded":"2023-11-18T19:06:41.588307+0000","last_fullsized":"2023-11-18T19:06:41.588307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587696+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:06:41.587696+0000","last_peered":"2023-11-18T19:06:41.587696+0000","last_clean":"2023-11-18T19:06:41.587696+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:06:41.587696+0000","last_undegraded":"2023-11-18T19:06:41.587696+0000","last_fullsized":"2023-11-18T19:06:41.587696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587712+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:06:41.587712+0000","last_peered":"2023-11-18T19:06:41.587712+0000","last_clean":"2023-11-18T19:06:41.587712+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:06:41.587712+0000","last_undegraded":"2023-11-18T19:06:41.587712+0000","last_fullsized":"2023-11-18T19:06:41.587712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592211+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:06:41.592211+0000","last_peered":"2023-11-18T19:06:41.592211+0000","last_clean":"2023-11-18T19:06:41.592211+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:06:41.592211+0000","last_undegraded":"2023-11-18T19:06:41.592211+0000","last_fullsized":"2023-11-18T19:06:41.592211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579563+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:06:41.579563+0000","last_peered":"2023-11-18T19:06:41.579563+0000","last_clean":"2023-11-18T19:06:41.579563+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:06:41.579563+0000","last_undegraded":"2023-11-18T19:06:41.579563+0000","last_fullsized":"2023-11-18T19:06:41.579563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581411+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:06:41.581411+0000","last_peered":"2023-11-18T19:06:41.581411+0000","last_clean":"2023-11-18T19:06:41.581411+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:06:41.581411+0000","last_undegraded":"2023-11-18T19:06:41.581411+0000","last_fullsized":"2023-11-18T19:06:41.581411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584038+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:06:41.584038+0000","last_peered":"2023-11-18T19:06:41.584038+0000","last_clean":"2023-11-18T19:06:41.584038+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:06:41.584038+0000","last_undegraded":"2023-11-18T19:06:41.584038+0000","last_fullsized":"2023-11-18T19:06:41.584038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580068+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:06:41.580068+0000","last_peered":"2023-11-18T19:06:41.580068+0000","last_clean":"2023-11-18T19:06:41.580068+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:06:41.580068+0000","last_undegraded":"2023-11-18T19:06:41.580068+0000","last_fullsized":"2023-11-18T19:06:41.580068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584628+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:06:41.584628+0000","last_peered":"2023-11-18T19:06:41.584628+0000","last_clean":"2023-11-18T19:06:41.584628+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:06:41.584628+0000","last_undegraded":"2023-11-18T19:06:41.584628+0000","last_fullsized":"2023-11-18T19:06:41.584628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591038+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:06:41.591038+0000","last_peered":"2023-11-18T19:06:41.591038+0000","last_clean":"2023-11-18T19:06:41.591038+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:06:41.591038+0000","last_undegraded":"2023-11-18T19:06:41.591038+0000","last_fullsized":"2023-11-18T19:06:41.591038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594622+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:06:41.594622+0000","last_peered":"2023-11-18T19:06:41.594622+0000","last_clean":"2023-11-18T19:06:41.594622+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:06:41.594622+0000","last_undegraded":"2023-11-18T19:06:41.594622+0000","last_fullsized":"2023-11-18T19:06:41.594622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588068+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:06:41.588068+0000","last_peered":"2023-11-18T19:06:41.588068+0000","last_clean":"2023-11-18T19:06:41.588068+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:06:41.588068+0000","last_undegraded":"2023-11-18T19:06:41.588068+0000","last_fullsized":"2023-11-18T19:06:41.588068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":700553,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":110675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5579999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.597}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":700531,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:07:08.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:07:08.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.551+0000 7ff00f77c640 1 Processor -- start 2023-11-18T19:07:08.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.551+0000 7ff00f77c640 1 -- start start 2023-11-18T19:07:08.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00f77c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff008155380 0x7ff0080bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00f77c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0080bf290 0x7ff0080a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00f77c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0080a5390 0x7ff0080c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00f77c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080c43e0 con 0x7ff0080bf290 2023-11-18T19:07:08.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00f77c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080c3ad0 con 0x7ff008155380 2023-11-18T19:07:08.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00f77c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff008158c30 con 0x7ff0080a5390 2023-11-18T19:07:08.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00cd17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0080bf290 0x7ff0080a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00cd17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0080bf290 0x7ff0080a4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38246/0 (socket says 172.21.15.45:38246) 2023-11-18T19:07:08.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00cd17640 1 -- 172.21.15.45:0/4273526730 learned_addr learned my addr 172.21.15.45:0/4273526730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00d518640 1 --2- 172.21.15.45:0/4273526730 >> v2:172.21.15.135:3300/0 conn(0x7ff008155380 0x7ff0080bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00dd19640 1 --2- 172.21.15.45:0/4273526730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0080a5390 0x7ff0080c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.553+0000 7ff00cd17640 1 -- 172.21.15.45:0/4273526730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0080a5390 msgr2=0x7ff0080c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.554+0000 7ff00cd17640 1 --2- 172.21.15.45:0/4273526730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0080a5390 0x7ff0080c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.554+0000 7ff00cd17640 1 -- 172.21.15.45:0/4273526730 >> v2:172.21.15.135:3300/0 conn(0x7ff008155380 msgr2=0x7ff0080bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.554+0000 7ff00cd17640 1 --2- 172.21.15.45:0/4273526730 >> v2:172.21.15.135:3300/0 conn(0x7ff008155380 0x7ff0080bfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.554+0000 7ff00cd17640 1 -- 172.21.15.45:0/4273526730 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080c3d20 con 0x7ff0080bf290 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.554+0000 7ff00dd19640 1 --2- 172.21.15.45:0/4273526730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0080a5390 0x7ff0080c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.555+0000 7ff00cd17640 1 --2- 172.21.15.45:0/4273526730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0080a4e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff00806f5e0 tx=0x7feff802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ea73ebb91ac392 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:08.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.555+0000 7feffffff640 1 -- 172.21.15.45:0/4273526730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8031750 con 0x7ff0080bf290 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.555+0000 7feffffff640 1 -- 172.21.15.45:0/4273526730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80318b0 con 0x7ff0080bf290 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.555+0000 7feffffff640 1 -- 172.21.15.45:0/4273526730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8031c40 con 0x7ff0080bf290 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 -- 172.21.15.45:0/4273526730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 msgr2=0x7ff0080a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 --2- 172.21.15.45:0/4273526730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0080a4e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff00806f5e0 tx=0x7feff802b7f0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 -- 172.21.15.45:0/4273526730 shutdown_connections 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 --2- 172.21.15.45:0/4273526730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0080a5390 0x7ff0080c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 --2- 172.21.15.45:0/4273526730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0080a4e50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 --2- 172.21.15.45:0/4273526730 >> v2:172.21.15.135:3300/0 conn(0x7ff008155380 0x7ff0080bfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 -- 172.21.15.45:0/4273526730 >> 172.21.15.45:0/4273526730 conn(0x7ff0080c5bd0 msgr2=0x7ff0080c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:08.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 -- 172.21.15.45:0/4273526730 shutdown_connections 2023-11-18T19:07:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.556+0000 7ff00f77c640 1 -- 172.21.15.45:0/4273526730 wait complete. 2023-11-18T19:07:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.557+0000 7ff00f77c640 1 Processor -- start 2023-11-18T19:07:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.558+0000 7ff00f77c640 1 -- start start 2023-11-18T19:07:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.558+0000 7ff00f77c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0080a5390 0x7ff0080a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.558+0000 7ff00f77c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0081ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00f77c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff008155380 0x7ff0081edd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00f77c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080a8ca0 con 0x7ff0080bf290 2023-11-18T19:07:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00f77c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0081ee340 con 0x7ff0080a5390 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00f77c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080a8ef0 con 0x7ff008155380 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0081ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0081ed7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38252/0 (socket says 172.21.15.45:38252) 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 -- 172.21.15.45:0/1376647866 learned_addr learned my addr 172.21.15.45:0/1376647866 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00d518640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0080a5390 0x7ff0080a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 -- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff008155380 msgr2=0x7ff0081edd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff008155380 0x7ff0081edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 -- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0080a5390 msgr2=0x7ff0080a7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0080a5390 0x7ff0080a7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00cd17640 1 -- 172.21.15.45:0/1376647866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80094d0 con 0x7ff0080bf290 2023-11-18T19:07:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.559+0000 7ff00d518640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0080a5390 0x7ff0080a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.560+0000 7ff00cd17640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0081ed7e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feff8000c00 tx=0x7feff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.560+0000 7feffdffb640 1 -- 172.21.15.45:0/1376647866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8033c80 con 0x7ff0080bf290 2023-11-18T19:07:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.560+0000 7feffdffb640 1 -- 172.21.15.45:0/1376647866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff8033de0 con 0x7ff0080bf290 2023-11-18T19:07:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.560+0000 7feffdffb640 1 -- 172.21.15.45:0/1376647866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff803c640 con 0x7ff0080bf290 2023-11-18T19:07:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.560+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0080a91d0 con 0x7ff0080bf290 2023-11-18T19:07:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.560+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0080a7fe0 con 0x7ff0080bf290 2023-11-18T19:07:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.561+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0080a81a0 con 0x7ff0080bf290 2023-11-18T19:07:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.562+0000 7feffdffb640 1 -- 172.21.15.45:0/1376647866 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feff803a040 con 0x7ff0080bf290 2023-11-18T19:07:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.563+0000 7feffdffb640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fefec06ae40 0x7fefec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.563+0000 7feffdffb640 1 -- 172.21.15.45:0/1376647866 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feff80ab630 con 0x7ff0080bf290 2023-11-18T19:07:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.563+0000 7ff00d518640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fefec06ae40 0x7fefec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.564+0000 7ff00d518640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fefec06ae40 0x7fefec06d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff004006fd0 tx=0x7ff004008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.567+0000 7feffdffb640 1 -- 172.21.15.45:0/1376647866 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feff80762c0 con 0x7ff0080bf290 2023-11-18T19:07:08.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.753+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0081588c0 con 0x7fefec06ae40 2023-11-18T19:07:08.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.776+0000 7feffdffb640 1 -- 172.21.15.45:0/1376647866 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345181 (secure 0 0 0) 0x7ff004009e10 con 0x7fefec06ae40 2023-11-18T19:07:08.781 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:07:08.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fefec06ae40 msgr2=0x7fefec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fefec06ae40 0x7fefec06d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff004006fd0 tx=0x7ff004008040 comp rx=0 tx=0).stop 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 msgr2=0x7ff0081ed7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0081ed7e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feff8000c00 tx=0x7feff80046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 shutdown_connections 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fefec06ae40 0x7fefec06d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff008155380 0x7ff0081edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0080bf290 0x7ff0081ed7e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 --2- 172.21.15.45:0/1376647866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0080a5390 0x7ff0080a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.783+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 >> 172.21.15.45:0/1376647866 conn(0x7ff0080c5bd0 msgr2=0x7ff0080c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.784+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 shutdown_connections 2023-11-18T19:07:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:08.784+0000 7ff00f77c640 1 -- 172.21.15.45:0/1376647866 wait complete. 2023-11-18T19:07:08.805 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-11-18T19:07:07.177888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222736,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751984,"statfs":{"total":773094113280,"available":772866031616,"internally_reserved":0,"allocated":2457600,"data_stored":2070758,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005692"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595259+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:06:41.595259+0000","last_peered":"2023-11-18T19:06:41.595259+0000","last_clean":"2023-11-18T19:06:41.595259+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:06:41.595259+0000","last_undegraded":"2023-11-18T19:06:41.595259+0000","last_fullsized":"2023-11-18T19:06:41.595259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594762+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:06:41.594762+0000","last_peered":"2023-11-18T19:06:41.594762+0000","last_clean":"2023-11-18T19:06:41.594762+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:06:41.594762+0000","last_undegraded":"2023-11-18T19:06:41.594762+0000","last_fullsized":"2023-11-18T19:06:41.594762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559367+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:06:43.559367+0000","last_peered":"2023-11-18T19:06:43.559367+0000","last_clean":"2023-11-18T19:06:43.559367+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:06:43.559367+0000","last_undegraded":"2023-11-18T19:06:43.559367+0000","last_fullsized":"2023-11-18T19:06:43.559367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595732+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:06:41.595732+0000","last_peered":"2023-11-18T19:06:41.595732+0000","last_clean":"2023-11-18T19:06:41.595732+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:06:41.595732+0000","last_undegraded":"2023-11-18T19:06:41.595732+0000","last_fullsized":"2023-11-18T19:06:41.595732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595986+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:06:41.595986+0000","last_peered":"2023-11-18T19:06:41.595986+0000","last_clean":"2023-11-18T19:06:41.595986+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:06:41.595986+0000","last_undegraded":"2023-11-18T19:06:41.595986+0000","last_fullsized":"2023-11-18T19:06:41.595986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606153+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:06:42.606153+0000","last_peered":"2023-11-18T19:06:42.606153+0000","last_clean":"2023-11-18T19:06:42.606153+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:06:42.606153+0000","last_undegraded":"2023-11-18T19:06:42.606153+0000","last_fullsized":"2023-11-18T19:06:42.606153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587914+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:06:41.587914+0000","last_peered":"2023-11-18T19:06:41.587914+0000","last_clean":"2023-11-18T19:06:41.587914+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:06:41.587914+0000","last_undegraded":"2023-11-18T19:06:41.587914+0000","last_fullsized":"2023-11-18T19:06:41.587914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591833+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:06:41.591833+0000","last_peered":"2023-11-18T19:06:41.591833+0000","last_clean":"2023-11-18T19:06:41.591833+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:06:41.591833+0000","last_undegraded":"2023-11-18T19:06:41.591833+0000","last_fullsized":"2023-11-18T19:06:41.591833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606957+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:06:42.606957+0000","last_peered":"2023-11-18T19:06:42.606957+0000","last_clean":"2023-11-18T19:06:42.606957+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:06:42.606957+0000","last_undegraded":"2023-11-18T19:06:42.606957+0000","last_fullsized":"2023-11-18T19:06:42.606957+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588640+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:06:41.588640+0000","last_peered":"2023-11-18T19:06:41.588640+0000","last_clean":"2023-11-18T19:06:41.588640+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:06:41.588640+0000","last_undegraded":"2023-11-18T19:06:41.588640+0000","last_fullsized":"2023-11-18T19:06:41.588640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574155+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:06:41.574155+0000","last_peered":"2023-11-18T19:06:41.574155+0000","last_clean":"2023-11-18T19:06:41.574155+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:06:41.574155+0000","last_undegraded":"2023-11-18T19:06:41.574155+0000","last_fullsized":"2023-11-18T19:06:41.574155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606417+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:06:42.606417+0000","last_peered":"2023-11-18T19:06:42.606417+0000","last_clean":"2023-11-18T19:06:42.606417+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:06:42.606417+0000","last_undegraded":"2023-11-18T19:06:42.606417+0000","last_fullsized":"2023-11-18T19:06:42.606417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572339+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:06:41.572339+0000","last_peered":"2023-11-18T19:06:41.572339+0000","last_clean":"2023-11-18T19:06:41.572339+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:06:41.572339+0000","last_undegraded":"2023-11-18T19:06:41.572339+0000","last_fullsized":"2023-11-18T19:06:41.572339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574750+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:06:41.574750+0000","last_peered":"2023-11-18T19:06:41.574750+0000","last_clean":"2023-11-18T19:06:41.574750+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:06:41.574750+0000","last_undegraded":"2023-11-18T19:06:41.574750+0000","last_fullsized":"2023-11-18T19:06:41.574750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718092+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:06:42.718092+0000","last_peered":"2023-11-18T19:06:42.718092+0000","last_clean":"2023-11-18T19:06:42.718092+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:06:42.718092+0000","last_undegraded":"2023-11-18T19:06:42.718092+0000","last_fullsized":"2023-11-18T19:06:42.718092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606456+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:06:41.606456+0000","last_peered":"2023-11-18T19:06:41.606456+0000","last_clean":"2023-11-18T19:06:41.606456+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:06:41.606456+0000","last_undegraded":"2023-11-18T19:06:41.606456+0000","last_fullsized":"2023-11-18T19:06:41.606456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579797+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:06:41.579797+0000","last_peered":"2023-11-18T19:06:41.579797+0000","last_clean":"2023-11-18T19:06:41.579797+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:06:41.579797+0000","last_undegraded":"2023-11-18T19:06:41.579797+0000","last_fullsized":"2023-11-18T19:06:41.579797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558472+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:06:43.558472+0000","last_peered":"2023-11-18T19:06:43.558472+0000","last_clean":"2023-11-18T19:06:43.558472+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:06:43.558472+0000","last_undegraded":"2023-11-18T19:06:43.558472+0000","last_fullsized":"2023-11-18T19:06:43.558472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592221+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:06:41.592221+0000","last_peered":"2023-11-18T19:06:41.592221+0000","last_clean":"2023-11-18T19:06:41.592221+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:06:41.592221+0000","last_undegraded":"2023-11-18T19:06:41.592221+0000","last_fullsized":"2023-11-18T19:06:41.592221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594052+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:06:41.594052+0000","last_peered":"2023-11-18T19:06:41.594052+0000","last_clean":"2023-11-18T19:06:41.594052+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:06:41.594052+0000","last_undegraded":"2023-11-18T19:06:41.594052+0000","last_fullsized":"2023-11-18T19:06:41.594052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562033+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:06:43.562033+0000","last_peered":"2023-11-18T19:06:43.562033+0000","last_clean":"2023-11-18T19:06:43.562033+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:06:43.562033+0000","last_undegraded":"2023-11-18T19:06:43.562033+0000","last_fullsized":"2023-11-18T19:06:43.562033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571771+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:06:41.571771+0000","last_peered":"2023-11-18T19:06:41.571771+0000","last_clean":"2023-11-18T19:06:41.571771+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:06:41.571771+0000","last_undegraded":"2023-11-18T19:06:41.571771+0000","last_fullsized":"2023-11-18T19:06:41.571771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580390+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:06:41.580390+0000","last_peered":"2023-11-18T19:06:41.580390+0000","last_clean":"2023-11-18T19:06:41.580390+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:06:41.580390+0000","last_undegraded":"2023-11-18T19:06:41.580390+0000","last_fullsized":"2023-11-18T19:06:41.580390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608335+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:06:42.608335+0000","last_peered":"2023-11-18T19:06:42.608335+0000","last_clean":"2023-11-18T19:06:42.608335+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:06:42.608335+0000","last_undegraded":"2023-11-18T19:06:42.608335+0000","last_fullsized":"2023-11-18T19:06:42.608335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594176+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:06:41.594176+0000","last_peered":"2023-11-18T19:06:41.594176+0000","last_clean":"2023-11-18T19:06:41.594176+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:06:41.594176+0000","last_undegraded":"2023-11-18T19:06:41.594176+0000","last_fullsized":"2023-11-18T19:06:41.594176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575911+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:06:41.575911+0000","last_peered":"2023-11-18T19:06:41.575911+0000","last_clean":"2023-11-18T19:06:41.575911+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:06:41.575911+0000","last_undegraded":"2023-11-18T19:06:41.575911+0000","last_fullsized":"2023-11-18T19:06:41.575911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606274+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:06:42.606274+0000","last_peered":"2023-11-18T19:06:42.606274+0000","last_clean":"2023-11-18T19:06:42.606274+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:06:42.606274+0000","last_undegraded":"2023-11-18T19:06:42.606274+0000","last_fullsized":"2023-11-18T19:06:42.606274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595159+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:06:41.595159+0000","last_peered":"2023-11-18T19:06:41.595159+0000","last_clean":"2023-11-18T19:06:41.595159+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:06:41.595159+0000","last_undegraded":"2023-11-18T19:06:41.595159+0000","last_fullsized":"2023-11-18T19:06:41.595159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594379+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:06:41.594379+0000","last_peered":"2023-11-18T19:06:41.594379+0000","last_clean":"2023-11-18T19:06:41.594379+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:06:41.594379+0000","last_undegraded":"2023-11-18T19:06:41.594379+0000","last_fullsized":"2023-11-18T19:06:41.594379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.608512+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:06:42.608512+0000","last_peered":"2023-11-18T19:06:42.608512+0000","last_clean":"2023-11-18T19:06:42.608512+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:06:42.608512+0000","last_undegraded":"2023-11-18T19:06:42.608512+0000","last_fullsized":"2023-11-18T19:06:42.608512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584700+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:06:41.584700+0000","last_peered":"2023-11-18T19:06:41.584700+0000","last_clean":"2023-11-18T19:06:41.584700+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:06:41.584700+0000","last_undegraded":"2023-11-18T19:06:41.584700+0000","last_fullsized":"2023-11-18T19:06:41.584700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574502+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:06:41.574502+0000","last_peered":"2023-11-18T19:06:41.574502+0000","last_clean":"2023-11-18T19:06:41.574502+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:06:41.574502+0000","last_undegraded":"2023-11-18T19:06:41.574502+0000","last_fullsized":"2023-11-18T19:06:41.574502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609207+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:06:42.609207+0000","last_peered":"2023-11-18T19:06:42.609207+0000","last_clean":"2023-11-18T19:06:42.609207+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:06:42.609207+0000","last_undegraded":"2023-11-18T19:06:42.609207+0000","last_fullsized":"2023-11-18T19:06:42.609207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584886+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:06:41.584886+0000","last_peered":"2023-11-18T19:06:41.584886+0000","last_clean":"2023-11-18T19:06:41.584886+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:06:41.584886+0000","last_undegraded":"2023-11-18T19:06:41.584886+0000","last_fullsized":"2023-11-18T19:06:41.584886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580430+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:06:41.580430+0000","last_peered":"2023-11-18T19:06:41.580430+0000","last_clean":"2023-11-18T19:06:41.580430+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:06:41.580430+0000","last_undegraded":"2023-11-18T19:06:41.580430+0000","last_fullsized":"2023-11-18T19:06:41.580430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611054+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:06:42.611054+0000","last_peered":"2023-11-18T19:06:42.611054+0000","last_clean":"2023-11-18T19:06:42.611054+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:06:42.611054+0000","last_undegraded":"2023-11-18T19:06:42.611054+0000","last_fullsized":"2023-11-18T19:06:42.611054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579918+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:06:41.579918+0000","last_peered":"2023-11-18T19:06:41.579918+0000","last_clean":"2023-11-18T19:06:41.579918+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:06:41.579918+0000","last_undegraded":"2023-11-18T19:06:41.579918+0000","last_fullsized":"2023-11-18T19:06:41.579918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575468+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:06:41.575468+0000","last_peered":"2023-11-18T19:06:41.575468+0000","last_clean":"2023-11-18T19:06:41.575468+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:06:41.575468+0000","last_undegraded":"2023-11-18T19:06:41.575468+0000","last_fullsized":"2023-11-18T19:06:41.575468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610460+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:06:42.610460+0000","last_peered":"2023-11-18T19:06:42.610460+0000","last_clean":"2023-11-18T19:06:42.610460+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:06:42.610460+0000","last_undegraded":"2023-11-18T19:06:42.610460+0000","last_fullsized":"2023-11-18T19:06:42.610460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579649+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:06:41.579649+0000","last_peered":"2023-11-18T19:06:41.579649+0000","last_clean":"2023-11-18T19:06:41.579649+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:06:41.579649+0000","last_undegraded":"2023-11-18T19:06:41.579649+0000","last_fullsized":"2023-11-18T19:06:41.579649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604625+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:06:41.604625+0000","last_peered":"2023-11-18T19:06:41.604625+0000","last_clean":"2023-11-18T19:06:41.604625+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:06:41.604625+0000","last_undegraded":"2023-11-18T19:06:41.604625+0000","last_fullsized":"2023-11-18T19:06:41.604625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.613259+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:06:42.613259+0000","last_peered":"2023-11-18T19:06:42.613259+0000","last_clean":"2023-11-18T19:06:42.613259+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:06:42.613259+0000","last_undegraded":"2023-11-18T19:06:42.613259+0000","last_fullsized":"2023-11-18T19:06:42.613259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582674+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:06:41.582674+0000","last_peered":"2023-11-18T19:06:41.582674+0000","last_clean":"2023-11-18T19:06:41.582674+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:06:41.582674+0000","last_undegraded":"2023-11-18T19:06:41.582674+0000","last_fullsized":"2023-11-18T19:06:41.582674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573262+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:06:41.573262+0000","last_peered":"2023-11-18T19:06:41.573262+0000","last_clean":"2023-11-18T19:06:41.573262+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:06:41.573262+0000","last_undegraded":"2023-11-18T19:06:41.573262+0000","last_fullsized":"2023-11-18T19:06:41.573262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561489+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:06:43.561489+0000","last_peered":"2023-11-18T19:06:43.561489+0000","last_clean":"2023-11-18T19:06:43.561489+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:06:43.561489+0000","last_undegraded":"2023-11-18T19:06:43.561489+0000","last_fullsized":"2023-11-18T19:06:43.561489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587345+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:06:41.587345+0000","last_peered":"2023-11-18T19:06:41.587345+0000","last_clean":"2023-11-18T19:06:41.587345+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:06:41.587345+0000","last_undegraded":"2023-11-18T19:06:41.587345+0000","last_fullsized":"2023-11-18T19:06:41.587345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574458+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:06:41.574458+0000","last_peered":"2023-11-18T19:06:41.574458+0000","last_clean":"2023-11-18T19:06:41.574458+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:06:41.574458+0000","last_undegraded":"2023-11-18T19:06:41.574458+0000","last_fullsized":"2023-11-18T19:06:41.574458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590707+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:06:41.590707+0000","last_peered":"2023-11-18T19:06:41.590707+0000","last_clean":"2023-11-18T19:06:41.590707+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:06:41.590707+0000","last_undegraded":"2023-11-18T19:06:41.590707+0000","last_fullsized":"2023-11-18T19:06:41.590707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:24:48.318265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718474+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:06:42.718474+0000","last_peered":"2023-11-18T19:06:42.718474+0000","last_clean":"2023-11-18T19:06:42.718474+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:06:42.718474+0000","last_undegraded":"2023-11-18T19:06:42.718474+0000","last_fullsized":"2023-11-18T19:06:42.718474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574260+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:06:41.574260+0000","last_peered":"2023-11-18T19:06:41.574260+0000","last_clean":"2023-11-18T19:06:41.574260+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:06:41.574260+0000","last_undegraded":"2023-11-18T19:06:41.574260+0000","last_fullsized":"2023-11-18T19:06:41.574260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584878+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:06:41.584878+0000","last_peered":"2023-11-18T19:06:41.584878+0000","last_clean":"2023-11-18T19:06:41.584878+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:06:41.584878+0000","last_undegraded":"2023-11-18T19:06:41.584878+0000","last_fullsized":"2023-11-18T19:06:41.584878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.606686+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:06:42.606686+0000","last_peered":"2023-11-18T19:06:42.606686+0000","last_clean":"2023-11-18T19:06:42.606686+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:06:42.606686+0000","last_undegraded":"2023-11-18T19:06:42.606686+0000","last_fullsized":"2023-11-18T19:06:42.606686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589667+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:06:41.589667+0000","last_peered":"2023-11-18T19:06:41.589667+0000","last_clean":"2023-11-18T19:06:41.589667+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:06:41.589667+0000","last_undegraded":"2023-11-18T19:06:41.589667+0000","last_fullsized":"2023-11-18T19:06:41.589667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591151+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:06:41.591151+0000","last_peered":"2023-11-18T19:06:41.591151+0000","last_clean":"2023-11-18T19:06:41.591151+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:06:41.591151+0000","last_undegraded":"2023-11-18T19:06:41.591151+0000","last_fullsized":"2023-11-18T19:06:41.591151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.560394+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:06:43.560394+0000","last_peered":"2023-11-18T19:06:43.560394+0000","last_clean":"2023-11-18T19:06:43.560394+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:06:43.560394+0000","last_undegraded":"2023-11-18T19:06:43.560394+0000","last_fullsized":"2023-11-18T19:06:43.560394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588173+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:06:41.588173+0000","last_peered":"2023-11-18T19:06:41.588173+0000","last_clean":"2023-11-18T19:06:41.588173+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:06:41.588173+0000","last_undegraded":"2023-11-18T19:06:41.588173+0000","last_fullsized":"2023-11-18T19:06:41.588173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594281+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:06:41.594281+0000","last_peered":"2023-11-18T19:06:41.594281+0000","last_clean":"2023-11-18T19:06:41.594281+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:06:41.594281+0000","last_undegraded":"2023-11-18T19:06:41.594281+0000","last_fullsized":"2023-11-18T19:06:41.594281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.717717+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:06:42.717717+0000","last_peered":"2023-11-18T19:06:42.717717+0000","last_clean":"2023-11-18T19:06:42.717717+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:06:42.717717+0000","last_undegraded":"2023-11-18T19:06:42.717717+0000","last_fullsized":"2023-11-18T19:06:42.717717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584417+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:06:41.584417+0000","last_peered":"2023-11-18T19:06:41.584417+0000","last_clean":"2023-11-18T19:06:41.584417+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:06:41.584417+0000","last_undegraded":"2023-11-18T19:06:41.584417+0000","last_fullsized":"2023-11-18T19:06:41.584417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588264+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:06:41.588264+0000","last_peered":"2023-11-18T19:06:41.588264+0000","last_clean":"2023-11-18T19:06:41.588264+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:06:41.588264+0000","last_undegraded":"2023-11-18T19:06:41.588264+0000","last_fullsized":"2023-11-18T19:06:41.588264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.558034+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:06:43.558034+0000","last_peered":"2023-11-18T19:06:43.558034+0000","last_clean":"2023-11-18T19:06:43.558034+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:06:43.558034+0000","last_undegraded":"2023-11-18T19:06:43.558034+0000","last_fullsized":"2023-11-18T19:06:43.558034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:03.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571644+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:06:41.571644+0000","last_peered":"2023-11-18T19:06:41.571644+0000","last_clean":"2023-11-18T19:06:41.571644+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:06:41.571644+0000","last_undegraded":"2023-11-18T19:06:41.571644+0000","last_fullsized":"2023-11-18T19:06:41.571644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592325+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:06:41.592325+0000","last_peered":"2023-11-18T19:06:41.592325+0000","last_clean":"2023-11-18T19:06:41.592325+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:06:41.592325+0000","last_undegraded":"2023-11-18T19:06:41.592325+0000","last_fullsized":"2023-11-18T19:06:41.592325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.562218+0000","last_change":"2023-11-18T19:06:41.614438+0000","last_active":"2023-11-18T19:06:43.562218+0000","last_peered":"2023-11-18T19:06:43.562218+0000","last_clean":"2023-11-18T19:06:43.562218+0000","last_became_active":"2023-11-18T19:06:41.613140+0000","last_became_peered":"2023-11-18T19:06:41.613140+0000","last_unstale":"2023-11-18T19:06:43.562218+0000","last_undegraded":"2023-11-18T19:06:43.562218+0000","last_fullsized":"2023-11-18T19:06:43.562218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:25.927295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590560+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:06:41.590560+0000","last_peered":"2023-11-18T19:06:41.590560+0000","last_clean":"2023-11-18T19:06:41.590560+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:06:41.590560+0000","last_undegraded":"2023-11-18T19:06:41.590560+0000","last_fullsized":"2023-11-18T19:06:41.590560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581506+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:06:41.581506+0000","last_peered":"2023-11-18T19:06:41.581506+0000","last_clean":"2023-11-18T19:06:41.581506+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:06:41.581506+0000","last_undegraded":"2023-11-18T19:06:41.581506+0000","last_fullsized":"2023-11-18T19:06:41.581506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561030+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:06:43.561030+0000","last_peered":"2023-11-18T19:06:43.561030+0000","last_clean":"2023-11-18T19:06:43.561030+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:06:43.561030+0000","last_undegraded":"2023-11-18T19:06:43.561030+0000","last_fullsized":"2023-11-18T19:06:43.561030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572710+0000","last_change":"2023-11-18T19:06:37.579602+0000","last_active":"2023-11-18T19:06:41.572710+0000","last_peered":"2023-11-18T19:06:41.572710+0000","last_clean":"2023-11-18T19:06:41.572710+0000","last_became_active":"2023-11-18T19:06:37.579178+0000","last_became_peered":"2023-11-18T19:06:37.579178+0000","last_unstale":"2023-11-18T19:06:41.572710+0000","last_undegraded":"2023-11-18T19:06:41.572710+0000","last_fullsized":"2023-11-18T19:06:41.572710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:10:15.325066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572917+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:06:41.572917+0000","last_peered":"2023-11-18T19:06:41.572917+0000","last_clean":"2023-11-18T19:06:41.572917+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:06:41.572917+0000","last_undegraded":"2023-11-18T19:06:41.572917+0000","last_fullsized":"2023-11-18T19:06:41.572917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.610033+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:06:42.610033+0000","last_peered":"2023-11-18T19:06:42.610033+0000","last_clean":"2023-11-18T19:06:42.610033+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:06:42.610033+0000","last_undegraded":"2023-11-18T19:06:42.610033+0000","last_fullsized":"2023-11-18T19:06:42.610033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579551+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:06:41.579551+0000","last_peered":"2023-11-18T19:06:41.579551+0000","last_clean":"2023-11-18T19:06:41.579551+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:06:41.579551+0000","last_undegraded":"2023-11-18T19:06:41.579551+0000","last_fullsized":"2023-11-18T19:06:41.579551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.607281+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:06:41.607281+0000","last_peered":"2023-11-18T19:06:41.607281+0000","last_clean":"2023-11-18T19:06:41.607281+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:06:41.607281+0000","last_undegraded":"2023-11-18T19:06:41.607281+0000","last_fullsized":"2023-11-18T19:06:41.607281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718925+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:06:42.718925+0000","last_peered":"2023-11-18T19:06:42.718925+0000","last_clean":"2023-11-18T19:06:42.718925+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:06:42.718925+0000","last_undegraded":"2023-11-18T19:06:42.718925+0000","last_fullsized":"2023-11-18T19:06:42.718925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587790+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:06:41.587790+0000","last_peered":"2023-11-18T19:06:41.587790+0000","last_clean":"2023-11-18T19:06:41.587790+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:06:41.587790+0000","last_undegraded":"2023-11-18T19:06:41.587790+0000","last_fullsized":"2023-11-18T19:06:41.587790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:57.618128+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:06:57.618128+0000","last_peered":"2023-11-18T19:06:57.618128+0000","last_clean":"2023-11-18T19:06:57.618128+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:06:57.618128+0000","last_undegraded":"2023-11-18T19:06:57.618128+0000","last_fullsized":"2023-11-18T19:06:57.618128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611068+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:06:42.611068+0000","last_peered":"2023-11-18T19:06:42.611068+0000","last_clean":"2023-11-18T19:06:42.611068+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:06:42.611068+0000","last_undegraded":"2023-11-18T19:06:42.611068+0000","last_fullsized":"2023-11-18T19:06:42.611068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.576702+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:06:41.576702+0000","last_peered":"2023-11-18T19:06:41.576702+0000","last_clean":"2023-11-18T19:06:41.576702+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:06:41.576702+0000","last_undegraded":"2023-11-18T19:06:41.576702+0000","last_fullsized":"2023-11-18T19:06:41.576702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606192+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:06:41.606192+0000","last_peered":"2023-11-18T19:06:41.606192+0000","last_clean":"2023-11-18T19:06:41.606192+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:06:41.606192+0000","last_undegraded":"2023-11-18T19:06:41.606192+0000","last_fullsized":"2023-11-18T19:06:41.606192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.607397+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:06:42.607397+0000","last_peered":"2023-11-18T19:06:42.607397+0000","last_clean":"2023-11-18T19:06:42.607397+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:06:42.607397+0000","last_undegraded":"2023-11-18T19:06:42.607397+0000","last_fullsized":"2023-11-18T19:06:42.607397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.596028+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:06:41.596028+0000","last_peered":"2023-11-18T19:06:41.596028+0000","last_clean":"2023-11-18T19:06:41.596028+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:06:41.596028+0000","last_undegraded":"2023-11-18T19:06:41.596028+0000","last_fullsized":"2023-11-18T19:06:41.596028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587870+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:06:41.587870+0000","last_peered":"2023-11-18T19:06:41.587870+0000","last_clean":"2023-11-18T19:06:41.587870+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:06:41.587870+0000","last_undegraded":"2023-11-18T19:06:41.587870+0000","last_fullsized":"2023-11-18T19:06:41.587870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.559235+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:06:43.559235+0000","last_peered":"2023-11-18T19:06:43.559235+0000","last_clean":"2023-11-18T19:06:43.559235+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:06:43.559235+0000","last_undegraded":"2023-11-18T19:06:43.559235+0000","last_fullsized":"2023-11-18T19:06:43.559235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584320+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:06:41.584320+0000","last_peered":"2023-11-18T19:06:41.584320+0000","last_clean":"2023-11-18T19:06:41.584320+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:06:41.584320+0000","last_undegraded":"2023-11-18T19:06:41.584320+0000","last_fullsized":"2023-11-18T19:06:41.584320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592273+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:06:41.592273+0000","last_peered":"2023-11-18T19:06:41.592273+0000","last_clean":"2023-11-18T19:06:41.592273+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:06:41.592273+0000","last_undegraded":"2023-11-18T19:06:41.592273+0000","last_fullsized":"2023-11-18T19:06:41.592273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:08.678189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.609111+0000","last_change":"2023-11-18T19:06:41.622287+0000","last_active":"2023-11-18T19:06:42.609111+0000","last_peered":"2023-11-18T19:06:42.609111+0000","last_clean":"2023-11-18T19:06:42.609111+0000","last_became_active":"2023-11-18T19:06:41.618340+0000","last_became_peered":"2023-11-18T19:06:41.618340+0000","last_unstale":"2023-11-18T19:06:42.609111+0000","last_undegraded":"2023-11-18T19:06:42.609111+0000","last_fullsized":"2023-11-18T19:06:42.609111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.614055+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:06:42.614055+0000","last_peered":"2023-11-18T19:06:42.614055+0000","last_clean":"2023-11-18T19:06:42.614055+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:06:42.614055+0000","last_undegraded":"2023-11-18T19:06:42.614055+0000","last_fullsized":"2023-11-18T19:06:42.614055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.590846+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:06:41.590846+0000","last_peered":"2023-11-18T19:06:41.590846+0000","last_clean":"2023-11-18T19:06:41.590846+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:06:41.590846+0000","last_undegraded":"2023-11-18T19:06:41.590846+0000","last_fullsized":"2023-11-18T19:06:41.590846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.573178+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:06:41.573178+0000","last_peered":"2023-11-18T19:06:41.573178+0000","last_clean":"2023-11-18T19:06:41.573178+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:06:41.573178+0000","last_undegraded":"2023-11-18T19:06:41.573178+0000","last_fullsized":"2023-11-18T19:06:41.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.718948+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:06:42.718948+0000","last_peered":"2023-11-18T19:06:42.718948+0000","last_clean":"2023-11-18T19:06:42.718948+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:06:42.718948+0000","last_undegraded":"2023-11-18T19:06:42.718948+0000","last_fullsized":"2023-11-18T19:06:42.718948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579857+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:06:41.579857+0000","last_peered":"2023-11-18T19:06:41.579857+0000","last_clean":"2023-11-18T19:06:41.579857+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:06:41.579857+0000","last_undegraded":"2023-11-18T19:06:41.579857+0000","last_fullsized":"2023-11-18T19:06:41.579857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582912+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:06:41.582912+0000","last_peered":"2023-11-18T19:06:41.582912+0000","last_clean":"2023-11-18T19:06:41.582912+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:06:41.582912+0000","last_undegraded":"2023-11-18T19:06:41.582912+0000","last_fullsized":"2023-11-18T19:06:41.582912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572727+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:06:41.572727+0000","last_peered":"2023-11-18T19:06:41.572727+0000","last_clean":"2023-11-18T19:06:41.572727+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:06:41.572727+0000","last_undegraded":"2023-11-18T19:06:41.572727+0000","last_fullsized":"2023-11-18T19:06:41.572727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591508+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:06:41.591508+0000","last_peered":"2023-11-18T19:06:41.591508+0000","last_clean":"2023-11-18T19:06:41.591508+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:06:41.591508+0000","last_undegraded":"2023-11-18T19:06:41.591508+0000","last_fullsized":"2023-11-18T19:06:41.591508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:42.611823+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:06:42.611823+0000","last_peered":"2023-11-18T19:06:42.611823+0000","last_clean":"2023-11-18T19:06:42.611823+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:06:42.611823+0000","last_undegraded":"2023-11-18T19:06:42.611823+0000","last_fullsized":"2023-11-18T19:06:42.611823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584083+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:06:41.584083+0000","last_peered":"2023-11-18T19:06:41.584083+0000","last_clean":"2023-11-18T19:06:41.584083+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:06:41.584083+0000","last_undegraded":"2023-11-18T19:06:41.584083+0000","last_fullsized":"2023-11-18T19:06:41.584083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589767+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:06:41.589767+0000","last_peered":"2023-11-18T19:06:41.589767+0000","last_clean":"2023-11-18T19:06:41.589767+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:06:41.589767+0000","last_undegraded":"2023-11-18T19:06:41.589767+0000","last_fullsized":"2023-11-18T19:06:41.589767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-18T19:06:43.561860+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:06:43.561860+0000","last_peered":"2023-11-18T19:06:43.561860+0000","last_clean":"2023-11-18T19:06:43.561860+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:06:43.561860+0000","last_undegraded":"2023-11-18T19:06:43.561860+0000","last_fullsized":"2023-11-18T19:06:43.561860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.582668+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:06:41.582668+0000","last_peered":"2023-11-18T19:06:41.582668+0000","last_clean":"2023-11-18T19:06:41.582668+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:06:41.582668+0000","last_undegraded":"2023-11-18T19:06:41.582668+0000","last_fullsized":"2023-11-18T19:06:41.582668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.604540+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:06:41.604540+0000","last_peered":"2023-11-18T19:06:41.604540+0000","last_clean":"2023-11-18T19:06:41.604540+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:06:41.604540+0000","last_undegraded":"2023-11-18T19:06:41.604540+0000","last_fullsized":"2023-11-18T19:06:41.604540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.571628+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:06:41.571628+0000","last_peered":"2023-11-18T19:06:41.571628+0000","last_clean":"2023-11-18T19:06:41.571628+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:06:41.571628+0000","last_undegraded":"2023-11-18T19:06:41.571628+0000","last_fullsized":"2023-11-18T19:06:41.571628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.583899+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:06:41.583899+0000","last_peered":"2023-11-18T19:06:41.583899+0000","last_clean":"2023-11-18T19:06:41.583899+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:06:41.583899+0000","last_undegraded":"2023-11-18T19:06:41.583899+0000","last_fullsized":"2023-11-18T19:06:41.583899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584150+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:06:41.584150+0000","last_peered":"2023-11-18T19:06:41.584150+0000","last_clean":"2023-11-18T19:06:41.584150+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:06:41.584150+0000","last_undegraded":"2023-11-18T19:06:41.584150+0000","last_fullsized":"2023-11-18T19:06:41.584150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580014+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:06:41.580014+0000","last_peered":"2023-11-18T19:06:41.580014+0000","last_clean":"2023-11-18T19:06:41.580014+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:06:41.580014+0000","last_undegraded":"2023-11-18T19:06:41.580014+0000","last_fullsized":"2023-11-18T19:06:41.580014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584222+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:06:41.584222+0000","last_peered":"2023-11-18T19:06:41.584222+0000","last_clean":"2023-11-18T19:06:41.584222+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:06:41.584222+0000","last_undegraded":"2023-11-18T19:06:41.584222+0000","last_fullsized":"2023-11-18T19:06:41.584222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.595920+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:06:41.595920+0000","last_peered":"2023-11-18T19:06:41.595920+0000","last_clean":"2023-11-18T19:06:41.595920+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:06:41.595920+0000","last_undegraded":"2023-11-18T19:06:41.595920+0000","last_fullsized":"2023-11-18T19:06:41.595920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572929+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:06:41.572929+0000","last_peered":"2023-11-18T19:06:41.572929+0000","last_clean":"2023-11-18T19:06:41.572929+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:06:41.572929+0000","last_undegraded":"2023-11-18T19:06:41.572929+0000","last_fullsized":"2023-11-18T19:06:41.572929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580481+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:06:41.580481+0000","last_peered":"2023-11-18T19:06:41.580481+0000","last_clean":"2023-11-18T19:06:41.580481+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:06:41.580481+0000","last_undegraded":"2023-11-18T19:06:41.580481+0000","last_fullsized":"2023-11-18T19:06:41.580481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.589699+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:06:41.589699+0000","last_peered":"2023-11-18T19:06:41.589699+0000","last_clean":"2023-11-18T19:06:41.589699+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:06:41.589699+0000","last_undegraded":"2023-11-18T19:06:41.589699+0000","last_fullsized":"2023-11-18T19:06:41.589699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591289+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:06:41.591289+0000","last_peered":"2023-11-18T19:06:41.591289+0000","last_clean":"2023-11-18T19:06:41.591289+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:06:41.591289+0000","last_undegraded":"2023-11-18T19:06:41.591289+0000","last_fullsized":"2023-11-18T19:06:41.591289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588400+0000","last_change":"2023-11-18T19:06:37.568642+0000","last_active":"2023-11-18T19:06:41.588400+0000","last_peered":"2023-11-18T19:06:41.588400+0000","last_clean":"2023-11-18T19:06:41.588400+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:06:41.588400+0000","last_undegraded":"2023-11-18T19:06:41.588400+0000","last_fullsized":"2023-11-18T19:06:41.588400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.574387+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:06:41.574387+0000","last_peered":"2023-11-18T19:06:41.574387+0000","last_clean":"2023-11-18T19:06:41.574387+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:06:41.574387+0000","last_undegraded":"2023-11-18T19:06:41.574387+0000","last_fullsized":"2023-11-18T19:06:41.574387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.606645+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:06:41.606645+0000","last_peered":"2023-11-18T19:06:41.606645+0000","last_clean":"2023-11-18T19:06:41.606645+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:06:41.606645+0000","last_undegraded":"2023-11-18T19:06:41.606645+0000","last_fullsized":"2023-11-18T19:06:41.606645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.575789+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:06:41.575789+0000","last_peered":"2023-11-18T19:06:41.575789+0000","last_clean":"2023-11-18T19:06:41.575789+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:06:41.575789+0000","last_undegraded":"2023-11-18T19:06:41.575789+0000","last_fullsized":"2023-11-18T19:06:41.575789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.572996+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:06:41.572996+0000","last_peered":"2023-11-18T19:06:41.572996+0000","last_clean":"2023-11-18T19:06:41.572996+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:06:41.572996+0000","last_undegraded":"2023-11-18T19:06:41.572996+0000","last_fullsized":"2023-11-18T19:06:41.572996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580120+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:06:41.580120+0000","last_peered":"2023-11-18T19:06:41.580120+0000","last_clean":"2023-11-18T19:06:41.580120+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:06:41.580120+0000","last_undegraded":"2023-11-18T19:06:41.580120+0000","last_fullsized":"2023-11-18T19:06:41.580120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579307+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:06:41.579307+0000","last_peered":"2023-11-18T19:06:41.579307+0000","last_clean":"2023-11-18T19:06:41.579307+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:06:41.579307+0000","last_undegraded":"2023-11-18T19:06:41.579307+0000","last_fullsized":"2023-11-18T19:06:41.579307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580691+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:06:41.580691+0000","last_peered":"2023-11-18T19:06:41.580691+0000","last_clean":"2023-11-18T19:06:41.580691+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:06:41.580691+0000","last_undegraded":"2023-11-18T19:06:41.580691+0000","last_fullsized":"2023-11-18T19:06:41.580691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588307+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:06:41.588307+0000","last_peered":"2023-11-18T19:06:41.588307+0000","last_clean":"2023-11-18T19:06:41.588307+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:06:41.588307+0000","last_undegraded":"2023-11-18T19:06:41.588307+0000","last_fullsized":"2023-11-18T19:06:41.588307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587696+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:06:41.587696+0000","last_peered":"2023-11-18T19:06:41.587696+0000","last_clean":"2023-11-18T19:06:41.587696+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:06:41.587696+0000","last_undegraded":"2023-11-18T19:06:41.587696+0000","last_fullsized":"2023-11-18T19:06:41.587696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.587712+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:06:41.587712+0000","last_peered":"2023-11-18T19:06:41.587712+0000","last_clean":"2023-11-18T19:06:41.587712+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:06:41.587712+0000","last_undegraded":"2023-11-18T19:06:41.587712+0000","last_fullsized":"2023-11-18T19:06:41.587712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.592211+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:06:41.592211+0000","last_peered":"2023-11-18T19:06:41.592211+0000","last_clean":"2023-11-18T19:06:41.592211+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:06:41.592211+0000","last_undegraded":"2023-11-18T19:06:41.592211+0000","last_fullsized":"2023-11-18T19:06:41.592211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.579563+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:06:41.579563+0000","last_peered":"2023-11-18T19:06:41.579563+0000","last_clean":"2023-11-18T19:06:41.579563+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:06:41.579563+0000","last_undegraded":"2023-11-18T19:06:41.579563+0000","last_fullsized":"2023-11-18T19:06:41.579563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.581411+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:06:41.581411+0000","last_peered":"2023-11-18T19:06:41.581411+0000","last_clean":"2023-11-18T19:06:41.581411+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:06:41.581411+0000","last_undegraded":"2023-11-18T19:06:41.581411+0000","last_fullsized":"2023-11-18T19:06:41.581411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584038+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:06:41.584038+0000","last_peered":"2023-11-18T19:06:41.584038+0000","last_clean":"2023-11-18T19:06:41.584038+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:06:41.584038+0000","last_undegraded":"2023-11-18T19:06:41.584038+0000","last_fullsized":"2023-11-18T19:06:41.584038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.580068+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:06:41.580068+0000","last_peered":"2023-11-18T19:06:41.580068+0000","last_clean":"2023-11-18T19:06:41.580068+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:06:41.580068+0000","last_undegraded":"2023-11-18T19:06:41.580068+0000","last_fullsized":"2023-11-18T19:06:41.580068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.584628+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:06:41.584628+0000","last_peered":"2023-11-18T19:06:41.584628+0000","last_clean":"2023-11-18T19:06:41.584628+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:06:41.584628+0000","last_undegraded":"2023-11-18T19:06:41.584628+0000","last_fullsized":"2023-11-18T19:06:41.584628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.591038+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:06:41.591038+0000","last_peered":"2023-11-18T19:06:41.591038+0000","last_clean":"2023-11-18T19:06:41.591038+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:06:41.591038+0000","last_undegraded":"2023-11-18T19:06:41.591038+0000","last_fullsized":"2023-11-18T19:06:41.591038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.594622+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:06:41.594622+0000","last_peered":"2023-11-18T19:06:41.594622+0000","last_clean":"2023-11-18T19:06:41.594622+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:06:41.594622+0000","last_undegraded":"2023-11-18T19:06:41.594622+0000","last_fullsized":"2023-11-18T19:06:41.594622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-18T19:06:41.588068+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:06:41.588068+0000","last_peered":"2023-11-18T19:06:41.588068+0000","last_clean":"2023-11-18T19:06:41.588068+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:06:41.588068+0000","last_undegraded":"2023-11-18T19:06:41.588068+0000","last_fullsized":"2023-11-18T19:06:41.588068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":110093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":700553,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":286720,"data_stored":110675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":113934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0209999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5579999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.597}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":352256,"data_stored":700531,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:07:08.811 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-18T19:07:08.811 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-18T19:07:08.811 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-18T19:07:08.811 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-18T19:07:09.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.077+0000 7f769ffff640 1 Processor -- start 2023-11-18T19:07:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.077+0000 7f769ffff640 1 -- start start 2023-11-18T19:07:09.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769ffff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f76a00c2fb0 0x7f76a00c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a00722c0 0x7f76a00a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76a0155890 0x7f76a0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769ffff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a0156780 con 0x7f76a0155890 2023-11-18T19:07:09.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769ffff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a006b9a0 con 0x7f76a00c2fb0 2023-11-18T19:07:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769ffff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a006bc80 con 0x7f76a00722c0 2023-11-18T19:07:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76a0155890 0x7f76a0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76a0155890 0x7f76a0155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38262/0 (socket says 172.21.15.45:38262) 2023-11-18T19:07:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769f7fe640 1 -- 172.21.15.45:0/1592488916 learned_addr learned my addr 172.21.15.45:0/1592488916 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769e7fc640 1 --2- 172.21.15.45:0/1592488916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a00722c0 0x7f76a00a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.079+0000 7f769effd640 1 --2- 172.21.15.45:0/1592488916 >> v2:172.21.15.135:3300/0 conn(0x7f76a00c2fb0 0x7f76a00c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.080+0000 7f769f7fe640 1 -- 172.21.15.45:0/1592488916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a00722c0 msgr2=0x7f76a00a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.080+0000 7f769f7fe640 1 --2- 172.21.15.45:0/1592488916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a00722c0 0x7f76a00a4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.080+0000 7f769f7fe640 1 -- 172.21.15.45:0/1592488916 >> v2:172.21.15.135:3300/0 conn(0x7f76a00c2fb0 msgr2=0x7f76a00c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.080+0000 7f769f7fe640 1 --2- 172.21.15.45:0/1592488916 >> v2:172.21.15.135:3300/0 conn(0x7f76a00c2fb0 0x7f76a00c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.080+0000 7f769f7fe640 1 -- 172.21.15.45:0/1592488916 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a006e070 con 0x7f76a0155890 2023-11-18T19:07:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.081+0000 7f769f7fe640 1 --2- 172.21.15.45:0/1592488916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a0155890 0x7f76a0155d20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76a006b4e0 tx=0x7f769802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef91a6fac89b845 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.081+0000 7f769dffb640 1 -- 172.21.15.45:0/1592488916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769802c960 con 0x7f76a0155890 2023-11-18T19:07:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.081+0000 7f769dffb640 1 -- 172.21.15.45:0/1592488916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769802cac0 con 0x7f76a0155890 2023-11-18T19:07:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.081+0000 7f769dffb640 1 -- 172.21.15.45:0/1592488916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769802ce50 con 0x7f76a0155890 2023-11-18T19:07:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 -- 172.21.15.45:0/1592488916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a0155890 msgr2=0x7f76a0155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 --2- 172.21.15.45:0/1592488916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a0155890 0x7f76a0155d20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76a006b4e0 tx=0x7f769802bdc0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 -- 172.21.15.45:0/1592488916 shutdown_connections 2023-11-18T19:07:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 --2- 172.21.15.45:0/1592488916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a0155890 0x7f76a0155d20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 --2- 172.21.15.45:0/1592488916 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a00722c0 0x7f76a00a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 --2- 172.21.15.45:0/1592488916 >> v2:172.21.15.135:3300/0 conn(0x7f76a00c2fb0 0x7f76a00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 -- 172.21.15.45:0/1592488916 >> 172.21.15.45:0/1592488916 conn(0x7f76a00c5af0 msgr2=0x7f76a00c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 -- 172.21.15.45:0/1592488916 shutdown_connections 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.082+0000 7f769ffff640 1 -- 172.21.15.45:0/1592488916 wait complete. 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.084+0000 7f769ffff640 1 Processor -- start 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.084+0000 7f769ffff640 1 -- start start 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a00722c0 0x7f76a0148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a00c2fb0 0x7f76a01517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a0155890 0x7f76a0151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01e8c20 con 0x7f76a00c2fb0 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769ffff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01e64b0 con 0x7f76a00722c0 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769ffff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a014df00 con 0x7f76a0155890 2023-11-18T19:07:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a00c2fb0 0x7f76a01517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a00c2fb0 0x7f76a01517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38272/0 (socket says 172.21.15.45:38272) 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 -- 172.21.15.45:0/3529024343 learned_addr learned my addr 172.21.15.45:0/3529024343 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769effd640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a00722c0 0x7f76a0148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 -- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a0155890 msgr2=0x7f76a0151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769f7fe640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a0155890 0x7f76a0151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a0155890 0x7f76a0151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 -- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a00722c0 msgr2=0x7f76a0148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a00722c0 0x7f76a0148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769e7fc640 1 -- 172.21.15.45:0/3529024343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698009b30 con 0x7f76a00c2fb0 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.085+0000 7f769effd640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a00722c0 0x7f76a0148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.086+0000 7f769e7fc640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a00c2fb0 0x7f76a01517a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f769400e870 tx=0x7f769400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.086+0000 7f76877fe640 1 -- 172.21.15.45:0/3529024343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940094f0 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.086+0000 7f76877fe640 1 -- 172.21.15.45:0/3529024343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769400c940 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.086+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a014e1e0 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.086+0000 7f76877fe640 1 -- 172.21.15.45:0/3529024343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400ccf0 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.086+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a0149c50 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.087+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a0067fc0 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.088+0000 7f76877fe640 1 -- 172.21.15.45:0/3529024343 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7694013470 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.089+0000 7f76877fe640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae40 0x7f768c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.089+0000 7f76877fe640 1 -- 172.21.15.45:0/3529024343 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7694089a30 con 0x7f76a00c2fb0 2023-11-18T19:07:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.089+0000 7f769effd640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae40 0x7f768c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.090+0000 7f769effd640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae40 0x7f768c06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7690006fd0 tx=0x7f7690008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.094+0000 7f76877fe640 1 -- 172.21.15.45:0/3529024343 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76940547e0 con 0x7f76a00c2fb0 2023-11-18T19:07:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.321+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f76a01e8d60 con 0x7f76a00c2fb0 2023-11-18T19:07:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.322+0000 7f76877fe640 1 -- 172.21.15.45:0/3529024343 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7694017040 con 0x7f76a00c2fb0 2023-11-18T19:07:09.323 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:09.323 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae40 msgr2=0x7f768c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae40 0x7f768c06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7690006fd0 tx=0x7f7690008040 comp rx=0 tx=0).stop 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a00c2fb0 msgr2=0x7f76a01517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a00c2fb0 0x7f76a01517a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f769400e870 tx=0x7f769400ed30 comp rx=0 tx=0).stop 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 shutdown_connections 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f768c06ae40 0x7f768c06d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76a0155890 0x7f76a0151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76a00c2fb0 0x7f76a01517a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 --2- 172.21.15.45:0/3529024343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76a00722c0 0x7f76a0148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 >> 172.21.15.45:0/3529024343 conn(0x7f76a00c5af0 msgr2=0x7f76a00c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 shutdown_connections 2023-11-18T19:07:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.324+0000 7f769ffff640 1 -- 172.21.15.45:0/3529024343 wait complete. 2023-11-18T19:07:09.344 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-18T19:07:09.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:07:09.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.568+0000 7f451a187640 1 Processor -- start 2023-11-18T19:07:09.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.569+0000 7f451a187640 1 -- start start 2023-11-18T19:07:09.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.571+0000 7f451a187640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4514151a10 0x7f45140ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.571+0000 7f451a187640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4514158ad0 con 0x7f45140c8220 2023-11-18T19:07:09.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.571+0000 7f451a187640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45140c4f80 con 0x7f45140c7d10 2023-11-18T19:07:09.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.571+0000 7f451a187640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c5ae0 con 0x7f4514151a10 2023-11-18T19:07:09.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.571+0000 7f4518984640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f45140c8220 0x7f4514154750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47030/0 (socket says 172.21.15.45:47030) 2023-11-18T19:07:09.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.571+0000 7f4518984640 1 -- 172.21.15.45:0/3334582197 learned_addr learned my addr 172.21.15.45:0/3334582197 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:09.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.571+0000 7f4519185640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4514151a10 0x7f45140ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631671792 0 0) 0x7f4504001110 con 0x7f45140c8220 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4500003520 con 0x7f45140c8220 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280439580 0 0) 0x7f4500003520 con 0x7f45140c8220 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4514151a10 msgr2=0x7f45140ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4514151a10 0x7f45140ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 >> v1:172.21.15.135:6789/0 conn(0x7f45140c7d10 legacy=0x7f4514154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451406caa0 con 0x7f45140c8220 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f4504001800 con 0x7f45140c8220 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 >> v1:172.21.15.45:6789/0 conn(0x7f45140c8220 legacy=0x7f4514154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45000039a0 0x7f4500003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4514151a10 0x7f45000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4500004d00 0x7f4500005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c5ae0 con 0x7f4500004d00 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450000bb40 con 0x7f45000039a0 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.572+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450000bd00 con 0x7f4514151a10 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519986640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4500004d00 0x7f4500005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519185640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45000039a0 0x7f4500003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519986640 1 -- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4514151a10 msgr2=0x7f45000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519986640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4514151a10 0x7f45000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519986640 1 -- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45000039a0 msgr2=0x7f4500003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519986640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45000039a0 0x7f4500003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519986640 1 -- 172.21.15.45:0/3334582197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500003520 con 0x7f4500004d00 2023-11-18T19:07:09.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.573+0000 7f4519185640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45000039a0 0x7f4500003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:09.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.575+0000 7f4519986640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4500004d00 0x7f4500005180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f450c001e50 tx=0x7f45000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86158cdcc951e251 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.575+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c003b70 con 0x7f4500004d00 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.575+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c003cd0 con 0x7f4500004d00 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.575+0000 7f450bfff640 1 -- 172.21.15.45:0/3334582197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c005310 con 0x7f4500004d00 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.576+0000 7f451a187640 1 -- 172.21.15.45:0/3334582197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4500004d00 msgr2=0x7f4500005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.576+0000 7f451a187640 1 --2- 172.21.15.45:0/3334582197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4500004d00 0x7f4500005180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f450c001e50 tx=0x7f45000057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.576+0000 7f4519986640 1 -- 172.21.15.45:0/3334582197 reap_dead start 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.576+0000 7f451a187640 1 -- 172.21.15.45:0/3334582197 shutdown_connections 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.576+0000 7f451a187640 1 -- 172.21.15.45:0/3334582197 >> 172.21.15.45:0/3334582197 conn(0x7f45140663d0 msgr2=0x7f45140667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.576+0000 7f451a187640 1 -- 172.21.15.45:0/3334582197 shutdown_connections 2023-11-18T19:07:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.576+0000 7f451a187640 1 -- 172.21.15.45:0/3334582197 wait complete. 2023-11-18T19:07:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.578+0000 7f451a187640 1 Processor -- start 2023-11-18T19:07:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.578+0000 7f451a187640 1 -- start start 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f451a187640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4500004d00 0x7f45140aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f451a187640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45141404a0 0x7f45141e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f451a187640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45141e7160 0x7f4514155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f451a187640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45141572a0 con 0x7f45141404a0 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f451a187640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514156c70 con 0x7f4500004d00 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f451a187640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45141ea5d0 con 0x7f45141e7160 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f4518984640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45141404a0 0x7f45141e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f4518984640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45141404a0 0x7f45141e6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38302/0 (socket says 172.21.15.45:38302) 2023-11-18T19:07:09.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.579+0000 7f4518984640 1 -- 172.21.15.45:0/130501530 learned_addr learned my addr 172.21.15.45:0/130501530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:09.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4519185640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4500004d00 0x7f45140aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4519986640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45141e7160 0x7f4514155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4518984640 1 -- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45141e7160 msgr2=0x7f4514155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4518984640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45141e7160 0x7f4514155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4518984640 1 -- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4500004d00 msgr2=0x7f45140aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4518984640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4500004d00 0x7f45140aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4518984640 1 -- 172.21.15.45:0/130501530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45141ea8b0 con 0x7f45141404a0 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.580+0000 7f4518984640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45141404a0 0x7f45141e6c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4504000ff0 tx=0x7f450400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:09.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.581+0000 7f4509ffb640 1 -- 172.21.15.45:0/130501530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040072d0 con 0x7f45141404a0 2023-11-18T19:07:09.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.581+0000 7f4509ffb640 1 -- 172.21.15.45:0/130501530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504007430 con 0x7f45141404a0 2023-11-18T19:07:09.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.581+0000 7f4509ffb640 1 -- 172.21.15.45:0/130501530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040047e0 con 0x7f45141404a0 2023-11-18T19:07:09.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.581+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514156ec0 con 0x7f45141404a0 2023-11-18T19:07:09.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.581+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45140c3620 con 0x7f45141404a0 2023-11-18T19:07:09.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.582+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45140c8690 con 0x7f45141404a0 2023-11-18T19:07:09.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.583+0000 7f4509ffb640 1 -- 172.21.15.45:0/130501530 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4504004b50 con 0x7f45141404a0 2023-11-18T19:07:09.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.584+0000 7f4509ffb640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f44f806ae40 0x7f44f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:09.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.584+0000 7f4509ffb640 1 -- 172.21.15.45:0/130501530 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4504088d00 con 0x7f45141404a0 2023-11-18T19:07:09.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.585+0000 7f4519185640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f44f806ae40 0x7f44f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:09.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.585+0000 7f4519185640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f44f806ae40 0x7f44f806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4510009bf0 tx=0x7f4510008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.589+0000 7f4509ffb640 1 -- 172.21.15.45:0/130501530 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4504053b50 con 0x7f45141404a0 2023-11-18T19:07:09.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.786+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4514158ad0 con 0x7f45141404a0 2023-11-18T19:07:09.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.788+0000 7f4509ffb640 1 -- 172.21.15.45:0/130501530 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f4514158ad0 con 0x7f45141404a0 2023-11-18T19:07:09.790 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:09.790 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f44f806ae40 msgr2=0x7f44f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f44f806ae40 0x7f44f806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4510009bf0 tx=0x7f4510008040 comp rx=0 tx=0).stop 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45141404a0 msgr2=0x7f45141e6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45141404a0 0x7f45141e6c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4504000ff0 tx=0x7f450400cb90 comp rx=0 tx=0).stop 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 shutdown_connections 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f44f806ae40 0x7f44f806d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45141e7160 0x7f4514155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45141404a0 0x7f45141e6c20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 --2- 172.21.15.45:0/130501530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4500004d00 0x7f45140aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.791+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 >> 172.21.15.45:0/130501530 conn(0x7f45140663d0 msgr2=0x7f45140ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.792+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 shutdown_connections 2023-11-18T19:07:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:09.792+0000 7f451a187640 1 -- 172.21.15.45:0/130501530 wait complete. 2023-11-18T19:07:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T19:06:35.454808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T19:06:36.526298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T19:06:39.617712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T19:07:09.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:07:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.044+0000 7f6e9a62e640 1 Processor -- start 2023-11-18T19:07:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.044+0000 7f6e9a62e640 1 -- start start 2023-11-18T19:07:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.045+0000 7f6e9a62e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e94152280 0x7f6e9406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.045+0000 7f6e9a62e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e940c3fa0 con 0x7f6e940c39c0 2023-11-18T19:07:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.045+0000 7f6e9a62e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e940c4280 con 0x7f6e9406a500 2023-11-18T19:07:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.045+0000 7f6e9a62e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940c4560 con 0x7f6e94152280 2023-11-18T19:07:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.046+0000 7f6e98e2b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6e940c39c0 0x7f6e9406dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47044/0 (socket says 172.21.15.45:47044) 2023-11-18T19:07:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.046+0000 7f6e98e2b640 1 -- 172.21.15.45:0/3560340905 learned_addr learned my addr 172.21.15.45:0/3560340905 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:10.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.046+0000 7f6e99e2d640 1 --2- 172.21.15.45:0/3560340905 >> v2:172.21.15.135:3300/0 conn(0x7f6e94152280 0x7f6e9406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.046+0000 7f6e93fff640 1 -- 172.21.15.45:0/3560340905 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173211711 0 0) 0x7f6e940c3fa0 con 0x7f6e940c39c0 2023-11-18T19:07:10.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.047+0000 7f6e93fff640 1 -- 172.21.15.45:0/3560340905 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e7c003520 con 0x7f6e940c39c0 2023-11-18T19:07:10.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.047+0000 7f6e99e2d640 1 -- 172.21.15.45:0/3560340905 >> v1:172.21.15.135:6789/0 conn(0x7f6e9406a500 legacy=0x7f6e9406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.047+0000 7f6e99e2d640 1 -- 172.21.15.45:0/3560340905 >> v1:172.21.15.45:6789/0 conn(0x7f6e940c39c0 legacy=0x7f6e9406dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.047+0000 7f6e99e2d640 1 -- 172.21.15.45:0/3560340905 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940c4840 con 0x7f6e94152280 2023-11-18T19:07:10.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.048+0000 7f6e99e2d640 1 --2- 172.21.15.45:0/3560340905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e9406a8e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0097a0 tx=0x7f6e8c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9088285b7404dcbf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.049+0000 7f6e93fff640 1 -- 172.21.15.45:0/3560340905 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c031830 con 0x7f6e94152280 2023-11-18T19:07:10.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.049+0000 7f6e93fff640 1 -- 172.21.15.45:0/3560340905 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c031990 con 0x7f6e94152280 2023-11-18T19:07:10.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.049+0000 7f6e93fff640 1 -- 172.21.15.45:0/3560340905 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c031d20 con 0x7f6e94152280 2023-11-18T19:07:10.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.049+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3560340905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 msgr2=0x7f6e9406a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.049+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3560340905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e9406a8e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0097a0 tx=0x7f6e8c02b8d0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.050+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3560340905 shutdown_connections 2023-11-18T19:07:10.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.050+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3560340905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e9406a8e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.050+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3560340905 >> 172.21.15.45:0/3560340905 conn(0x7f6e940a7870 msgr2=0x7f6e940a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:10.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.050+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3560340905 shutdown_connections 2023-11-18T19:07:10.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.050+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3560340905 wait complete. 2023-11-18T19:07:10.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.051+0000 7f6e9a62e640 1 Processor -- start 2023-11-18T19:07:10.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.052+0000 7f6e9a62e640 1 -- start start 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.052+0000 7f6e9a62e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9406a500 0x7f6e940aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.052+0000 7f6e9a62e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e940c39c0 0x7f6e940bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.052+0000 7f6e9a62e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e940a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.052+0000 7f6e9a62e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94155dd0 con 0x7f6e9406a500 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.052+0000 7f6e9a62e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e941ea650 con 0x7f6e94152280 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.052+0000 7f6e9a62e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940c33c0 con 0x7f6e940c39c0 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9406a500 0x7f6e940aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9406a500 0x7f6e940aa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38304/0 (socket says 172.21.15.45:38304) 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 -- 172.21.15.45:0/3488071584 learned_addr learned my addr 172.21.15.45:0/3488071584 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e99e2d640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e940a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 -- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e940c39c0 msgr2=0x7f6e940bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e98e2b640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e940c39c0 0x7f6e940bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e940c39c0 0x7f6e940bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 -- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 msgr2=0x7f6e940a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e940a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e9962c640 1 -- 172.21.15.45:0/3488071584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c009400 con 0x7f6e9406a500 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.053+0000 7f6e99e2d640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e940a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.054+0000 7f6e9962c640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9406a500 0x7f6e940aa8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c730 tx=0x7f6e8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.054+0000 7f6e91ffb640 1 -- 172.21.15.45:0/3488071584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84003b70 con 0x7f6e9406a500 2023-11-18T19:07:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.054+0000 7f6e91ffb640 1 -- 172.21.15.45:0/3488071584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84003cf0 con 0x7f6e9406a500 2023-11-18T19:07:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.054+0000 7f6e91ffb640 1 -- 172.21.15.45:0/3488071584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84003ea0 con 0x7f6e9406a500 2023-11-18T19:07:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.054+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e94155710 con 0x7f6e9406a500 2023-11-18T19:07:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.054+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e940bf6a0 con 0x7f6e9406a500 2023-11-18T19:07:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.055+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e94155f10 con 0x7f6e9406a500 2023-11-18T19:07:10.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.056+0000 7f6e91ffb640 1 -- 172.21.15.45:0/3488071584 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e8400aa90 con 0x7f6e9406a500 2023-11-18T19:07:10.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.057+0000 7f6e91ffb640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6e8006ae40 0x7f6e8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.057+0000 7f6e91ffb640 1 -- 172.21.15.45:0/3488071584 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e84089740 con 0x7f6e9406a500 2023-11-18T19:07:10.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.057+0000 7f6e98e2b640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6e8006ae40 0x7f6e8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.058+0000 7f6e98e2b640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6e8006ae40 0x7f6e8006d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e9406b250 tx=0x7f6e88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.061+0000 7f6e91ffb640 1 -- 172.21.15.45:0/3488071584 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e94155f10 con 0x7f6e9406a500 2023-11-18T19:07:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.253+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e94155f10 con 0x7f6e9406a500 2023-11-18T19:07:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.253+0000 7f6e91ffb640 1 -- 172.21.15.45:0/3488071584 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e94155f10 con 0x7f6e9406a500 2023-11-18T19:07:10.255 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:07:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6e8006ae40 msgr2=0x7f6e8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6e8006ae40 0x7f6e8006d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e9406b250 tx=0x7f6e88009040 comp rx=0 tx=0).stop 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9406a500 msgr2=0x7f6e940aa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9406a500 0x7f6e940aa8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c730 tx=0x7f6e8400cbf0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 shutdown_connections 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e94152280 0x7f6e940a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6e8006ae40 0x7f6e8006d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e940c39c0 0x7f6e940bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 --2- 172.21.15.45:0/3488071584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e9406a500 0x7f6e940aa8f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 >> 172.21.15.45:0/3488071584 conn(0x7f6e940a7870 msgr2=0x7f6e941528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 shutdown_connections 2023-11-18T19:07:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.256+0000 7f6e9a62e640 1 -- 172.21.15.45:0/3488071584 wait complete. 2023-11-18T19:07:10.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T19:07:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.493+0000 7fe6ae2f2640 1 Processor -- start 2023-11-18T19:07:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.493+0000 7fe6ae2f2640 1 -- start start 2023-11-18T19:07:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.494+0000 7fe6ae2f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 0x7fe6a80ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.494+0000 7fe6ae2f2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe6a80c7f40 0x7fe6a8155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.494+0000 7fe6ae2f2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a80c49c0 con 0x7fe6a80c8450 2023-11-18T19:07:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.494+0000 7fe6ae2f2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a806bf90 con 0x7fe6a80c7f40 2023-11-18T19:07:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.494+0000 7fe6ae2f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80c5260 con 0x7fe6a8151d40 2023-11-18T19:07:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.495+0000 7fe69f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe6a80c8450 0x7fe6a8154a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47056/0 (socket says 172.21.15.45:47056) 2023-11-18T19:07:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.495+0000 7fe69f7fe640 1 -- 172.21.15.45:0/4145576170 learned_addr learned my addr 172.21.15.45:0/4145576170 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.495+0000 7fe6a7fff640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 0x7fe6a80ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.495+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759795309 0 0) 0x7fe6a80c49c0 con 0x7fe6a80c8450 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.495+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe694003520 con 0x7fe6a80c8450 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.495+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/4145576170 >> v2:172.21.15.135:3300/0 conn(0x7fe6a80c7f40 0x7fe6a8155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412331813 0 0) 0x7fe694003520 con 0x7fe6a80c8450 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 msgr2=0x7fe6a80ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 0x7fe6a80ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 >> v2:172.21.15.135:3300/0 conn(0x7fe6a80c7f40 msgr2=0x7fe6a8155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/4145576170 >> v2:172.21.15.135:3300/0 conn(0x7fe6a80c7f40 0x7fe6a8155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8158b50 con 0x7fe6a80c8450 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fe690001670 con 0x7fe6a80c8450 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/4145576170 >> v2:172.21.15.135:3300/0 conn(0x7fe6a80c7f40 0x7fe6a8155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 >> v1:172.21.15.45:6789/0 conn(0x7fe6a80c8450 legacy=0x7fe6a8154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 0x7fe694003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe694003f40 0x7fe6940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe694004d00 0x7fe694005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a806bf90 con 0x7fe694004d00 2023-11-18T19:07:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80c5260 con 0x7fe694003f40 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69400bae0 con 0x7fe6a8151d40 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe694004d00 0x7fe694005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.496+0000 7fe6a7fff640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 0x7fe694003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.497+0000 7fe69f7fe640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe694003f40 0x7fe6940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.497+0000 7fe6ac88f640 1 -- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 msgr2=0x7fe694003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.497+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6a8151d40 0x7fe694003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.497+0000 7fe6ac88f640 1 -- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe694003f40 msgr2=0x7fe6940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.497+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe694003f40 0x7fe6940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.497+0000 7fe6ac88f640 1 -- 172.21.15.45:0/4145576170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694003520 con 0x7fe694004d00 2023-11-18T19:07:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.498+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe694004d00 0x7fe694005180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00073b0 tx=0x7fe6940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2cd2de88df2d32 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.498+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a002cd90 con 0x7fe694004d00 2023-11-18T19:07:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.498+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a0034440 con 0x7fe694004d00 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.498+0000 7fe6a77fe640 1 -- 172.21.15.45:0/4145576170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00347b0 con 0x7fe694004d00 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.499+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/4145576170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe694004d00 msgr2=0x7fe694005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.499+0000 7fe6ae2f2640 1 --2- 172.21.15.45:0/4145576170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe694004d00 0x7fe694005180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00073b0 tx=0x7fe6940057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.499+0000 7fe6ac88f640 1 -- 172.21.15.45:0/4145576170 reap_dead start 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.499+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/4145576170 shutdown_connections 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.499+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/4145576170 >> 172.21.15.45:0/4145576170 conn(0x7fe6a80663d0 msgr2=0x7fe6a80667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.499+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/4145576170 shutdown_connections 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.499+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/4145576170 wait complete. 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.501+0000 7fe6ae2f2640 1 Processor -- start 2023-11-18T19:07:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.501+0000 7fe6ae2f2640 1 -- start start 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ae2f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe694004d00 0x7fe6a80c1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ae2f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a81e9ea0 0x7fe6a8156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ae2f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a81535f0 0x7fe6a81483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ae2f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80c3330 con 0x7fe6a81535f0 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ae2f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a81525e0 con 0x7fe6a81e9ea0 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ae2f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8153160 con 0x7fe694004d00 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ac88f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a81535f0 0x7fe6a81483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ac88f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a81535f0 0x7fe6a81483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38318/0 (socket says 172.21.15.45:38318) 2023-11-18T19:07:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6ac88f640 1 -- 172.21.15.45:0/3327822216 learned_addr learned my addr 172.21.15.45:0/3327822216 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe69f7fe640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a81e9ea0 0x7fe6a8156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.502+0000 7fe6a7fff640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe694004d00 0x7fe6a80c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ac88f640 1 -- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe694004d00 msgr2=0x7fe6a80c1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe694004d00 0x7fe6a80c1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ac88f640 1 -- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a81e9ea0 msgr2=0x7fe6a8156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a81e9ea0 0x7fe6a8156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ac88f640 1 -- 172.21.15.45:0/3327822216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a80c4000 con 0x7fe6a81535f0 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ac88f640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a81535f0 0x7fe6a81483d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0002230 tx=0x7fe6a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6a57fa640 1 -- 172.21.15.45:0/3327822216 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a003e440 con 0x7fe6a81535f0 2023-11-18T19:07:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6a57fa640 1 -- 172.21.15.45:0/3327822216 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a003e5c0 con 0x7fe6a81535f0 2023-11-18T19:07:10.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6a57fa640 1 -- 172.21.15.45:0/3327822216 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a003e970 con 0x7fe6a81535f0 2023-11-18T19:07:10.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a8152830 con 0x7fe6a81535f0 2023-11-18T19:07:10.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.503+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a8152df0 con 0x7fe6a81535f0 2023-11-18T19:07:10.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.505+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a80c5db0 con 0x7fe6a81535f0 2023-11-18T19:07:10.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.506+0000 7fe6a57fa640 1 -- 172.21.15.45:0/3327822216 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6a003ead0 con 0x7fe6a81535f0 2023-11-18T19:07:10.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.507+0000 7fe6a57fa640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe68806ae40 0x7fe68806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.507+0000 7fe6a57fa640 1 -- 172.21.15.45:0/3327822216 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6a00abc00 con 0x7fe6a81535f0 2023-11-18T19:07:10.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.507+0000 7fe6a7fff640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe68806ae40 0x7fe68806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.508+0000 7fe6a7fff640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe68806ae40 0x7fe68806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80c9e20 tx=0x7fe698008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.511+0000 7fe6a57fa640 1 -- 172.21.15.45:0/3327822216 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6a00b2080 con 0x7fe6a81535f0 2023-11-18T19:07:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.708+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6a80747c0 con 0x7fe6a81535f0 2023-11-18T19:07:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.709+0000 7fe6a57fa640 1 -- 172.21.15.45:0/3327822216 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6a0042020 con 0x7fe6a81535f0 2023-11-18T19:07:10.710 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:07:10.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe68806ae40 msgr2=0x7fe68806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe68806ae40 0x7fe68806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80c9e20 tx=0x7fe698008040 comp rx=0 tx=0).stop 2023-11-18T19:07:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a81535f0 msgr2=0x7fe6a81483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a81535f0 0x7fe6a81483d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0002230 tx=0x7fe6a0004ab0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 shutdown_connections 2023-11-18T19:07:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a81535f0 0x7fe6a81483d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6a81e9ea0 0x7fe6a8156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe68806ae40 0x7fe68806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 --2- 172.21.15.45:0/3327822216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe694004d00 0x7fe6a80c1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.711+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 >> 172.21.15.45:0/3327822216 conn(0x7fe6a80663d0 msgr2=0x7fe6a80c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.712+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 shutdown_connections 2023-11-18T19:07:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.712+0000 7fe6ae2f2640 1 -- 172.21.15.45:0/3327822216 wait complete. 2023-11-18T19:07:10.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T19:07:10.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.952+0000 7f0ca950a640 1 Processor -- start 2023-11-18T19:07:10.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.953+0000 7f0ca950a640 1 -- start start 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.954+0000 7f0ca950a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ca4155270 0x7f0ca4071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.954+0000 7f0ca950a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca40c54d0 0x7f0ca406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.954+0000 7f0ca950a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca40c04c0 con 0x7f0ca406aa40 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.954+0000 7f0ca950a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca40c09f0 con 0x7f0ca4155270 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.954+0000 7f0ca950a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40c0710 con 0x7f0ca40c54d0 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0ca3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ca4155270 0x7f0ca4071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0ca3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ca4155270 0x7f0ca4071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38332/0 (socket says 172.21.15.45:38332) 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0ca3fff640 1 -- 172.21.15.45:0/1665959869 learned_addr learned my addr 172.21.15.45:0/1665959869 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0c9bfff640 1 --2- 172.21.15.45:0/1665959869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca40c54d0 0x7f0ca406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0ca3fff640 1 -- 172.21.15.45:0/1665959869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca40c54d0 msgr2=0x7f0ca406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:10.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0ca3fff640 1 --2- 172.21.15.45:0/1665959869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca40c54d0 0x7f0ca406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0ca3fff640 1 -- 172.21.15.45:0/1665959869 >> v1:172.21.15.135:6789/0 conn(0x7f0ca406aa40 legacy=0x7f0ca4157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0ca3fff640 1 -- 172.21.15.45:0/1665959869 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40c0e90 con 0x7f0ca4155270 2023-11-18T19:07:10.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.955+0000 7f0c9bfff640 1 --2- 172.21.15.45:0/1665959869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca40c54d0 0x7f0ca406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:10.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.957+0000 7f0ca3fff640 1 --2- 172.21.15.45:0/1665959869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca4155270 0x7f0ca4071f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009870 tx=0x7f0c9402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5e1a5d84b4daac server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.957+0000 7f0ca37fe640 1 -- 172.21.15.45:0/1665959869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940317d0 con 0x7f0ca4155270 2023-11-18T19:07:10.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.957+0000 7f0ca37fe640 1 -- 172.21.15.45:0/1665959869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94031930 con 0x7f0ca4155270 2023-11-18T19:07:10.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.957+0000 7f0ca37fe640 1 -- 172.21.15.45:0/1665959869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94031cc0 con 0x7f0ca4155270 2023-11-18T19:07:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 -- 172.21.15.45:0/1665959869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca4155270 msgr2=0x7f0ca4071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 --2- 172.21.15.45:0/1665959869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca4155270 0x7f0ca4071f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009870 tx=0x7f0c9402b870 comp rx=0 tx=0).stop 2023-11-18T19:07:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 -- 172.21.15.45:0/1665959869 shutdown_connections 2023-11-18T19:07:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 --2- 172.21.15.45:0/1665959869 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca40c54d0 0x7f0ca406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 --2- 172.21.15.45:0/1665959869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca4155270 0x7f0ca4071f40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 -- 172.21.15.45:0/1665959869 >> 172.21.15.45:0/1665959869 conn(0x7f0ca40a7870 msgr2=0x7f0ca40a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 -- 172.21.15.45:0/1665959869 shutdown_connections 2023-11-18T19:07:10.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.958+0000 7f0ca950a640 1 -- 172.21.15.45:0/1665959869 wait complete. 2023-11-18T19:07:10.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.960+0000 7f0ca950a640 1 Processor -- start 2023-11-18T19:07:10.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.960+0000 7f0ca950a640 1 -- start start 2023-11-18T19:07:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0ca950a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca406aa40 0x7f0ca41eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0ca950a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca40c54d0 0x7f0ca40a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0ca950a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca4155270 0x7f0ca414d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0ca950a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca41eb170 con 0x7f0ca40c54d0 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0ca950a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4071e50 con 0x7f0ca406aa40 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0ca950a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40720a0 con 0x7f0ca4155270 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0c9bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca40c54d0 0x7f0ca40a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0c9bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca40c54d0 0x7f0ca40a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38336/0 (socket says 172.21.15.45:38336) 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.961+0000 7f0c9bfff640 1 -- 172.21.15.45:0/99017071 learned_addr learned my addr 172.21.15.45:0/99017071 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0ca3fff640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca406aa40 0x7f0ca41eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0ca8d09640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca4155270 0x7f0ca414d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0c9bfff640 1 -- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca4155270 msgr2=0x7f0ca414d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0c9bfff640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca4155270 0x7f0ca414d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0c9bfff640 1 -- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca406aa40 msgr2=0x7f0ca41eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0c9bfff640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca406aa40 0x7f0ca41eac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0c9bfff640 1 -- 172.21.15.45:0/99017071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940094d0 con 0x7f0ca40c54d0 2023-11-18T19:07:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0ca8d09640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca4155270 0x7f0ca414d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.962+0000 7f0c9bfff640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca40c54d0 0x7f0ca40a69b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00e7e0 tx=0x7f0c8c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.963+0000 7f0ca17fa640 1 -- 172.21.15.45:0/99017071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c004030 con 0x7f0ca40c54d0 2023-11-18T19:07:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.963+0000 7f0ca17fa640 1 -- 172.21.15.45:0/99017071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c004190 con 0x7f0ca40c54d0 2023-11-18T19:07:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.963+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca4072380 con 0x7f0ca40c54d0 2023-11-18T19:07:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.963+0000 7f0ca17fa640 1 -- 172.21.15.45:0/99017071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c004520 con 0x7f0ca40c54d0 2023-11-18T19:07:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.963+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca4155de0 con 0x7f0ca40c54d0 2023-11-18T19:07:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.964+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca40683a0 con 0x7f0ca40c54d0 2023-11-18T19:07:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.965+0000 7f0ca17fa640 1 -- 172.21.15.45:0/99017071 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c8c00c6d0 con 0x7f0ca40c54d0 2023-11-18T19:07:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.966+0000 7f0ca17fa640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c8406ae40 0x7f0c8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.966+0000 7f0ca17fa640 1 -- 172.21.15.45:0/99017071 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c8c089600 con 0x7f0ca40c54d0 2023-11-18T19:07:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.966+0000 7f0ca3fff640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c8406ae40 0x7f0c8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.967+0000 7f0ca3fff640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c8406ae40 0x7f0c8406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c94036000 tx=0x7f0c9403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:10.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:10.970+0000 7f0ca17fa640 1 -- 172.21.15.45:0/99017071 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c8c0543b0 con 0x7f0ca40c54d0 2023-11-18T19:07:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.166+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ca40c3a90 con 0x7f0ca40c54d0 2023-11-18T19:07:11.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.167+0000 7f0ca17fa640 1 -- 172.21.15.45:0/99017071 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c8c0579d0 con 0x7f0ca40c54d0 2023-11-18T19:07:11.169 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c8406ae40 msgr2=0x7f0c8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c8406ae40 0x7f0c8406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c94036000 tx=0x7f0c9403d040 comp rx=0 tx=0).stop 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca40c54d0 msgr2=0x7f0ca40a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca40c54d0 0x7f0ca40a69b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00e7e0 tx=0x7f0c8c00eca0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 shutdown_connections 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c8406ae40 0x7f0c8406d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca4155270 0x7f0ca414d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ca40c54d0 0x7f0ca40a69b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 --2- 172.21.15.45:0/99017071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca406aa40 0x7f0ca41eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.170+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 >> 172.21.15.45:0/99017071 conn(0x7f0ca40a7870 msgr2=0x7f0ca4152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.171+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 shutdown_connections 2023-11-18T19:07:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.171+0000 7f0ca950a640 1 -- 172.21.15.45:0/99017071 wait complete. 2023-11-18T19:07:11.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T19:07:11.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.419+0000 7f48e3f4e640 1 Processor -- start 2023-11-18T19:07:11.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.419+0000 7f48e3f4e640 1 -- start start 2023-11-18T19:07:11.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.420+0000 7f48e3f4e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f48dc0af690 0x7f48dc0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.420+0000 7f48e3f4e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.420+0000 7f48e3f4e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48dc0ca700 0x7f48dc0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.420+0000 7f48e3f4e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0afa70 con 0x7f48dc0ca700 2023-11-18T19:07:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.420+0000 7f48e3f4e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0c5770 con 0x7f48dc0af690 2023-11-18T19:07:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.420+0000 7f48e3f4e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0c4f70 con 0x7f48dc0bd620 2023-11-18T19:07:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.420+0000 7f48e24eb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48dc0ca700 0x7f48dc0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e24eb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48dc0ca700 0x7f48dc0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38344/0 (socket says 172.21.15.45:38344) 2023-11-18T19:07:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e24eb640 1 -- 172.21.15.45:0/3529979399 learned_addr learned my addr 172.21.15.45:0/3529979399 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e14e9640 1 --2- 172.21.15.45:0/3529979399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e1cea640 1 --2- 172.21.15.45:0/3529979399 >> v2:172.21.15.135:3300/0 conn(0x7f48dc0af690 0x7f48dc0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e24eb640 1 -- 172.21.15.45:0/3529979399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 msgr2=0x7f48dc0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e24eb640 1 --2- 172.21.15.45:0/3529979399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e24eb640 1 -- 172.21.15.45:0/3529979399 >> v2:172.21.15.135:3300/0 conn(0x7f48dc0af690 msgr2=0x7f48dc0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e24eb640 1 --2- 172.21.15.45:0/3529979399 >> v2:172.21.15.135:3300/0 conn(0x7f48dc0af690 0x7f48dc0ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.421+0000 7f48e24eb640 1 -- 172.21.15.45:0/3529979399 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc1551e0 con 0x7f48dc0ca700 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.422+0000 7f48e24eb640 1 --2- 172.21.15.45:0/3529979399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0ca700 0x7f48dc0c6d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0ca190 tx=0x7f48d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e015f13f80cef2d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.422+0000 7f48e0ce8640 1 -- 172.21.15.45:0/3529979399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40317e0 con 0x7f48dc0ca700 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e0ce8640 1 -- 172.21.15.45:0/3529979399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4031940 con 0x7f48dc0ca700 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e0ce8640 1 -- 172.21.15.45:0/3529979399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4031cd0 con 0x7f48dc0ca700 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 -- 172.21.15.45:0/3529979399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0ca700 msgr2=0x7f48dc0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/3529979399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0ca700 0x7f48dc0c6d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0ca190 tx=0x7f48d402b880 comp rx=0 tx=0).stop 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 -- 172.21.15.45:0/3529979399 shutdown_connections 2023-11-18T19:07:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/3529979399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0ca700 0x7f48dc0c6d70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/3529979399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/3529979399 >> v2:172.21.15.135:3300/0 conn(0x7f48dc0af690 0x7f48dc0ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 -- 172.21.15.45:0/3529979399 >> 172.21.15.45:0/3529979399 conn(0x7f48dc0663d0 msgr2=0x7f48dc0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 -- 172.21.15.45:0/3529979399 shutdown_connections 2023-11-18T19:07:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.423+0000 7f48e3f4e640 1 -- 172.21.15.45:0/3529979399 wait complete. 2023-11-18T19:07:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.425+0000 7f48e3f4e640 1 Processor -- start 2023-11-18T19:07:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.425+0000 7f48e3f4e640 1 -- start start 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.426+0000 7f48e3f4e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0af690 0x7f48dc0c0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.426+0000 7f48e3f4e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.426+0000 7f48e3f4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48dc0ca700 0x7f48dc0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.426+0000 7f48e3f4e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0bde90 con 0x7f48dc0af690 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.426+0000 7f48e3f4e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0c3890 con 0x7f48dc0ca700 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.426+0000 7f48e3f4e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1eaaf0 con 0x7f48dc0bd620 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0af690 0x7f48dc0c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0af690 0x7f48dc0c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38360/0 (socket says 172.21.15.45:38360) 2023-11-18T19:07:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 -- 172.21.15.45:0/2315808100 learned_addr learned my addr 172.21.15.45:0/2315808100 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e14e9640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e24eb640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48dc0ca700 0x7f48dc0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 -- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 msgr2=0x7f48dc0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 -- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48dc0ca700 msgr2=0x7f48dc0c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48dc0ca700 0x7f48dc0c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e1cea640 1 -- 172.21.15.45:0/2315808100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40094d0 con 0x7f48dc0af690 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.427+0000 7f48e14e9640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.428+0000 7f48e1cea640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0af690 0x7f48dc0c0610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007e60 tx=0x7f48d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.428+0000 7f48d27fc640 1 -- 172.21.15.45:0/2315808100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8014620 con 0x7f48dc0af690 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.428+0000 7f48d27fc640 1 -- 172.21.15.45:0/2315808100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d800ee90 con 0x7f48dc0af690 2023-11-18T19:07:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.428+0000 7f48d27fc640 1 -- 172.21.15.45:0/2315808100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80149c0 con 0x7f48dc0af690 2023-11-18T19:07:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.428+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc1eadd0 con 0x7f48dc0af690 2023-11-18T19:07:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.428+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc0c3de0 con 0x7f48dc0af690 2023-11-18T19:07:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.429+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc0c3fa0 con 0x7f48dc0af690 2023-11-18T19:07:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.430+0000 7f48d27fc640 1 -- 172.21.15.45:0/2315808100 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f48d8014b20 con 0x7f48dc0af690 2023-11-18T19:07:11.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.431+0000 7f48d27fc640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f48c006ae40 0x7f48c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.431+0000 7f48d27fc640 1 -- 172.21.15.45:0/2315808100 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48d808a2b0 con 0x7f48dc0af690 2023-11-18T19:07:11.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.432+0000 7f48e14e9640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f48c006ae40 0x7f48c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.432+0000 7f48e14e9640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f48c006ae40 0x7f48c006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48dc1544a0 tx=0x7f48cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:11.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.436+0000 7f48d27fc640 1 -- 172.21.15.45:0/2315808100 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f48d8055060 con 0x7f48dc0af690 2023-11-18T19:07:11.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.628+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f48dc0747c0 con 0x7f48dc0af690 2023-11-18T19:07:11.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.629+0000 7f48d27fc640 1 -- 172.21.15.45:0/2315808100 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f48d8058680 con 0x7f48dc0af690 2023-11-18T19:07:11.631 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f48c006ae40 msgr2=0x7f48c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f48c006ae40 0x7f48c006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48dc1544a0 tx=0x7f48cc008040 comp rx=0 tx=0).stop 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0af690 msgr2=0x7f48dc0c0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0af690 0x7f48dc0c0610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007e60 tx=0x7f48d800e4b0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 shutdown_connections 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48dc0ca700 0x7f48dc0c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f48c006ae40 0x7f48c006d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48dc0bd620 0x7f48dc0c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 --2- 172.21.15.45:0/2315808100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48dc0af690 0x7f48dc0c0610 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 >> 172.21.15.45:0/2315808100 conn(0x7f48dc0663d0 msgr2=0x7f48dc0ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:11.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 shutdown_connections 2023-11-18T19:07:11.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.632+0000 7f48e3f4e640 1 -- 172.21.15.45:0/2315808100 wait complete. 2023-11-18T19:07:11.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:07:11.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.879+0000 7f4fce999640 1 Processor -- start 2023-11-18T19:07:11.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.879+0000 7f4fce999640 1 -- start start 2023-11-18T19:07:11.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.880+0000 7f4fce999640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fc80a95b0 0x7f4fc80a9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.880+0000 7f4fce999640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80c4530 con 0x7f4fc806fcc0 2023-11-18T19:07:11.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.880+0000 7f4fce999640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80a8c40 con 0x7f4fc8072560 2023-11-18T19:07:11.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.880+0000 7f4fce999640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc80a8f20 con 0x7f4fc80a95b0 2023-11-18T19:07:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.880+0000 7f4fcd997640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fc80a95b0 0x7f4fc80a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.880+0000 7f4fce198640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4fc806fcc0 0x7f4fc815a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47066/0 (socket says 172.21.15.45:47066) 2023-11-18T19:07:11.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.880+0000 7f4fce198640 1 -- 172.21.15.45:0/2099006910 learned_addr learned my addr 172.21.15.45:0/2099006910 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.881+0000 7f4fcd997640 1 -- 172.21.15.45:0/2099006910 >> v1:172.21.15.135:6789/0 conn(0x7f4fc8072560 legacy=0x7f4fc80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.881+0000 7f4fcd997640 1 -- 172.21.15.45:0/2099006910 >> v1:172.21.15.45:6789/0 conn(0x7f4fc806fcc0 legacy=0x7f4fc815a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.881+0000 7f4fcc995640 1 -- 172.21.15.45:0/2099006910 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573918009 0 0) 0x7f4fc80c4530 con 0x7f4fc806fcc0 2023-11-18T19:07:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.881+0000 7f4fcd997640 1 -- 172.21.15.45:0/2099006910 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80a9200 con 0x7f4fc80a95b0 2023-11-18T19:07:11.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.882+0000 7f4fcd997640 1 --2- 172.21.15.45:0/2099006910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80a9990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40097a0 tx=0x7f4fc402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e909108700179d32 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.882+0000 7f4fcc995640 1 -- 172.21.15.45:0/2099006910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4030610 con 0x7f4fc80a95b0 2023-11-18T19:07:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.882+0000 7f4fcc995640 1 -- 172.21.15.45:0/2099006910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4030770 con 0x7f4fc80a95b0 2023-11-18T19:07:11.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.882+0000 7f4fcc995640 1 -- 172.21.15.45:0/2099006910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4030b00 con 0x7f4fc80a95b0 2023-11-18T19:07:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.883+0000 7f4fce999640 1 -- 172.21.15.45:0/2099006910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 msgr2=0x7f4fc80a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.883+0000 7f4fce999640 1 --2- 172.21.15.45:0/2099006910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80a9990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40097a0 tx=0x7f4fc402b960 comp rx=0 tx=0).stop 2023-11-18T19:07:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.883+0000 7f4fce999640 1 -- 172.21.15.45:0/2099006910 shutdown_connections 2023-11-18T19:07:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.883+0000 7f4fce999640 1 --2- 172.21.15.45:0/2099006910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80a9990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.883+0000 7f4fce999640 1 -- 172.21.15.45:0/2099006910 >> 172.21.15.45:0/2099006910 conn(0x7f4fc80c5af0 msgr2=0x7f4fc80c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.883+0000 7f4fce999640 1 -- 172.21.15.45:0/2099006910 shutdown_connections 2023-11-18T19:07:11.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.883+0000 7f4fce999640 1 -- 172.21.15.45:0/2099006910 wait complete. 2023-11-18T19:07:11.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.885+0000 7f4fce999640 1 Processor -- start 2023-11-18T19:07:11.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.885+0000 7f4fce999640 1 -- start start 2023-11-18T19:07:11.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fce999640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fc806fcc0 0x7f4fc815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fce999640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80bab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fce999640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fc8158710 0x7f4fc81ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fce999640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80bbec0 con 0x7f4fc80a95b0 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fce999640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8152090 con 0x7f4fc8158710 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fce999640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80bf9b0 con 0x7f4fc806fcc0 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fcd196640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fcd196640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80bab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38380/0 (socket says 172.21.15.45:38380) 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fcd196640 1 -- 172.21.15.45:0/4217868102 learned_addr learned my addr 172.21.15.45:0/4217868102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fcd997640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fc806fcc0 0x7f4fc815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.886+0000 7f4fce198640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fc8158710 0x7f4fc81ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fcd196640 1 -- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fc806fcc0 msgr2=0x7f4fc815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fcd196640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fc806fcc0 0x7f4fc815dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fcd196640 1 -- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fc8158710 msgr2=0x7f4fc81ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fcd196640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fc8158710 0x7f4fc81ed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:11.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fcd196640 1 -- 172.21.15.45:0/4217868102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4009400 con 0x7f4fc80a95b0 2023-11-18T19:07:11.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fcd196640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80bab10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c450 tx=0x7f4fb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:11.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fbe7fc640 1 -- 172.21.15.45:0/4217868102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80052d0 con 0x7f4fc80a95b0 2023-11-18T19:07:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fbe7fc640 1 -- 172.21.15.45:0/4217868102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8005430 con 0x7f4fc80a95b0 2023-11-18T19:07:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fbe7fc640 1 -- 172.21.15.45:0/4217868102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8012870 con 0x7f4fc80a95b0 2023-11-18T19:07:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.887+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc80bfc90 con 0x7f4fc80a95b0 2023-11-18T19:07:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.888+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc815e180 con 0x7f4fc80a95b0 2023-11-18T19:07:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.889+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8067fc0 con 0x7f4fc80a95b0 2023-11-18T19:07:11.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.890+0000 7f4fbe7fc640 1 -- 172.21.15.45:0/4217868102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4fb80129d0 con 0x7f4fc80a95b0 2023-11-18T19:07:11.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.891+0000 7f4fbe7fc640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4fac06ae70 0x7f4fac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:11.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.891+0000 7f4fbe7fc640 1 -- 172.21.15.45:0/4217868102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4fb80894a0 con 0x7f4fc80a95b0 2023-11-18T19:07:11.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.892+0000 7f4fcd997640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4fac06ae70 0x7f4fac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:11.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.892+0000 7f4fcd997640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4fac06ae70 0x7f4fac06d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4036000 tx=0x7f4fc4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:11.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:11.896+0000 7f4fbe7fc640 1 -- 172.21.15.45:0/4217868102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4fb80541d0 con 0x7f4fc80a95b0 2023-11-18T19:07:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.129+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fc8068410 con 0x7f4fc80a95b0 2023-11-18T19:07:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.131+0000 7f4fbe7fc640 1 -- 172.21.15.45:0/4217868102 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f4fb80577f0 con 0x7f4fc80a95b0 2023-11-18T19:07:12.132 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:12.132 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:07:00.598223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T19:07:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-11-18T19:07:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4fac06ae70 msgr2=0x7f4fac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4fac06ae70 0x7f4fac06d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4036000 tx=0x7f4fc4008030 comp rx=0 tx=0).stop 2023-11-18T19:07:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 msgr2=0x7f4fc80bab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80bab10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c450 tx=0x7f4fb800c910 comp rx=0 tx=0).stop 2023-11-18T19:07:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 shutdown_connections 2023-11-18T19:07:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fc8158710 0x7f4fc81ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fc80a95b0 0x7f4fc80bab10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4fac06ae70 0x7f4fac06d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 --2- 172.21.15.45:0/4217868102 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fc806fcc0 0x7f4fc815dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.133+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 >> 172.21.15.45:0/4217868102 conn(0x7f4fc80c5af0 msgr2=0x7f4fc80a54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:12.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.134+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 shutdown_connections 2023-11-18T19:07:12.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.134+0000 7f4fce999640 1 -- 172.21.15.45:0/4217868102 wait complete. 2023-11-18T19:07:12.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:07:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.386+0000 7fd7fb59e640 1 Processor -- start 2023-11-18T19:07:12.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.386+0000 7fd7fb59e640 1 -- start start 2023-11-18T19:07:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.387+0000 7fd7fb59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd7fc0c83c0 0x7fd7fc157a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.387+0000 7fd7fb59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc151eb0 con 0x7fd7fc157f60 2023-11-18T19:07:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.387+0000 7fd7fb59e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc1584d0 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.387+0000 7fd7fb59e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0c15a0 con 0x7fd7fc0c83c0 2023-11-18T19:07:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.388+0000 7fd7f9d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd7fc157f60 0x7fd7fc0c72e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47068/0 (socket says 172.21.15.45:47068) 2023-11-18T19:07:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.388+0000 7fd7f9d9b640 1 -- 172.21.15.45:0/1761065955 learned_addr learned my addr 172.21.15.45:0/1761065955 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.388+0000 7fd7fa59c640 1 --2- 172.21.15.45:0/1761065955 >> v2:172.21.15.135:3300/0 conn(0x7fd7fc0c83c0 0x7fd7fc157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.388+0000 7fd7f959a640 1 -- 172.21.15.45:0/1761065955 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477971772 0 0) 0x7fd7fc151eb0 con 0x7fd7fc157f60 2023-11-18T19:07:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.388+0000 7fd7f959a640 1 -- 172.21.15.45:0/1761065955 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e8003520 con 0x7fd7fc157f60 2023-11-18T19:07:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.389+0000 7fd7f959a640 1 -- 172.21.15.45:0/1761065955 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219172229 0 0) 0x7fd7e8003520 con 0x7fd7fc157f60 2023-11-18T19:07:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.389+0000 7fd7fa59c640 1 -- 172.21.15.45:0/1761065955 >> v1:172.21.15.135:6789/0 conn(0x7fd7fc0c6d70 legacy=0x7fd7fc15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.389+0000 7fd7fa59c640 1 -- 172.21.15.45:0/1761065955 >> v1:172.21.15.45:6789/0 conn(0x7fd7fc157f60 legacy=0x7fd7fc0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.389+0000 7fd7fa59c640 1 -- 172.21.15.45:0/1761065955 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0a77f0 con 0x7fd7fc0c83c0 2023-11-18T19:07:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.390+0000 7fd7fa59c640 1 --2- 172.21.15.45:0/1761065955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc157a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009d90 tx=0x7fd7ec02bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb17a81c2fdffad7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7f959a640 1 -- 172.21.15.45:0/1761065955 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4001690 con 0x7fd7fc0c83c0 2023-11-18T19:07:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7f959a640 1 -- 172.21.15.45:0/1761065955 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec02c820 con 0x7fd7fc0c83c0 2023-11-18T19:07:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7f959a640 1 -- 172.21.15.45:0/1761065955 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec02cbb0 con 0x7fd7fc0c83c0 2023-11-18T19:07:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7fb59e640 1 -- 172.21.15.45:0/1761065955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 msgr2=0x7fd7fc157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/1761065955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc157a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009d90 tx=0x7fd7ec02bcf0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7fb59e640 1 -- 172.21.15.45:0/1761065955 shutdown_connections 2023-11-18T19:07:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/1761065955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc157a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7fb59e640 1 -- 172.21.15.45:0/1761065955 >> 172.21.15.45:0/1761065955 conn(0x7fd7fc0661f0 msgr2=0x7fd7fc0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.391+0000 7fd7fb59e640 1 -- 172.21.15.45:0/1761065955 shutdown_connections 2023-11-18T19:07:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.392+0000 7fd7fb59e640 1 -- 172.21.15.45:0/1761065955 wait complete. 2023-11-18T19:07:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.393+0000 7fd7fb59e640 1 Processor -- start 2023-11-18T19:07:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.393+0000 7fd7fb59e640 1 -- start start 2023-11-18T19:07:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.394+0000 7fd7fb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7fc0c6d70 0x7fd7fc156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.394+0000 7fd7fb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.394+0000 7fd7fb59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7fc157f60 0x7fd7fc1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.394+0000 7fd7fb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc152970 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.394+0000 7fd7fb59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc152db0 con 0x7fd7fc0c83c0 2023-11-18T19:07:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.394+0000 7fd7fb59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc155a00 con 0x7fd7fc157f60 2023-11-18T19:07:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7fc0c6d70 0x7fd7fc156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7fc0c6d70 0x7fd7fc156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38382/0 (socket says 172.21.15.45:38382) 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 -- 172.21.15.45:0/3767684814 learned_addr learned my addr 172.21.15.45:0/3767684814 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fad9d640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7fc157f60 0x7fd7fc1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 -- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7fc157f60 msgr2=0x7fd7fc1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7f9d9b640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7fc157f60 0x7fd7fc1541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 -- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 msgr2=0x7fd7fc156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7fa59c640 1 -- 172.21.15.45:0/3767684814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec009a70 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.395+0000 7fd7f9d9b640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.396+0000 7fd7fa59c640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7fc0c6d70 0x7fd7fc156340 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec037040 tx=0x7fd7ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.396+0000 7fd7f2ffd640 1 -- 172.21.15.45:0/3767684814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec02ce30 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.396+0000 7fd7f2ffd640 1 -- 172.21.15.45:0/3767684814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec003990 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.396+0000 7fd7f2ffd640 1 -- 172.21.15.45:0/3767684814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec003d40 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.396+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc156dc0 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.396+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc1ea500 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.397+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc1557d0 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.398+0000 7fd7f2ffd640 1 -- 172.21.15.45:0/3767684814 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7ec03b050 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.399+0000 7fd7f2ffd640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd7dc06ae40 0x7fd7dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.399+0000 7fd7f2ffd640 1 -- 172.21.15.45:0/3767684814 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7ec0abfe0 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.400+0000 7fd7f9d9b640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd7dc06ae40 0x7fd7dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.400+0000 7fd7f9d9b640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd7dc06ae40 0x7fd7dc06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc153c20 tx=0x7fd7e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.404+0000 7fd7f2ffd640 1 -- 172.21.15.45:0/3767684814 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7fc1557d0 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.600+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7fc1557d0 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.602+0000 7fd7f2ffd640 1 -- 172.21.15.45:0/3767684814 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7fd7fc1557d0 con 0x7fd7fc0c6d70 2023-11-18T19:07:12.604 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:12.604 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:07:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.604+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd7dc06ae40 msgr2=0x7fd7dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.604+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd7dc06ae40 0x7fd7dc06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc153c20 tx=0x7fd7e4009040 comp rx=0 tx=0).stop 2023-11-18T19:07:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.604+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7fc0c6d70 msgr2=0x7fd7fc156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.604+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7fc0c6d70 0x7fd7fc156340 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec037040 tx=0x7fd7ec004a40 comp rx=0 tx=0).stop 2023-11-18T19:07:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 shutdown_connections 2023-11-18T19:07:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd7dc06ae40 0x7fd7dc06d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7fc157f60 0x7fd7fc1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7fc0c83c0 0x7fd7fc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 --2- 172.21.15.45:0/3767684814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7fc0c6d70 0x7fd7fc156340 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 >> 172.21.15.45:0/3767684814 conn(0x7fd7fc0661f0 msgr2=0x7fd7fc06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:12.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 shutdown_connections 2023-11-18T19:07:12.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.605+0000 7fd7fb59e640 1 -- 172.21.15.45:0/3767684814 wait complete. 2023-11-18T19:07:12.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T19:06:35.454808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T19:06:36.526298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T19:06:39.617712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T19:07:12.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:07:12.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.856+0000 7f6fd3fff640 1 Processor -- start 2023-11-18T19:07:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.856+0000 7f6fd3fff640 1 -- start start 2023-11-18T19:07:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fd40c4690 0x7f6fd40c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd3fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6fd40c6620 0x7f6fd41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd3fff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd40c51f0 con 0x7f6fd40c8330 2023-11-18T19:07:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd3fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd406baf0 con 0x7f6fd40c4690 2023-11-18T19:07:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd3fff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd40c5f10 con 0x7f6fd40c6620 2023-11-18T19:07:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fd40c4690 0x7f6fd40c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fd40c4690 0x7f6fd40c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38390/0 (socket says 172.21.15.45:38390) 2023-11-18T19:07:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.858+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/235433576 learned_addr learned my addr 172.21.15.45:0/235433576 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.859+0000 7f6fd37fe640 1 --2- 172.21.15.45:0/235433576 >> v2:172.21.15.135:3300/0 conn(0x7f6fd40c6620 0x7f6fd41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.859+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/235433576 >> v2:172.21.15.135:3300/0 conn(0x7f6fd40c6620 msgr2=0x7f6fd41550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.859+0000 7f6fd2ffd640 1 --2- 172.21.15.45:0/235433576 >> v2:172.21.15.135:3300/0 conn(0x7f6fd40c6620 0x7f6fd41550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.859+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/235433576 >> v1:172.21.15.135:6789/0 conn(0x7f6fd40c8330 legacy=0x7f6fd406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.859+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/235433576 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd41555f0 con 0x7f6fd40c4690 2023-11-18T19:07:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.860+0000 7f6fd2ffd640 1 --2- 172.21.15.45:0/235433576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd40c4a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40bd7b0 tx=0x7f6fc402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8113ea02808442d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.860+0000 7f6fd1ffb640 1 -- 172.21.15.45:0/235433576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc402ca80 con 0x7f6fd40c4690 2023-11-18T19:07:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.860+0000 7f6fd1ffb640 1 -- 172.21.15.45:0/235433576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc402cbe0 con 0x7f6fd40c4690 2023-11-18T19:07:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.860+0000 7f6fd1ffb640 1 -- 172.21.15.45:0/235433576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40343f0 con 0x7f6fd40c4690 2023-11-18T19:07:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 -- 172.21.15.45:0/235433576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 msgr2=0x7f6fd40c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/235433576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd40c4a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40bd7b0 tx=0x7f6fc402bee0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 -- 172.21.15.45:0/235433576 shutdown_connections 2023-11-18T19:07:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/235433576 >> v2:172.21.15.135:3300/0 conn(0x7f6fd40c6620 0x7f6fd41550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/235433576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd40c4a70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 -- 172.21.15.45:0/235433576 >> 172.21.15.45:0/235433576 conn(0x7f6fd40ab8a0 msgr2=0x7f6fd40abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 -- 172.21.15.45:0/235433576 shutdown_connections 2023-11-18T19:07:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.861+0000 7f6fd3fff640 1 -- 172.21.15.45:0/235433576 wait complete. 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.863+0000 7f6fd3fff640 1 Processor -- start 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.863+0000 7f6fd3fff640 1 -- start start 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.864+0000 7f6fd3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd414b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.864+0000 7f6fd3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40c6620 0x7f6fd414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.864+0000 7f6fd3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40c8330 0x7f6fd414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.864+0000 7f6fd3fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4155ad0 con 0x7f6fd40c4690 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.864+0000 7f6fd3fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd41eabb0 con 0x7f6fd40c8330 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.864+0000 7f6fd3fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4155d70 con 0x7f6fd40c6620 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.864+0000 7f6fd2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd414b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd414b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38392/0 (socket says 172.21.15.45:38392) 2023-11-18T19:07:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/3254247138 learned_addr learned my addr 172.21.15.45:0/3254247138 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd27fc640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40c6620 0x7f6fd414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd37fe640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40c8330 0x7f6fd414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40c6620 msgr2=0x7f6fd414a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40c6620 0x7f6fd414a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40c8330 msgr2=0x7f6fd414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40c8330 0x7f6fd414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/3254247138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4009b30 con 0x7f6fd40c4690 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.865+0000 7f6fd2ffd640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd414b210 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4000f80 tx=0x7f6fc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.866+0000 7f6fcbfff640 1 -- 172.21.15.45:0/3254247138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4009510 con 0x7f6fd40c4690 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.866+0000 7f6fcbfff640 1 -- 172.21.15.45:0/3254247138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc403e450 con 0x7f6fd40c4690 2023-11-18T19:07:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.866+0000 7f6fcbfff640 1 -- 172.21.15.45:0/3254247138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc403e800 con 0x7f6fd40c4690 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.866+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd40c08c0 con 0x7f6fd40c4690 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.866+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd414ace0 con 0x7f6fd40c4690 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.867+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd408ba90 con 0x7f6fd40c4690 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.868+0000 7f6fcbfff640 1 -- 172.21.15.45:0/3254247138 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6fc402cd50 con 0x7f6fd40c4690 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.869+0000 7f6fcbfff640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6fb406ae40 0x7f6fb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.869+0000 7f6fcbfff640 1 -- 172.21.15.45:0/3254247138 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fc40ac170 con 0x7f6fd40c4690 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.869+0000 7f6fd27fc640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6fb406ae40 0x7f6fb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.870+0000 7f6fd27fc640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6fb406ae40 0x7f6fb406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4157f90 tx=0x7f6fbc009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:12.873+0000 7f6fcbfff640 1 -- 172.21.15.45:0/3254247138 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6fc40770f0 con 0x7f6fd40c4690 2023-11-18T19:07:13.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.067+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fd41555f0 con 0x7f6fd40c4690 2023-11-18T19:07:13.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.068+0000 7f6fcbfff640 1 -- 172.21.15.45:0/3254247138 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fd41555f0 con 0x7f6fd40c4690 2023-11-18T19:07:13.069 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.070+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6fb406ae40 msgr2=0x7f6fb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.070+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6fb406ae40 0x7f6fb406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4157f90 tx=0x7f6fbc009060 comp rx=0 tx=0).stop 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.070+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 msgr2=0x7f6fd414b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.070+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd414b210 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4000f80 tx=0x7f6fc4004a40 comp rx=0 tx=0).stop 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 shutdown_connections 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40c8330 0x7f6fd414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6fb406ae40 0x7f6fb406d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40c6620 0x7f6fd414a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/3254247138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd40c4690 0x7f6fd414b210 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 >> 172.21.15.45:0/3254247138 conn(0x7f6fd40ab8a0 msgr2=0x7f6fd40aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:13.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 shutdown_connections 2023-11-18T19:07:13.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.071+0000 7f6fd3fff640 1 -- 172.21.15.45:0/3254247138 wait complete. 2023-11-18T19:07:13.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T19:07:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.301+0000 7fbb5759e640 1 Processor -- start 2023-11-18T19:07:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.302+0000 7fbb5759e640 1 -- start start 2023-11-18T19:07:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.303+0000 7fbb5759e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbb580c4690 0x7fbb580c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.303+0000 7fbb5759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580c51f0 con 0x7fbb580c8330 2023-11-18T19:07:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.303+0000 7fbb5759e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580c6be0 con 0x7fbb580c6620 2023-11-18T19:07:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.303+0000 7fbb5759e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5806baf0 con 0x7fbb580c4690 2023-11-18T19:07:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb55d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb580c8330 0x7fbb5806bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48968/0 (socket says 172.21.15.45:48968) 2023-11-18T19:07:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb55d9b640 1 -- 172.21.15.45:0/3645230700 learned_addr learned my addr 172.21.15.45:0/3645230700 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744202061 0 0) 0x7fbb580c51f0 con 0x7fbb580c8330 2023-11-18T19:07:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb5659c640 1 --2- 172.21.15.45:0/3645230700 >> v2:172.21.15.135:3300/0 conn(0x7fbb580c4690 0x7fbb580c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb44003520 con 0x7fbb580c8330 2023-11-18T19:07:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2758986218 0 0) 0x7fbb44003520 con 0x7fbb580c8330 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 >> v2:172.21.15.135:3300/0 conn(0x7fbb580c4690 msgr2=0x7fbb580c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.304+0000 7fbb5559a640 1 --2- 172.21.15.45:0/3645230700 >> v2:172.21.15.135:3300/0 conn(0x7fbb580c4690 0x7fbb580c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 >> v1:172.21.15.135:6789/0 conn(0x7fbb580c6620 legacy=0x7fbb5815efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580c6ec0 con 0x7fbb580c8330 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fbb40001670 con 0x7fbb580c8330 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 >> v1:172.21.15.45:6789/0 conn(0x7fbb580c8330 legacy=0x7fbb5806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb440039c0 0x7fbb44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb440047c0 0x7fbb44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005180 0x7fbb4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5806baf0 con 0x7fbb44005180 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4400c050 con 0x7fbb440047c0 2023-11-18T19:07:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4400c210 con 0x7fbb440039c0 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb56d9d640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005180 0x7fbb4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb55d9b640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb440047c0 0x7fbb44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb5659c640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb440039c0 0x7fbb44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb56d9d640 1 -- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb440039c0 msgr2=0x7fbb44003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.305+0000 7fbb56d9d640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb440039c0 0x7fbb44003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.306+0000 7fbb56d9d640 1 -- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb440047c0 msgr2=0x7fbb44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.306+0000 7fbb56d9d640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb440047c0 0x7fbb44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.306+0000 7fbb56d9d640 1 -- 172.21.15.45:0/3645230700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44003520 con 0x7fbb44005180 2023-11-18T19:07:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.306+0000 7fbb56d9d640 1 -- 172.21.15.45:0/3645230700 reap_dead start 2023-11-18T19:07:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.307+0000 7fbb56d9d640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005180 0x7fbb4400b980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb50003db0 tx=0x7fbb440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a381f4ac43c772a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.307+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50007220 con 0x7fbb44005180 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.307+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5002e050 con 0x7fbb44005180 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.307+0000 7fbb5559a640 1 -- 172.21.15.45:0/3645230700 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500075e0 con 0x7fbb44005180 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.307+0000 7fbb5759e640 1 -- 172.21.15.45:0/3645230700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005180 msgr2=0x7fbb4400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.307+0000 7fbb5759e640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005180 0x7fbb4400b980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb50003db0 tx=0x7fbb440057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.308+0000 7fbb5759e640 1 -- 172.21.15.45:0/3645230700 shutdown_connections 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.308+0000 7fbb5759e640 1 --2- 172.21.15.45:0/3645230700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005180 0x7fbb4400b980 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.308+0000 7fbb5759e640 1 -- 172.21.15.45:0/3645230700 >> 172.21.15.45:0/3645230700 conn(0x7fbb580ab8a0 msgr2=0x7fbb580abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.308+0000 7fbb5759e640 1 -- 172.21.15.45:0/3645230700 shutdown_connections 2023-11-18T19:07:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.308+0000 7fbb5759e640 1 -- 172.21.15.45:0/3645230700 wait complete. 2023-11-18T19:07:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.309+0000 7fbb5759e640 1 Processor -- start 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.310+0000 7fbb5759e640 1 -- start start 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.310+0000 7fbb5759e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb44005180 0x7fbb580c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.310+0000 7fbb5759e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb580be880 0x7fbb581e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb5759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb581e74c0 0x7fbb581ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb5759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581ee2d0 con 0x7fbb581e74c0 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb5759e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581ed750 con 0x7fbb580be880 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb5759e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581eda30 con 0x7fbb44005180 2023-11-18T19:07:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb581e74c0 0x7fbb581ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb581e74c0 0x7fbb581ea180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56190/0 (socket says 172.21.15.45:56190) 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 -- 172.21.15.45:0/1265068385 learned_addr learned my addr 172.21.15.45:0/1265068385 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb5659c640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb44005180 0x7fbb580c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb55d9b640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb580be880 0x7fbb581e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 -- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb44005180 msgr2=0x7fbb580c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb44005180 0x7fbb580c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 -- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb580be880 msgr2=0x7fbb581e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb580be880 0x7fbb581e6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb56d9d640 1 -- 172.21.15.45:0/1265068385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb581edd10 con 0x7fbb581e74c0 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.311+0000 7fbb55d9b640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb580be880 0x7fbb581e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.312+0000 7fbb56d9d640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb581e74c0 0x7fbb581ea180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb5002bc00 tx=0x7fbb500036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:13.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.312+0000 7fbb4effd640 1 -- 172.21.15.45:0/1265068385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50006ea0 con 0x7fbb581e74c0 2023-11-18T19:07:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.312+0000 7fbb4effd640 1 -- 172.21.15.45:0/1265068385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5003e470 con 0x7fbb581e74c0 2023-11-18T19:07:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.312+0000 7fbb4effd640 1 -- 172.21.15.45:0/1265068385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5003e820 con 0x7fbb581e74c0 2023-11-18T19:07:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.312+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb581edff0 con 0x7fbb581e74c0 2023-11-18T19:07:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.312+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb581e7970 con 0x7fbb581e74c0 2023-11-18T19:07:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.313+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb580747c0 con 0x7fbb581e74c0 2023-11-18T19:07:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.314+0000 7fbb4effd640 1 -- 172.21.15.45:0/1265068385 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb5003e980 con 0x7fbb581e74c0 2023-11-18T19:07:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.315+0000 7fbb4effd640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbb3806ae40 0x7fbb3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.315+0000 7fbb4effd640 1 -- 172.21.15.45:0/1265068385 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb500ab720 con 0x7fbb581e74c0 2023-11-18T19:07:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.316+0000 7fbb5659c640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbb3806ae40 0x7fbb3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.316+0000 7fbb5659c640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbb3806ae40 0x7fbb3806d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009fd0 tx=0x7fbb4800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:13.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.321+0000 7fbb4effd640 1 -- 172.21.15.45:0/1265068385 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb500764d0 con 0x7fbb581e74c0 2023-11-18T19:07:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.514+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb580c6be0 con 0x7fbb581e74c0 2023-11-18T19:07:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.515+0000 7fbb4effd640 1 -- 172.21.15.45:0/1265068385 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb50079af0 con 0x7fbb581e74c0 2023-11-18T19:07:13.517 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:07:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbb3806ae40 msgr2=0x7fbb3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbb3806ae40 0x7fbb3806d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009fd0 tx=0x7fbb4800b040 comp rx=0 tx=0).stop 2023-11-18T19:07:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb581e74c0 msgr2=0x7fbb581ea180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb581e74c0 0x7fbb581ea180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb5002bc00 tx=0x7fbb500036f0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 shutdown_connections 2023-11-18T19:07:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb581e74c0 0x7fbb581ea180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb580be880 0x7fbb581e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbb3806ae40 0x7fbb3806d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 --2- 172.21.15.45:0/1265068385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb44005180 0x7fbb580c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 >> 172.21.15.45:0/1265068385 conn(0x7fbb580ab8a0 msgr2=0x7fbb580c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 shutdown_connections 2023-11-18T19:07:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.518+0000 7fbb5759e640 1 -- 172.21.15.45:0/1265068385 wait complete. 2023-11-18T19:07:13.539 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T19:07:13.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.758+0000 7f8f3fd41640 1 Processor -- start 2023-11-18T19:07:13.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.758+0000 7f8f3fd41640 1 -- start start 2023-11-18T19:07:13.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3fd41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3fd41640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f380ab740 0x7f8f380c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3fd41640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f380c07d0 con 0x7f8f3806dca0 2023-11-18T19:07:13.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3fd41640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f38072070 con 0x7f8f380ab740 2023-11-18T19:07:13.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3fd41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38072310 con 0x7f8f3814fc40 2023-11-18T19:07:13.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3d2dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f380ab740 0x7f8f380c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3d2dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f380ab740 0x7f8f380c1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56198/0 (socket says 172.21.15.45:56198) 2023-11-18T19:07:13.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3d2dc640 1 -- 172.21.15.45:0/697548361 learned_addr learned my addr 172.21.15.45:0/697548361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:13.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.760+0000 7f8f3dadd640 1 --2- 172.21.15.45:0/697548361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.761+0000 7f8f3d2dc640 1 -- 172.21.15.45:0/697548361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 msgr2=0x7f8f38152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:13.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.761+0000 7f8f3d2dc640 1 --2- 172.21.15.45:0/697548361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.761+0000 7f8f3d2dc640 1 -- 172.21.15.45:0/697548361 >> v1:172.21.15.135:6789/0 conn(0x7f8f3806dca0 legacy=0x7f8f380c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:13.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.761+0000 7f8f3d2dc640 1 -- 172.21.15.45:0/697548361 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f380725f0 con 0x7f8f380ab740 2023-11-18T19:07:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.762+0000 7f8f3d2dc640 1 --2- 172.21.15.45:0/697548361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380ab740 0x7f8f380c1d50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009870 tx=0x7f8f2802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccab69a8e0a16848 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.762+0000 7f8f3cadb640 1 -- 172.21.15.45:0/697548361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28033620 con 0x7f8f380ab740 2023-11-18T19:07:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.762+0000 7f8f3cadb640 1 -- 172.21.15.45:0/697548361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f28033780 con 0x7f8f380ab740 2023-11-18T19:07:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.762+0000 7f8f3cadb640 1 -- 172.21.15.45:0/697548361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28033b10 con 0x7f8f380ab740 2023-11-18T19:07:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 -- 172.21.15.45:0/697548361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380ab740 msgr2=0x7f8f380c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/697548361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380ab740 0x7f8f380c1d50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009870 tx=0x7f8f2802b7d0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 -- 172.21.15.45:0/697548361 shutdown_connections 2023-11-18T19:07:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/697548361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380ab740 0x7f8f380c1d50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/697548361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 -- 172.21.15.45:0/697548361 >> 172.21.15.45:0/697548361 conn(0x7f8f380a7980 msgr2=0x7f8f380a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 -- 172.21.15.45:0/697548361 shutdown_connections 2023-11-18T19:07:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.763+0000 7f8f3fd41640 1 -- 172.21.15.45:0/697548361 wait complete. 2023-11-18T19:07:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.765+0000 7f8f3fd41640 1 Processor -- start 2023-11-18T19:07:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.765+0000 7f8f3fd41640 1 -- start start 2023-11-18T19:07:13.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.766+0000 7f8f3fd41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3806dca0 0x7f8f38151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.766+0000 7f8f3fd41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ab740 0x7f8f380a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.766+0000 7f8f3fd41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.766+0000 7f8f3fd41640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38152550 con 0x7f8f3806dca0 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.766+0000 7f8f3fd41640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f381ed5d0 con 0x7f8f380ab740 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.766+0000 7f8f3fd41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f381ed8b0 con 0x7f8f3814fc40 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.766+0000 7f8f3dadd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3806dca0 0x7f8f38151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3806dca0 0x7f8f38151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56206/0 (socket says 172.21.15.45:56206) 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 -- 172.21.15.45:0/1178564170 learned_addr learned my addr 172.21.15.45:0/1178564170 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3e2de640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3d2dc640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ab740 0x7f8f380a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 -- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 msgr2=0x7f8f38150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 -- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ab740 msgr2=0x7f8f380a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ab740 0x7f8f380a9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 -- 172.21.15.45:0/1178564170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f280094d0 con 0x7f8f3806dca0 2023-11-18T19:07:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3d2dc640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ab740 0x7f8f380a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.767+0000 7f8f3dadd640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3806dca0 0x7f8f38151f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400d5f0 tx=0x7f8f3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.768+0000 7f8f2e7fc640 1 -- 172.21.15.45:0/1178564170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340125f0 con 0x7f8f3806dca0 2023-11-18T19:07:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.768+0000 7f8f2e7fc640 1 -- 172.21.15.45:0/1178564170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34012750 con 0x7f8f3806dca0 2023-11-18T19:07:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.768+0000 7f8f2e7fc640 1 -- 172.21.15.45:0/1178564170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34012b00 con 0x7f8f3806dca0 2023-11-18T19:07:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.768+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f381edb90 con 0x7f8f3806dca0 2023-11-18T19:07:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.768+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380aa410 con 0x7f8f3806dca0 2023-11-18T19:07:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.769+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f38066b80 con 0x7f8f3806dca0 2023-11-18T19:07:13.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.770+0000 7f8f2e7fc640 1 -- 172.21.15.45:0/1178564170 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f34012c60 con 0x7f8f3806dca0 2023-11-18T19:07:13.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.771+0000 7f8f2e7fc640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8f1c06ae40 0x7f8f1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:13.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.771+0000 7f8f2e7fc640 1 -- 172.21.15.45:0/1178564170 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f34089e00 con 0x7f8f3806dca0 2023-11-18T19:07:13.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.771+0000 7f8f3d2dc640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8f1c06ae40 0x7f8f1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.772+0000 7f8f3d2dc640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8f1c06ae40 0x7f8f1c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f28035000 tx=0x7f8f28008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:13.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.775+0000 7f8f2e7fc640 1 -- 172.21.15.45:0/1178564170 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f34054bb0 con 0x7f8f3806dca0 2023-11-18T19:07:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.967+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f380747c0 con 0x7f8f3806dca0 2023-11-18T19:07:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.968+0000 7f8f2e7fc640 1 -- 172.21.15.45:0/1178564170 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f340581d0 con 0x7f8f3806dca0 2023-11-18T19:07:13.970 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-18T19:07:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8f1c06ae40 msgr2=0x7f8f1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8f1c06ae40 0x7f8f1c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f28035000 tx=0x7f8f28008030 comp rx=0 tx=0).stop 2023-11-18T19:07:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3806dca0 msgr2=0x7f8f38151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3806dca0 0x7f8f38151f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400d5f0 tx=0x7f8f3400dab0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 shutdown_connections 2023-11-18T19:07:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8f1c06ae40 0x7f8f1c06d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f3814fc40 0x7f8f38150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ab740 0x7f8f380a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 --2- 172.21.15.45:0/1178564170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3806dca0 0x7f8f38151f20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 >> 172.21.15.45:0/1178564170 conn(0x7f8f380a7980 msgr2=0x7f8f380709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 shutdown_connections 2023-11-18T19:07:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:13.971+0000 7f8f3fd41640 1 -- 172.21.15.45:0/1178564170 wait complete. 2023-11-18T19:07:13.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T19:07:14.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.216+0000 7f65e1f65640 1 Processor -- start 2023-11-18T19:07:14.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.217+0000 7f65e1f65640 1 -- start start 2023-11-18T19:07:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.218+0000 7f65e1f65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 0x7f65dc0c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.218+0000 7f65e1f65640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc0c07d0 con 0x7f65dc14fc40 2023-11-18T19:07:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.218+0000 7f65e1f65640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc06e3b0 con 0x7f65dc0ab740 2023-11-18T19:07:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.218+0000 7f65e1f65640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc152920 con 0x7f65dc152490 2023-11-18T19:07:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.219+0000 7f65db7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f65dc14fc40 0x7f65dc06dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48972/0 (socket says 172.21.15.45:48972) 2023-11-18T19:07:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.219+0000 7f65db7fe640 1 -- 172.21.15.45:0/3549844978 learned_addr learned my addr 172.21.15.45:0/3549844978 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.219+0000 7f65dbfff640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 0x7f65dc0c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.219+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275762764 0 0) 0x7f65dc0c07d0 con 0x7f65dc14fc40 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.219+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65c4003520 con 0x7f65dc14fc40 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.219+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426054076 0 0) 0x7f65c4003520 con 0x7f65dc14fc40 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 msgr2=0x7f65dc0c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 0x7f65dc0c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 >> v1:172.21.15.135:6789/0 conn(0x7f65dc0ab740 legacy=0x7f65dc0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc072070 con 0x7f65dc14fc40 2023-11-18T19:07:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f65cc001670 con 0x7f65dc14fc40 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 >> v1:172.21.15.45:6789/0 conn(0x7f65dc14fc40 legacy=0x7f65dc06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 0x7f65c40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c4003f70 0x7f65c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc152920 con 0x7f65c4004d00 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c400ff80 con 0x7f65c4003f70 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c4010140 con 0x7f65dc152490 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65dbfff640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65db7fe640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 0x7f65c40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.220+0000 7f65daffd640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c4003f70 0x7f65c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.221+0000 7f65dbfff640 1 -- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 msgr2=0x7f65c40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.221+0000 7f65dbfff640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc152490 0x7f65c40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.221+0000 7f65dbfff640 1 -- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c4003f70 msgr2=0x7f65c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.221+0000 7f65dbfff640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c4003f70 0x7f65c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.221+0000 7f65dbfff640 1 -- 172.21.15.45:0/3549844978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4003520 con 0x7f65c4004d00 2023-11-18T19:07:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.221+0000 7f65daffd640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65c4003f70 0x7f65c40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.222+0000 7f65dbfff640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65c4005180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009fc0 tx=0x7f65c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7509cd72d8f8fc8a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.222+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d402cc20 con 0x7f65c4004d00 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.222+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d400f040 con 0x7f65c4004d00 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.222+0000 7f65da7fc640 1 -- 172.21.15.45:0/3549844978 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4034440 con 0x7f65c4004d00 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.223+0000 7f65e1f65640 1 -- 172.21.15.45:0/3549844978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 msgr2=0x7f65c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.223+0000 7f65e1f65640 1 --2- 172.21.15.45:0/3549844978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65c4005180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009fc0 tx=0x7f65c40057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.223+0000 7f65dbfff640 1 -- 172.21.15.45:0/3549844978 reap_dead start 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.223+0000 7f65e1f65640 1 -- 172.21.15.45:0/3549844978 shutdown_connections 2023-11-18T19:07:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.223+0000 7f65e1f65640 1 -- 172.21.15.45:0/3549844978 >> 172.21.15.45:0/3549844978 conn(0x7f65dc0a7980 msgr2=0x7f65dc0a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:14.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.223+0000 7f65e1f65640 1 -- 172.21.15.45:0/3549844978 shutdown_connections 2023-11-18T19:07:14.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.223+0000 7f65e1f65640 1 -- 172.21.15.45:0/3549844978 wait complete. 2023-11-18T19:07:14.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.226+0000 7f65e1f65640 1 Processor -- start 2023-11-18T19:07:14.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.226+0000 7f65e1f65640 1 -- start start 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.227+0000 7f65e1f65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65dc1e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.227+0000 7f65e1f65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65dc14e0c0 0x7f65dc0beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.227+0000 7f65e1f65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc0bf430 0x7f65dc1e9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.227+0000 7f65e1f65640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc1e8d40 con 0x7f65c4004d00 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.227+0000 7f65e1f65640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc1536b0 con 0x7f65dc14e0c0 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.227+0000 7f65e1f65640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc156400 con 0x7f65dc0bf430 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.227+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65dc1e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65dc1e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56216/0 (socket says 172.21.15.45:56216) 2023-11-18T19:07:14.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 -- 172.21.15.45:0/3791674717 learned_addr learned my addr 172.21.15.45:0/3791674717 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65daffd640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65dc14e0c0 0x7f65dc0beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65dbfff640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc0bf430 0x7f65dc1e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 -- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc0bf430 msgr2=0x7f65dc1e9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc0bf430 0x7f65dc1e9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 -- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65dc14e0c0 msgr2=0x7f65dc0beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65dc14e0c0 0x7f65dc0beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 -- 172.21.15.45:0/3791674717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0c0270 con 0x7f65c4004d00 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65dbfff640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc0bf430 0x7f65dc1e9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65daffd640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65dc14e0c0 0x7f65dc0beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.228+0000 7f65db7fe640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65dc1e61d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0072c0 tx=0x7f65cc0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.229+0000 7f65c3fff640 1 -- 172.21.15.45:0/3791674717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00f9c0 con 0x7f65c4004d00 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.229+0000 7f65c3fff640 1 -- 172.21.15.45:0/3791674717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc00fb20 con 0x7f65c4004d00 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.229+0000 7f65c3fff640 1 -- 172.21.15.45:0/3791674717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00fed0 con 0x7f65c4004d00 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.229+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc1e6710 con 0x7f65c4004d00 2023-11-18T19:07:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.229+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc0bf8b0 con 0x7f65c4004d00 2023-11-18T19:07:14.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.230+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc066b80 con 0x7f65c4004d00 2023-11-18T19:07:14.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.231+0000 7f65c3fff640 1 -- 172.21.15.45:0/3791674717 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65cc01d460 con 0x7f65c4004d00 2023-11-18T19:07:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.233+0000 7f65c3fff640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f65c806ae40 0x7f65c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.233+0000 7f65c3fff640 1 -- 172.21.15.45:0/3791674717 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65cc089bb0 con 0x7f65c4004d00 2023-11-18T19:07:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.233+0000 7f65daffd640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f65c806ae40 0x7f65c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.234+0000 7f65daffd640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f65c806ae40 0x7f65c806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65dc067860 tx=0x7f65d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.237+0000 7f65c3fff640 1 -- 172.21.15.45:0/3791674717 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65cc054960 con 0x7f65c4004d00 2023-11-18T19:07:14.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.432+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f65dc0747c0 con 0x7f65c4004d00 2023-11-18T19:07:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.432+0000 7f65c3fff640 1 -- 172.21.15.45:0/3791674717 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f65cc089030 con 0x7f65c4004d00 2023-11-18T19:07:14.440 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:07:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f65c806ae40 msgr2=0x7f65c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f65c806ae40 0x7f65c806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65dc067860 tx=0x7f65d0009040 comp rx=0 tx=0).stop 2023-11-18T19:07:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 msgr2=0x7f65dc1e61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65dc1e61d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0072c0 tx=0x7f65cc0076c0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 shutdown_connections 2023-11-18T19:07:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f65c806ae40 0x7f65c806d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65dc0bf430 0x7f65dc1e9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65dc14e0c0 0x7f65dc0beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 --2- 172.21.15.45:0/3791674717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65c4004d00 0x7f65dc1e61d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 >> 172.21.15.45:0/3791674717 conn(0x7f65dc0a7980 msgr2=0x7f65dc150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 shutdown_connections 2023-11-18T19:07:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.435+0000 7f65e1f65640 1 -- 172.21.15.45:0/3791674717 wait complete. 2023-11-18T19:07:14.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:07:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.681+0000 7fe76cf33640 1 Processor -- start 2023-11-18T19:07:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.681+0000 7fe76cf33640 1 -- start start 2023-11-18T19:07:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe76cf33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe7681560e0 0x7fe7680c4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe76cf33640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7680aa7d0 0x7fe7680aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe76cf33640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7680c3a60 con 0x7fe768159390 2023-11-18T19:07:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe76cf33640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680a9950 con 0x7fe7680aa7d0 2023-11-18T19:07:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe76cf33640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76815a510 con 0x7fe7681560e0 2023-11-18T19:07:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe766d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7680aa7d0 0x7fe7680aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe766d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7680aa7d0 0x7fe7680aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56232/0 (socket says 172.21.15.45:56232) 2023-11-18T19:07:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe766d9d640 1 -- 172.21.15.45:0/1022709538 learned_addr learned my addr 172.21.15.45:0/1022709538 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe765d9b640 1 --1- 172.21.15.45:0/1022709538 >> v1:172.21.15.45:6789/0 conn(0x7fe768159390 0x7fe768159e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48974/0 (socket says 172.21.15.45:48974) 2023-11-18T19:07:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.683+0000 7fe76659c640 1 --2- 172.21.15.45:0/1022709538 >> v2:172.21.15.135:3300/0 conn(0x7fe7681560e0 0x7fe7680c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.684+0000 7fe76559a640 1 -- 172.21.15.45:0/1022709538 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978833320 0 0) 0x7fe7680c3a60 con 0x7fe768159390 2023-11-18T19:07:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.684+0000 7fe76559a640 1 -- 172.21.15.45:0/1022709538 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe754003520 con 0x7fe768159390 2023-11-18T19:07:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.684+0000 7fe766d9d640 1 -- 172.21.15.45:0/1022709538 >> v2:172.21.15.135:3300/0 conn(0x7fe7681560e0 msgr2=0x7fe7680c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.684+0000 7fe766d9d640 1 --2- 172.21.15.45:0/1022709538 >> v2:172.21.15.135:3300/0 conn(0x7fe7681560e0 0x7fe7680c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.684+0000 7fe766d9d640 1 -- 172.21.15.45:0/1022709538 >> v1:172.21.15.45:6789/0 conn(0x7fe768159390 legacy=0x7fe768159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.684+0000 7fe766d9d640 1 -- 172.21.15.45:0/1022709538 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680a8ee0 con 0x7fe7680aa7d0 2023-11-18T19:07:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.685+0000 7fe766d9d640 1 --2- 172.21.15.45:0/1022709538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7680aa7d0 0x7fe7680aac20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe768072d30 tx=0x7fe76002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388770cc25dffde6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.685+0000 7fe76559a640 1 -- 172.21.15.45:0/1022709538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760031860 con 0x7fe7680aa7d0 2023-11-18T19:07:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76559a640 1 -- 172.21.15.45:0/1022709538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7600319c0 con 0x7fe7680aa7d0 2023-11-18T19:07:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76559a640 1 -- 172.21.15.45:0/1022709538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760031d50 con 0x7fe7680aa7d0 2023-11-18T19:07:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 -- 172.21.15.45:0/1022709538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7680aa7d0 msgr2=0x7fe7680aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1022709538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7680aa7d0 0x7fe7680aac20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe768072d30 tx=0x7fe76002b900 comp rx=0 tx=0).stop 2023-11-18T19:07:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 -- 172.21.15.45:0/1022709538 shutdown_connections 2023-11-18T19:07:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1022709538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7680aa7d0 0x7fe7680aac20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1022709538 >> v2:172.21.15.135:3300/0 conn(0x7fe7681560e0 0x7fe7680c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 -- 172.21.15.45:0/1022709538 >> 172.21.15.45:0/1022709538 conn(0x7fe76806a500 msgr2=0x7fe76806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 -- 172.21.15.45:0/1022709538 shutdown_connections 2023-11-18T19:07:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.686+0000 7fe76cf33640 1 -- 172.21.15.45:0/1022709538 wait complete. 2023-11-18T19:07:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.688+0000 7fe76cf33640 1 Processor -- start 2023-11-18T19:07:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.688+0000 7fe76cf33640 1 -- start start 2023-11-18T19:07:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe76cf33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7680aa7d0 0x7fe76806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe76cf33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7681560e0 0x7fe768072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe76cf33640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe768159390 0x7fe768072680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe76cf33640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe768071050 con 0x7fe768159390 2023-11-18T19:07:14.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe76cf33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680bee20 con 0x7fe7680aa7d0 2023-11-18T19:07:14.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe76cf33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680704a0 con 0x7fe7681560e0 2023-11-18T19:07:14.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe766d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe768159390 0x7fe768072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe766d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe768159390 0x7fe768072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56240/0 (socket says 172.21.15.45:56240) 2023-11-18T19:07:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.689+0000 7fe766d9d640 1 -- 172.21.15.45:0/1949192583 learned_addr learned my addr 172.21.15.45:0/1949192583 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe76659c640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7680aa7d0 0x7fe76806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe765d9b640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7681560e0 0x7fe768072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe766d9d640 1 -- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7681560e0 msgr2=0x7fe768072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe766d9d640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7681560e0 0x7fe768072140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe766d9d640 1 -- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7680aa7d0 msgr2=0x7fe76806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe766d9d640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7680aa7d0 0x7fe76806dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe766d9d640 1 -- 172.21.15.45:0/1949192583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600094d0 con 0x7fe768159390 2023-11-18T19:07:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe766d9d640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe768159390 0x7fe768072680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7600097f0 tx=0x7fe7600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe75effd640 1 -- 172.21.15.45:0/1949192583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76003ac60 con 0x7fe768159390 2023-11-18T19:07:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe75effd640 1 -- 172.21.15.45:0/1949192583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76003ade0 con 0x7fe768159390 2023-11-18T19:07:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe75effd640 1 -- 172.21.15.45:0/1949192583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760044630 con 0x7fe768159390 2023-11-18T19:07:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.690+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76806e190 con 0x7fe768159390 2023-11-18T19:07:14.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.691+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7680bf070 con 0x7fe768159390 2023-11-18T19:07:14.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.692+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680747c0 con 0x7fe768159390 2023-11-18T19:07:14.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.693+0000 7fe75effd640 1 -- 172.21.15.45:0/1949192583 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe76004d450 con 0x7fe768159390 2023-11-18T19:07:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.694+0000 7fe75effd640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe74806ae40 0x7fe74806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.694+0000 7fe75effd640 1 -- 172.21.15.45:0/1949192583 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7600abcc0 con 0x7fe768159390 2023-11-18T19:07:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.694+0000 7fe76659c640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe74806ae40 0x7fe74806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.695+0000 7fe76659c640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe74806ae40 0x7fe74806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe768072d30 tx=0x7fe75800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.698+0000 7fe75effd640 1 -- 172.21.15.45:0/1949192583 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7600b2080 con 0x7fe768159390 2023-11-18T19:07:14.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.930+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7680c51c0 con 0x7fe768159390 2023-11-18T19:07:14.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.931+0000 7fe75effd640 1 -- 172.21.15.45:0/1949192583 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fe760035020 con 0x7fe768159390 2023-11-18T19:07:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:14.933 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:07:00.598223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T19:07:14.933 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe74806ae40 msgr2=0x7fe74806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe74806ae40 0x7fe74806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe768072d30 tx=0x7fe75800b040 comp rx=0 tx=0).stop 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe768159390 msgr2=0x7fe768072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe768159390 0x7fe768072680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7600097f0 tx=0x7fe7600046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 shutdown_connections 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe768159390 0x7fe768072680 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe74806ae40 0x7fe74806d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe7681560e0 0x7fe768072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 --2- 172.21.15.45:0/1949192583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7680aa7d0 0x7fe76806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:14.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.934+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 >> 172.21.15.45:0/1949192583 conn(0x7fe76806a500 msgr2=0x7fe768153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:14.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.935+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 shutdown_connections 2023-11-18T19:07:14.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:14.935+0000 7fe76cf33640 1 -- 172.21.15.45:0/1949192583 wait complete. 2023-11-18T19:07:14.957 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:07:15.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.186+0000 7f378a51b640 1 Processor -- start 2023-11-18T19:07:15.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.186+0000 7f378a51b640 1 -- start start 2023-11-18T19:07:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.187+0000 7f378a51b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f378414e580 0x7f37840c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.187+0000 7f378a51b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37840bd520 0x7f3784157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.187+0000 7f378a51b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3784155510 con 0x7f37840c7d90 2023-11-18T19:07:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.187+0000 7f378a51b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3784154f90 con 0x7f37840bd520 2023-11-18T19:07:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.187+0000 7f378a51b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840ca4d0 con 0x7f378414e580 2023-11-18T19:07:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.187+0000 7f3789d1a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f37840c7d90 0x7f3784158190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48988/0 (socket says 172.21.15.45:48988) 2023-11-18T19:07:15.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.188+0000 7f3789d1a640 1 -- 172.21.15.45:0/1621894796 learned_addr learned my addr 172.21.15.45:0/1621894796 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.188+0000 7f3788d18640 1 --2- 172.21.15.45:0/1621894796 >> v2:172.21.15.135:3300/0 conn(0x7f37840bd520 0x7f3784157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.188+0000 7f3789519640 1 --2- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f378414e580 0x7f37840c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.188+0000 7f377bfff640 1 -- 172.21.15.45:0/1621894796 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498589109 0 0) 0x7f3784155510 con 0x7f37840c7d90 2023-11-18T19:07:15.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.188+0000 7f377bfff640 1 -- 172.21.15.45:0/1621894796 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3770003520 con 0x7f37840c7d90 2023-11-18T19:07:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.189+0000 7f3788d18640 1 -- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f378414e580 msgr2=0x7f37840c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.189+0000 7f3788d18640 1 --2- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f378414e580 0x7f37840c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.189+0000 7f3788d18640 1 -- 172.21.15.45:0/1621894796 >> v1:172.21.15.45:6789/0 conn(0x7f37840c7d90 legacy=0x7f3784158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.189+0000 7f377bfff640 1 -- 172.21.15.45:0/1621894796 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4104059342 0 0) 0x7f3770003520 con 0x7f37840c7d90 2023-11-18T19:07:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.189+0000 7f3788d18640 1 -- 172.21.15.45:0/1621894796 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378406cbb0 con 0x7f37840bd520 2023-11-18T19:07:15.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.189+0000 7f3789519640 1 --2- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f378414e580 0x7f37840c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:07:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.190+0000 7f3788d18640 1 --2- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840bd520 0x7f3784157c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37740097a0 tx=0x7f377402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b57191ee908401bf server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.190+0000 7f377bfff640 1 -- 172.21.15.45:0/1621894796 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0019f0 con 0x7f37840bd520 2023-11-18T19:07:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.190+0000 7f377bfff640 1 -- 172.21.15.45:0/1621894796 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377402e050 con 0x7f37840bd520 2023-11-18T19:07:15.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.190+0000 7f377bfff640 1 -- 172.21.15.45:0/1621894796 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774030730 con 0x7f37840bd520 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 -- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840bd520 msgr2=0x7f3784157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 --2- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840bd520 0x7f3784157c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37740097a0 tx=0x7f377402b710 comp rx=0 tx=0).stop 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 -- 172.21.15.45:0/1621894796 shutdown_connections 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 --2- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840bd520 0x7f3784157c50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 --2- 172.21.15.45:0/1621894796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f378414e580 0x7f37840c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 -- 172.21.15.45:0/1621894796 >> 172.21.15.45:0/1621894796 conn(0x7f3784066610 msgr2=0x7f3784066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 -- 172.21.15.45:0/1621894796 shutdown_connections 2023-11-18T19:07:15.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.191+0000 7f378a51b640 1 -- 172.21.15.45:0/1621894796 wait complete. 2023-11-18T19:07:15.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.193+0000 7f378a51b640 1 Processor -- start 2023-11-18T19:07:15.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.193+0000 7f378a51b640 1 -- start start 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f378a51b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37840bd520 0x7f37840c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f378a51b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840c7d90 0x7f37840bef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f378a51b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378414e580 0x7f378414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f378a51b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841ed350 con 0x7f378414e580 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f378a51b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841ed630 con 0x7f37840c7d90 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f378a51b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37841ed910 con 0x7f37840bd520 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f3789d1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378414e580 0x7f378414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f3789d1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378414e580 0x7f378414cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56248/0 (socket says 172.21.15.45:56248) 2023-11-18T19:07:15.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.194+0000 7f3789d1a640 1 -- 172.21.15.45:0/1211068798 learned_addr learned my addr 172.21.15.45:0/1211068798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:15.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3789519640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37840bd520 0x7f37840c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3788d18640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840c7d90 0x7f37840bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3789d1a640 1 -- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37840bd520 msgr2=0x7f37840c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3789d1a640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37840bd520 0x7f37840c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3789d1a640 1 -- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840c7d90 msgr2=0x7f37840bef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3789d1a640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840c7d90 0x7f37840bef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3789d1a640 1 -- 172.21.15.45:0/1211068798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780009400 con 0x7f378414e580 2023-11-18T19:07:15.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.195+0000 7f3789d1a640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378414e580 0x7f378414cfd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f377c00cc70 tx=0x7f377c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:15.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.196+0000 7f3779ffb640 1 -- 172.21.15.45:0/1211068798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00ce80 con 0x7f378414e580 2023-11-18T19:07:15.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.196+0000 7f3779ffb640 1 -- 172.21.15.45:0/1211068798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c012400 con 0x7f378414e580 2023-11-18T19:07:15.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.196+0000 7f3779ffb640 1 -- 172.21.15.45:0/1211068798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0127b0 con 0x7f378414e580 2023-11-18T19:07:15.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.196+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774009400 con 0x7f378414e580 2023-11-18T19:07:15.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.196+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37841eded0 con 0x7f378414e580 2023-11-18T19:07:15.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.197+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3784067910 con 0x7f378414e580 2023-11-18T19:07:15.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.198+0000 7f3779ffb640 1 -- 172.21.15.45:0/1211068798 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f377c012910 con 0x7f378414e580 2023-11-18T19:07:15.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.199+0000 7f3779ffb640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f376806ae70 0x7f376806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.199+0000 7f3779ffb640 1 -- 172.21.15.45:0/1211068798 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f377c089f40 con 0x7f378414e580 2023-11-18T19:07:15.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.200+0000 7f3789519640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f376806ae70 0x7f376806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.200+0000 7f3789519640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f376806ae70 0x7f376806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3780009c30 tx=0x7f3780009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:15.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.204+0000 7f3779ffb640 1 -- 172.21.15.45:0/1211068798 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f377c054cf0 con 0x7f378414e580 2023-11-18T19:07:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.400+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3784158860 con 0x7f378414e580 2023-11-18T19:07:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.401+0000 7f3779ffb640 1 -- 172.21.15.45:0/1211068798 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18338 (secure 0 0 0) 0x7f377c058310 con 0x7f378414e580 2023-11-18T19:07:15.403 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:15.403 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:06:42.051995+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:07:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f376806ae70 msgr2=0x7f376806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f376806ae70 0x7f376806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3780009c30 tx=0x7f3780009190 comp rx=0 tx=0).stop 2023-11-18T19:07:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378414e580 msgr2=0x7f378414cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378414e580 0x7f378414cfd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f377c00cc70 tx=0x7f377c00a430 comp rx=0 tx=0).stop 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 shutdown_connections 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378414e580 0x7f378414cfd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37840c7d90 0x7f37840bef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f376806ae70 0x7f376806d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 --2- 172.21.15.45:0/1211068798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37840bd520 0x7f37840c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 >> 172.21.15.45:0/1211068798 conn(0x7f3784066610 msgr2=0x7f37840c4710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 shutdown_connections 2023-11-18T19:07:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.404+0000 7f378a51b640 1 -- 172.21.15.45:0/1211068798 wait complete. 2023-11-18T19:07:15.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:07:15.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.650+0000 7f6f34690640 1 Processor -- start 2023-11-18T19:07:15.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.650+0000 7f6f34690640 1 -- start start 2023-11-18T19:07:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.651+0000 7f6f34690640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6f2c155290 0x7f6f2c158640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.651+0000 7f6f34690640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0c0ed0 0x7f6f2c0c1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f34690640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c158b80 con 0x7f6f2c0a99f0 2023-11-18T19:07:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f34690640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a9140 con 0x7f6f2c155290 2023-11-18T19:07:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f34690640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0c40f0 con 0x7f6f2c0c0ed0 2023-11-18T19:07:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f3242c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6f2c155290 0x7f6f2c158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f31c2b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0c0ed0 0x7f6f2c0c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f31c2b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0c0ed0 0x7f6f2c0c1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:34784/0 (socket says 172.21.15.45:34784) 2023-11-18T19:07:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f3242c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6f2c155290 0x7f6f2c158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:39760/0 (socket says 172.21.15.45:39760) 2023-11-18T19:07:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.652+0000 7f6f31c2b640 1 -- 172.21.15.45:0/2687304667 learned_addr learned my addr 172.21.15.45:0/2687304667 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.653+0000 7f6f3242c640 1 -- 172.21.15.45:0/2687304667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0c0ed0 msgr2=0x7f6f2c0c1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.653+0000 7f6f3242c640 1 --2- 172.21.15.45:0/2687304667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0c0ed0 0x7f6f2c0c1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.653+0000 7f6f3242c640 1 -- 172.21.15.45:0/2687304667 >> v1:172.21.15.135:6789/0 conn(0x7f6f2c0a99f0 legacy=0x7f6f2c0a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.653+0000 7f6f3242c640 1 -- 172.21.15.45:0/2687304667 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0c3c70 con 0x7f6f2c155290 2023-11-18T19:07:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.655+0000 7f6f3242c640 1 --2- 172.21.15.45:0/2687304667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c155290 0x7f6f2c158640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009d90 tx=0x7f6f2002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac5bb92b4247456a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.655+0000 7f6f3142a640 1 -- 172.21.15.45:0/2687304667 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2002cc50 con 0x7f6f2c155290 2023-11-18T19:07:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.655+0000 7f6f3142a640 1 -- 172.21.15.45:0/2687304667 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2002cdb0 con 0x7f6f2c155290 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.655+0000 7f6f3142a640 1 -- 172.21.15.45:0/2687304667 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20034660 con 0x7f6f2c155290 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 -- 172.21.15.45:0/2687304667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c155290 msgr2=0x7f6f2c158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 --2- 172.21.15.45:0/2687304667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c155290 0x7f6f2c158640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009d90 tx=0x7f6f2002bea0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 -- 172.21.15.45:0/2687304667 shutdown_connections 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 --2- 172.21.15.45:0/2687304667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0c0ed0 0x7f6f2c0c1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 --2- 172.21.15.45:0/2687304667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c155290 0x7f6f2c158640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 -- 172.21.15.45:0/2687304667 >> 172.21.15.45:0/2687304667 conn(0x7f6f2c06a500 msgr2=0x7f6f2c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 -- 172.21.15.45:0/2687304667 shutdown_connections 2023-11-18T19:07:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.656+0000 7f6f34690640 1 -- 172.21.15.45:0/2687304667 wait complete. 2023-11-18T19:07:15.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.658+0000 7f6f34690640 1 Processor -- start 2023-11-18T19:07:15.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.658+0000 7f6f34690640 1 -- start start 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f34690640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0a99f0 0x7f6f2c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f34690640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c0c0ed0 0x7f6f2c1ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f34690640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2c155290 0x7f6f2c06dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f34690640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c1ed960 con 0x7f6f2c155290 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f34690640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c1565d0 con 0x7f6f2c0c0ed0 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f34690640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c1eae20 con 0x7f6f2c0a99f0 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f32c2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2c155290 0x7f6f2c06dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f32c2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2c155290 0x7f6f2c06dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56258/0 (socket says 172.21.15.45:56258) 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f32c2d640 1 -- 172.21.15.45:0/3029394299 learned_addr learned my addr 172.21.15.45:0/3029394299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.659+0000 7f6f3242c640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0a99f0 0x7f6f2c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f31c2b640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c0c0ed0 0x7f6f2c1ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f32c2d640 1 -- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0a99f0 msgr2=0x7f6f2c156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f32c2d640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0a99f0 0x7f6f2c156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f32c2d640 1 -- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c0c0ed0 msgr2=0x7f6f2c1ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f32c2d640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c0c0ed0 0x7f6f2c1ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f32c2d640 1 -- 172.21.15.45:0/3029394299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20009a70 con 0x7f6f2c155290 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f32c2d640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2c155290 0x7f6f2c06dbf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c430 tx=0x7f6f2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f2affd640 1 -- 172.21.15.45:0/3029394299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240052d0 con 0x7f6f2c155290 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f2affd640 1 -- 172.21.15.45:0/3029394299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24005430 con 0x7f6f2c155290 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.660+0000 7f6f2affd640 1 -- 172.21.15.45:0/3029394299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24003810 con 0x7f6f2c155290 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.661+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c072610 con 0x7f6f2c155290 2023-11-18T19:07:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.661+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c1ed5f0 con 0x7f6f2c155290 2023-11-18T19:07:15.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.662+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c0ab0e0 con 0x7f6f2c155290 2023-11-18T19:07:15.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.663+0000 7f6f2affd640 1 -- 172.21.15.45:0/3029394299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f24003970 con 0x7f6f2c155290 2023-11-18T19:07:15.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.664+0000 7f6f2affd640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1006ae40 0x7f6f1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:15.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.664+0000 7f6f2affd640 1 -- 172.21.15.45:0/3029394299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f24088c50 con 0x7f6f2c155290 2023-11-18T19:07:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.664+0000 7f6f3242c640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1006ae40 0x7f6f1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.665+0000 7f6f3242c640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1006ae40 0x7f6f1006d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f20036000 tx=0x7f6f20030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:15.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.669+0000 7f6f2affd640 1 -- 172.21.15.45:0/3029394299 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f24053ab0 con 0x7f6f2c155290 2023-11-18T19:07:15.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.901+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f2c072b30 con 0x7f6f2c155290 2023-11-18T19:07:15.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.903+0000 7f6f2affd640 1 -- 172.21.15.45:0/3029394299 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f6f2c072b30 con 0x7f6f2c155290 2023-11-18T19:07:15.905 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:07:15.905 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:07:00.598223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T19:07:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-11-18T19:07:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1006ae40 msgr2=0x7f6f1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1006ae40 0x7f6f1006d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f20036000 tx=0x7f6f20030000 comp rx=0 tx=0).stop 2023-11-18T19:07:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2c155290 msgr2=0x7f6f2c06dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2c155290 0x7f6f2c06dbf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c430 tx=0x7f6f2400c8f0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 shutdown_connections 2023-11-18T19:07:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2c155290 0x7f6f2c06dbf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2c0c0ed0 0x7f6f2c1ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1006ae40 0x7f6f1006d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 --2- 172.21.15.45:0/3029394299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f2c0a99f0 0x7f6f2c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:15.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.905+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 >> 172.21.15.45:0/3029394299 conn(0x7f6f2c06a500 msgr2=0x7f6f2c152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:15.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.906+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 shutdown_connections 2023-11-18T19:07:15.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:15.906+0000 7f6f34690640 1 -- 172.21.15.45:0/3029394299 wait complete. 2023-11-18T19:07:16.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-18T19:06:37.510166+0000', 'modified': '2023-11-18T19:07:00.598223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6835/2364227676', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2364227676}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 2364227676}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-18T19:07:16.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-18T19:07:16.330 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-18T19:07:16.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.563+0000 7f9fc9861640 1 Processor -- start 2023-11-18T19:07:16.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.564+0000 7f9fc9861640 1 -- start start 2023-11-18T19:07:16.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.565+0000 7f9fc9861640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fc414e8b0 0x7f9fc40c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.565+0000 7f9fc9861640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9fc4155430 0x7f9fc40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.565+0000 7f9fc9861640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc40c4ef0 con 0x7f9fc406c840 2023-11-18T19:07:16.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.565+0000 7f9fc9861640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc4155010 con 0x7f9fc414e8b0 2023-11-18T19:07:16.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.565+0000 7f9fc9861640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc40c5400 con 0x7f9fc4155430 2023-11-18T19:07:16.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fc414e8b0 0x7f9fc40c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9fc414e8b0 0x7f9fc40c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56272/0 (socket says 172.21.15.45:56272) 2023-11-18T19:07:16.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1501434722 learned_addr learned my addr 172.21.15.45:0/1501434722 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:16.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/1501434722 >> v2:172.21.15.135:3300/0 conn(0x7f9fc4155430 0x7f9fc40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1501434722 >> v2:172.21.15.135:3300/0 conn(0x7f9fc4155430 msgr2=0x7f9fc40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1501434722 >> v2:172.21.15.135:3300/0 conn(0x7f9fc4155430 0x7f9fc40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1501434722 >> v1:172.21.15.135:6789/0 conn(0x7f9fc406c840 legacy=0x7f9fc4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.566+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1501434722 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40c6350 con 0x7f9fc414e8b0 2023-11-18T19:07:16.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.568+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1501434722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40c49b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40a9a80 tx=0x7f9fb402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d66253344907b32 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:16.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.568+0000 7f9fc27fc640 1 -- 172.21.15.45:0/1501434722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40317e0 con 0x7f9fc414e8b0 2023-11-18T19:07:16.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.568+0000 7f9fc27fc640 1 -- 172.21.15.45:0/1501434722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4031940 con 0x7f9fc414e8b0 2023-11-18T19:07:16.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.568+0000 7f9fc27fc640 1 -- 172.21.15.45:0/1501434722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4031cd0 con 0x7f9fc414e8b0 2023-11-18T19:07:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 -- 172.21.15.45:0/1501434722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc414e8b0 msgr2=0x7f9fc40c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 --2- 172.21.15.45:0/1501434722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40c49b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40a9a80 tx=0x7f9fb402b880 comp rx=0 tx=0).stop 2023-11-18T19:07:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 -- 172.21.15.45:0/1501434722 shutdown_connections 2023-11-18T19:07:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 --2- 172.21.15.45:0/1501434722 >> v2:172.21.15.135:3300/0 conn(0x7f9fc4155430 0x7f9fc40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 --2- 172.21.15.45:0/1501434722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40c49b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 -- 172.21.15.45:0/1501434722 >> 172.21.15.45:0/1501434722 conn(0x7f9fc40663d0 msgr2=0x7f9fc40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 -- 172.21.15.45:0/1501434722 shutdown_connections 2023-11-18T19:07:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.569+0000 7f9fc9861640 1 -- 172.21.15.45:0/1501434722 wait complete. 2023-11-18T19:07:16.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.571+0000 7f9fc9861640 1 Processor -- start 2023-11-18T19:07:16.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.571+0000 7f9fc9861640 1 -- start start 2023-11-18T19:07:16.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc9861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc406c840 0x7f9fc40c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc9861640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc9861640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fc4155430 0x7f9fc40ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc9861640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40aca50 con 0x7f9fc406c840 2023-11-18T19:07:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc9861640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40af840 con 0x7f9fc414e8b0 2023-11-18T19:07:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc9861640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40afae0 con 0x7f9fc4155430 2023-11-18T19:07:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc406c840 0x7f9fc40c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc406c840 0x7f9fc40c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56276/0 (socket says 172.21.15.45:56276) 2023-11-18T19:07:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.572+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/773973507 learned_addr learned my addr 172.21.15.45:0/773973507 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:16.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fc4155430 0x7f9fc40ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fc4155430 msgr2=0x7f9fc40ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fc4155430 0x7f9fc40ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fc414e8b0 msgr2=0x7f9fc40ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/773973507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb40094d0 con 0x7f9fc406c840 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fc4155430 0x7f9fc40ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.573+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc406c840 0x7f9fc40c3540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9fb402b8c0 tx=0x7f9fb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.574+0000 7f9fc0ff9640 1 -- 172.21.15.45:0/773973507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4032880 con 0x7f9fc406c840 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.574+0000 7f9fc0ff9640 1 -- 172.21.15.45:0/773973507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4032a00 con 0x7f9fc406c840 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.574+0000 7f9fc0ff9640 1 -- 172.21.15.45:0/773973507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4032db0 con 0x7f9fc406c840 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.574+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc40ac770 con 0x7f9fc406c840 2023-11-18T19:07:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.574+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc40c3a80 con 0x7f9fc406c840 2023-11-18T19:07:16.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.576+0000 7f9fc0ff9640 1 -- 172.21.15.45:0/773973507 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fb40453f0 con 0x7f9fc406c840 2023-11-18T19:07:16.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.577+0000 7f9fc0ff9640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9fa406ae70 0x7f9fa406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.577+0000 7f9fc0ff9640 1 -- 172.21.15.45:0/773973507 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fb40aba90 con 0x7f9fc406c840 2023-11-18T19:07:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.577+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9fa406ae70 0x7f9fa406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.578+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9fa406ae70 0x7f9fa406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40ab420 tx=0x7f9fac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:16.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.578+0000 7f9fcc3f6740 1 Processor -- start 2023-11-18T19:07:16.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.579+0000 7f9fcc3f6740 1 -- start start 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.579+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.579+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.579+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.579+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56306a02d880 con 0x56306a0d05f0 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.579+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56306a03cae0 con 0x56306a10d0b0 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.579+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56306a03a1d0 con 0x56306a1098a0 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56280/0 (socket says 172.21.15.45:56280) 2023-11-18T19:07:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 -- 172.21.15.45:0/2193223776 learned_addr learned my addr 172.21.15.45:0/2193223776 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 -- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 msgr2=0x56306a109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 -- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 msgr2=0x56306a0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 -- 172.21.15.45:0/2193223776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563069ffd860 con 0x56306a0d05f0 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.580+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10cb70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fac007fa0 tx=0x7f9fac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c05101150ba4a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.581+0000 7f9fb97fa640 1 -- 172.21.15.45:0/2193223776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac01d070 con 0x56306a0d05f0 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.581+0000 7f9fb97fa640 1 -- 172.21.15.45:0/2193223776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac0069e0 con 0x56306a0d05f0 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.581+0000 7f9fb97fa640 1 -- 172.21.15.45:0/2193223776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac006b70 con 0x56306a0d05f0 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.581+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/2193223776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 msgr2=0x56306a10cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.581+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10cb70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fac007fa0 tx=0x7f9fac011000 comp rx=0 tx=0).stop 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/2193223776 shutdown_connections 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10cb70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/2193223776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/2193223776 >> 172.21.15.45:0/2193223776 conn(0x56306a090bb0 msgr2=0x56306a0f0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:16.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/2193223776 shutdown_connections 2023-11-18T19:07:16.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/2193223776 wait complete. 2023-11-18T19:07:16.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.582+0000 7f9fcc3f6740 1 -- start start 2023-11-18T19:07:16.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.583+0000 7f9fcc3f6740 1 Processor -- start 2023-11-18T19:07:16.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a0f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a1098a0 0x56306a11e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a10d0b0 0x56306a0ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56306a035ac0 con 0x56306a10d0b0 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069fd22f0 con 0x56306a1098a0 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x563069fefc70 con 0x56306a0d05f0 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fcc3f6740 10 client.0 _ll_register_callbacks cb 0x563069ff43b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a10d0b0 0x56306a0ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a10d0b0 0x56306a0ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56296/0 (socket says 172.21.15.45:56296) 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 -- 172.21.15.45:0/1285545645 learned_addr learned my addr 172.21.15.45:0/1285545645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a0f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a1098a0 0x56306a11e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 -- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 msgr2=0x56306a0f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a0f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 -- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a1098a0 msgr2=0x56306a11e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a1098a0 0x56306a11e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.584+0000 7f9fc37fe640 1 -- 172.21.15.45:0/1285545645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac00f040 con 0x56306a10d0b0 2023-11-18T19:07:16.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.585+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a10d0b0 0x56306a0ed5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007a40 tx=0x7f9fbc007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a23acaa2fb3a9a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:16.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.585+0000 7f9fa27fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-18T19:07:16.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1285545645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc010ad0 con 0x56306a10d0b0 2023-11-18T19:07:16.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1285545645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fbc010c30 con 0x56306a10d0b0 2023-11-18T19:07:16.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56306a02eaa0 con 0x56306a10d0b0 2023-11-18T19:07:16.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1285545645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fbc010e10 con 0x56306a10d0b0 2023-11-18T19:07:16.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fcc3f6740 10 client.4836 fetch_fsmap learned FSMap version 9 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56306a034140 con 0x56306a10d0b0 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1285545645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56306a02eaa0 con 0x56306a10d0b0 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1285545645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9fbc01f350 con 0x56306a10d0b0 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fcc3f6740 10 client.4836 fetch_fsmap finished waiting for FSMap version 9 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fcc3f6740 10 client.4836 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fcc3f6740 20 client.4836 populate_metadata read hostname 'smithi045' 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.586+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a11af40 0x56306a11b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.587+0000 7f9fcc3f6740 4 client.4836 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.587+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 --> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56306a02e7c0 con 0x56306a11af40 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.587+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a11af40 0x56306a11b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.588+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a11af40 0x56306a11b320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c92343c6afe389af server_cookie=af94ec12f5dcb7c9 in_seq=0 out_seq=0 2023-11-18T19:07:16.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.588+0000 7f9fa27fc640 10 client.4836 ms_handle_connect on v2:172.21.15.135:6834/2364227676 2023-11-18T19:07:16.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.590+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1285545645 <== mds.0 v2:172.21.15.135:6834/2364227676 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56306a02e7c0 con 0x56306a11af40 2023-11-18T19:07:16.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.590+0000 7f9fa27fc640 10 client.4836 handle_command_reply: tid=0 2023-11-18T19:07:16.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.590+0000 7f9fcc3f6740 1 client.4836 shutdown 2023-11-18T19:07:16.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a10d0b0 msgr2=0x56306a0ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a10d0b0 0x56306a0ed5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007a40 tx=0x7f9fbc007f00 comp rx=0 tx=0).stop 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 shutdown_connections 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a11af40 0x56306a11b320 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a10d0b0 0x56306a0ed5f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a1098a0 0x56306a11e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1285545645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a0f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fa27fc640 0 client.4836 ms_handle_reset on v2:172.21.15.135:6834/2364227676 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 >> 172.21.15.45:0/1285545645 conn(0x56306a090bb0 msgr2=0x56306a0c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 shutdown_connections 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1285545645 wait complete. 2023-11-18T19:07:16.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.591+0000 7f9fcc3f6740 20 client.4836 trim_cache size 0 max 16384 2023-11-18T19:07:16.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.608+0000 7f9fcc3f6740 1 Processor -- start 2023-11-18T19:07:16.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.608+0000 7f9fcc3f6740 1 -- start start 2023-11-18T19:07:16.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a10ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a1098a0 0x56306a0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a12db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069d98f20 con 0x56306a1098a0 2023-11-18T19:07:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56306a10d9d0 con 0x56306a10d0b0 2023-11-18T19:07:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56306a11f2d0 con 0x56306a0d05f0 2023-11-18T19:07:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a1098a0 0x56306a0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a1098a0 0x56306a0cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56310/0 (socket says 172.21.15.45:56310) 2023-11-18T19:07:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.609+0000 7f9fbbfff640 1 -- 172.21.15.45:0/42586409 learned_addr learned my addr 172.21.15.45:0/42586409 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:16.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a10ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a12db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fbbfff640 1 -- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 msgr2=0x56306a10ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a10ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fbbfff640 1 -- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 msgr2=0x56306a12db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a12db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fbbfff640 1 -- 172.21.15.45:0/42586409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563069fd1b80 con 0x56306a1098a0 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a1098a0 0x56306a0cb0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9fac003d10 tx=0x7f9fac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e7786b898a85dd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fb9ffb640 1 -- 172.21.15.45:0/42586409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac006d50 con 0x56306a1098a0 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fb9ffb640 1 -- 172.21.15.45:0/42586409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac005030 con 0x56306a1098a0 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.610+0000 7f9fb9ffb640 1 -- 172.21.15.45:0/42586409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0051c0 con 0x56306a1098a0 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/42586409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a1098a0 msgr2=0x56306a0cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a1098a0 0x56306a0cb0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9fac003d10 tx=0x7f9fac012000 comp rx=0 tx=0).stop 2023-11-18T19:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/42586409 shutdown_connections 2023-11-18T19:07:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a12db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a1098a0 0x56306a0cb0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/42586409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a0d05f0 0x56306a10ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/42586409 >> 172.21.15.45:0/42586409 conn(0x56306a090bb0 msgr2=0x56306a1116f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/42586409 shutdown_connections 2023-11-18T19:07:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.611+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/42586409 wait complete. 2023-11-18T19:07:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.612+0000 7f9fcc3f6740 1 -- start start 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.612+0000 7f9fcc3f6740 1 Processor -- start 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a1759d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fcc3f6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a1729b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56306a0c8f00 con 0x56306a0d05f0 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56306a1766f0 con 0x56306a10d0b0 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fcc3f6740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56306a0c8bc0 con 0x56306a1098a0 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fcc3f6740 10 client.0 _ll_register_callbacks cb 0x7f9fbc009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56318/0 (socket says 172.21.15.45:56318) 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1631964157 learned_addr learned my addr 172.21.15.45:0/1631964157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a1759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc37fe640 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a1729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 msgr2=0x56306a1759d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a1759d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 msgr2=0x56306a1729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.613+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a1729b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fc2ffd640 1 -- 172.21.15.45:0/1631964157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563069ffd860 con 0x56306a0d05f0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fc2ffd640 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10c620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4076a00 tx=0x7f9fb40069d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3017be410d38f66b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fa27fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1631964157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb407e650 con 0x56306a0d05f0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1631964157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fb4082800 con 0x56306a0d05f0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fac0069e0 con 0x56306a0d05f0 2023-11-18T19:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1631964157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb4076c10 con 0x56306a0d05f0 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fcc3f6740 10 client.4842 fetch_fsmap learned FSMap version 9 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.614+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563069ff7170 con 0x56306a0d05f0 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1631964157 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac0069e0 con 0x56306a0d05f0 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1631964157 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9fb40a3be0 con 0x56306a0d05f0 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fcc3f6740 10 client.4842 fetch_fsmap finished waiting for FSMap version 9 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fcc3f6740 10 client.4842 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fcc3f6740 20 client.4842 populate_metadata read hostname 'smithi045' 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a172ef0 0x56306a178c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fcc3f6740 4 client.4842 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 --> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563069d366c0 con 0x56306a172ef0 2023-11-18T19:07:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.615+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a172ef0 0x56306a178c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.616+0000 7f9fbbfff640 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a172ef0 0x56306a178c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3debddbf98a81c51 server_cookie=ccf8388e44b465c8 in_seq=0 out_seq=0 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.616+0000 7f9fa27fc640 10 client.4842 ms_handle_connect on v2:172.21.15.135:6834/2364227676 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fa27fc640 1 -- 172.21.15.45:0/1631964157 <== mds.0 v2:172.21.15.135:6834/2364227676 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563069d366c0 con 0x56306a172ef0 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fa27fc640 10 client.4842 handle_command_reply: tid=0 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 client.4842 shutdown 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 msgr2=0x56306a10c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10c620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4076a00 tx=0x7f9fb40069d0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 shutdown_connections 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:6834/2364227676,v1:172.21.15.135:6835/2364227676] conn(0x56306a172ef0 0x56306a178c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56306a10d0b0 0x56306a1729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56306a1098a0 0x56306a1759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 --2- 172.21.15.45:0/1631964157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56306a0d05f0 0x56306a10c620 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 >> 172.21.15.45:0/1631964157 conn(0x56306a090bb0 msgr2=0x56306a0ef710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fa27fc640 0 client.4842 ms_handle_reset on v2:172.21.15.135:6834/2364227676 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 shutdown_connections 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 1 -- 172.21.15.45:0/1631964157 wait complete. 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.617+0000 7f9fcc3f6740 20 client.4842 trim_cache size 0 max 16384 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "b96c09c0-a884-4d0b-a1ec-074e421eff36", 2023-11-18T19:07:16.622 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4270, 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 38.587555807999998, 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 9, 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 27, 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 27, 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 46.262318205 2023-11-18T19:07:16.623 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:07:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9fa406ae70 msgr2=0x7f9fa406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9fa406ae70 0x7f9fa406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40ab420 tx=0x7f9fac009040 comp rx=0 tx=0).stop 2023-11-18T19:07:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc406c840 msgr2=0x7f9fc40c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc406c840 0x7f9fc40c3540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9fb402b8c0 tx=0x7f9fb40046c0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 shutdown_connections 2023-11-18T19:07:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9fa406ae70 0x7f9fa406d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fc4155430 0x7f9fc40ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fc414e8b0 0x7f9fc40ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 --2- 172.21.15.45:0/773973507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc406c840 0x7f9fc40c3540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 >> 172.21.15.45:0/773973507 conn(0x7f9fc40663d0 msgr2=0x7f9fc40ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 shutdown_connections 2023-11-18T19:07:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:16.618+0000 7f9fc9861640 1 -- 172.21.15.45:0/773973507 wait complete. 2023-11-18T19:07:16.635 INFO:teuthology.run_tasks:Running task parallel... 2023-11-18T19:07:16.645 INFO:teuthology.task.parallel:starting parallel... 2023-11-18T19:07:16.645 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-11-18T19:07:16.646 INFO:teuthology.task.sequential:In sequential, running task ceph-fuse... 2023-11-18T19:07:16.647 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-18T19:07:16.647 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-11-18T19:07:16.647 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-18T19:07:16.647 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T19:07:16.647 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:16.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:16.648 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-18T19:07:16.648 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-11-18T19:07:16.648 INFO:teuthology.task.sequential:In sequential, running task kclient... 2023-11-18T19:07:16.651 INFO:tasks.kclient:Mounting kernel clients... 2023-11-18T19:07:16.652 INFO:tasks.kclient:config is {'client.1': {}} 2023-11-18T19:07:16.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:16.652 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-11-18T19:07:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-18T19:07:16.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:16.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-18T19:07:16.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:16.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-11-18T19:07:16.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:16.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-18T19:07:16.811 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-11-18T19:07:16.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T19:07:16.815 INFO:tasks.kclient:client.1 config is {} 2023-11-18T19:07:16.815 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-18T19:07:16.815 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:16.815 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T19:07:16.935 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-18T19:07:16.935 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-18T19:07:17.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.086+0000 7fcc19ffb640 1 Processor -- start 2023-11-18T19:07:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.086+0000 7fcc19ffb640 1 -- start start 2023-11-18T19:07:17.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.087+0000 7fcc19ffb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc14151c00 0x7fcc140c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.087+0000 7fcc19ffb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc140ca200 con 0x7fcc140bd590 2023-11-18T19:07:17.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.088+0000 7fcc19ffb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc14151fe0 con 0x7fcc140c7e00 2023-11-18T19:07:17.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.088+0000 7fcc19ffb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc140c5610 con 0x7fcc14151c00 2023-11-18T19:07:17.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.088+0000 7fcc13fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcc140bd590 0x7fcc1415ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48992/0 (socket says 172.21.15.45:48992) 2023-11-18T19:07:17.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.088+0000 7fcc13fff640 1 -- 172.21.15.45:0/1487019558 learned_addr learned my addr 172.21.15.45:0/1487019558 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:17.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.088+0000 7fcc137fe640 1 --2- 172.21.15.45:0/1487019558 >> v2:172.21.15.135:3300/0 conn(0x7fcc14151c00 0x7fcc140c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.088+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935062723 0 0) 0x7fcc140ca200 con 0x7fcc140bd590 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.088+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc00003520 con 0x7fcc140bd590 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604891579 0 0) 0x7fcc00003520 con 0x7fcc140bd590 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 >> v2:172.21.15.135:3300/0 conn(0x7fcc14151c00 msgr2=0x7fcc140c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 --2- 172.21.15.45:0/1487019558 >> v2:172.21.15.135:3300/0 conn(0x7fcc14151c00 0x7fcc140c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 >> v1:172.21.15.135:6789/0 conn(0x7fcc140c7e00 legacy=0x7fcc141545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc141586d0 con 0x7fcc140bd590 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fcc0c0019f0 con 0x7fcc140bd590 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 >> v1:172.21.15.45:6789/0 conn(0x7fcc140bd590 legacy=0x7fcc1415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc00003970 0x7fcc00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc00005180 0x7fcc0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140c5610 con 0x7fcc000047c0 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0000c120 con 0x7fcc00003970 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0000c2e0 con 0x7fcc00005180 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.089+0000 7fcc0bfff640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc13fff640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc00005180 0x7fcc0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc137fe640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc00003970 0x7fcc00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc0bfff640 1 -- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc00005180 msgr2=0x7fcc0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc0bfff640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc00005180 0x7fcc0000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc0bfff640 1 -- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc00003970 msgr2=0x7fcc00003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc0bfff640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc00003970 0x7fcc00003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc0bfff640 1 -- 172.21.15.45:0/1487019558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00003520 con 0x7fcc000047c0 2023-11-18T19:07:17.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc13fff640 1 -- 172.21.15.45:0/1487019558 reap_dead start 2023-11-18T19:07:17.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.090+0000 7fcc137fe640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc00003970 0x7fcc00003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:07:17.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.091+0000 7fcc0bfff640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc001750 tx=0x7fcc000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653076788ca3985f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.091+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0052d0 con 0x7fcc000047c0 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.091+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc02e050 con 0x7fcc000047c0 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.091+0000 7fcc12ffd640 1 -- 172.21.15.45:0/1487019558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc003830 con 0x7fcc000047c0 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.092+0000 7fcc19ffb640 1 -- 172.21.15.45:0/1487019558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc000047c0 msgr2=0x7fcc00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.092+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc001750 tx=0x7fcc000057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.092+0000 7fcc19ffb640 1 -- 172.21.15.45:0/1487019558 shutdown_connections 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.092+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/1487019558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.092+0000 7fcc19ffb640 1 -- 172.21.15.45:0/1487019558 >> 172.21.15.45:0/1487019558 conn(0x7fcc140663d0 msgr2=0x7fcc140667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.092+0000 7fcc19ffb640 1 -- 172.21.15.45:0/1487019558 shutdown_connections 2023-11-18T19:07:17.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.092+0000 7fcc19ffb640 1 -- 172.21.15.45:0/1487019558 wait complete. 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.094+0000 7fcc19ffb640 1 Processor -- start 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.094+0000 7fcc19ffb640 1 -- start start 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.095+0000 7fcc19ffb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc000047c0 0x7fcc141ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.095+0000 7fcc19ffb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc140aabc0 0x7fcc140bded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.095+0000 7fcc19ffb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc140be410 0x7fcc141ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.095+0000 7fcc19ffb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc141eae80 con 0x7fcc140be410 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.095+0000 7fcc19ffb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14157300 con 0x7fcc140aabc0 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.095+0000 7fcc19ffb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc141575e0 con 0x7fcc000047c0 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc140be410 0x7fcc141ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc140be410 0x7fcc141ed430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56340/0 (socket says 172.21.15.45:56340) 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 -- 172.21.15.45:0/3697312408 learned_addr learned my addr 172.21.15.45:0/3697312408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc137fe640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc000047c0 0x7fcc141ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc0bfff640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc140aabc0 0x7fcc140bded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 -- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc000047c0 msgr2=0x7fcc141ea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc000047c0 0x7fcc141ea940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 -- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc140aabc0 msgr2=0x7fcc140bded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc140aabc0 0x7fcc140bded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.096+0000 7fcc13fff640 1 -- 172.21.15.45:0/3697312408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140bf190 con 0x7fcc140be410 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.097+0000 7fcc13fff640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc140be410 0x7fcc141ed430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc140caeb0 tx=0x7fcc0c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.097+0000 7fcc10ff9640 1 -- 172.21.15.45:0/3697312408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00ea80 con 0x7fcc140be410 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.097+0000 7fcc10ff9640 1 -- 172.21.15.45:0/3697312408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00ec00 con 0x7fcc140be410 2023-11-18T19:07:17.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.097+0000 7fcc10ff9640 1 -- 172.21.15.45:0/3697312408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c013420 con 0x7fcc140be410 2023-11-18T19:07:17.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.097+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc140bf470 con 0x7fcc140be410 2023-11-18T19:07:17.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.097+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc140ab4f0 con 0x7fcc140be410 2023-11-18T19:07:17.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.098+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc140747c0 con 0x7fcc140be410 2023-11-18T19:07:17.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.100+0000 7fcc10ff9640 1 -- 172.21.15.45:0/3697312408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc0c013580 con 0x7fcc140be410 2023-11-18T19:07:17.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.101+0000 7fcc10ff9640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbf406ae70 0x7fcbf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.101+0000 7fcc10ff9640 1 -- 172.21.15.45:0/3697312408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc0c089ca0 con 0x7fcc140be410 2023-11-18T19:07:17.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.102+0000 7fcc137fe640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbf406ae70 0x7fcbf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.102+0000 7fcc137fe640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbf406ae70 0x7fcbf406d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcc140681a0 tx=0x7fcc04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:17.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.106+0000 7fcc10ff9640 1 -- 172.21.15.45:0/3697312408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc0c054a50 con 0x7fcc140be410 2023-11-18T19:07:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.130+0000 7f43b7fff640 1 Processor -- start 2023-11-18T19:07:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.131+0000 7f43b7fff640 1 -- start start 2023-11-18T19:07:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.132+0000 7f43b7fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f43b80bd520 0x7f43b8157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.132+0000 7f43b7fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b8155510 con 0x7f43b80c7d90 2023-11-18T19:07:17.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.132+0000 7f43b7fff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b8154f90 con 0x7f43b814e580 2023-11-18T19:07:17.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.132+0000 7f43b7fff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80ca4d0 con 0x7f43b80bd520 2023-11-18T19:07:17.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f43b80c7d90 0x7f43b8158190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48994/0 (socket says 172.21.15.45:48994) 2023-11-18T19:07:17.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b77fe640 1 -- 172.21.15.45:0/307320928 learned_addr learned my addr 172.21.15.45:0/307320928 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:07:17.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43affff640 1 --2- 172.21.15.45:0/307320928 >> v2:172.21.15.135:3300/0 conn(0x7f43b80bd520 0x7f43b8157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844962142 0 0) 0x7f43b8155510 con 0x7f43b80c7d90 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a4003520 con 0x7f43b80c7d90 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 297745635 0 0) 0x7f43a4003520 con 0x7f43b80c7d90 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 >> v2:172.21.15.135:3300/0 conn(0x7f43b80bd520 msgr2=0x7f43b8157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 --2- 172.21.15.45:0/307320928 >> v2:172.21.15.135:3300/0 conn(0x7f43b80bd520 0x7f43b8157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 >> v1:172.21.15.135:6789/0 conn(0x7f43b814e580 legacy=0x7f43b80c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b806cbb0 con 0x7f43b80c7d90 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.133+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f43b00019f0 con 0x7f43b80c7d90 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 >> v1:172.21.15.45:6789/0 conn(0x7f43b80c7d90 legacy=0x7f43b8158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b67fc640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a4003970 0x7f43a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b67fc640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b67fc640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a4005180 0x7f43a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80ca4d0 con 0x7f43a40047c0 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a400c120 con 0x7f43a4003970 2023-11-18T19:07:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a400c2e0 con 0x7f43a4005180 2023-11-18T19:07:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43affff640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b6ffd640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a4003970 0x7f43a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.134+0000 7f43b77fe640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a4005180 0x7f43a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.135+0000 7f43affff640 1 -- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a4005180 msgr2=0x7f43a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.135+0000 7f43affff640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a4005180 0x7f43a400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.135+0000 7f43affff640 1 -- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a4003970 msgr2=0x7f43a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:07:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.135+0000 7f43affff640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43a4003970 0x7f43a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.135+0000 7f43affff640 1 -- 172.21.15.45:0/307320928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4003520 con 0x7f43a40047c0 2023-11-18T19:07:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.135+0000 7f43b77fe640 1 -- 172.21.15.45:0/307320928 reap_dead start 2023-11-18T19:07:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.137+0000 7f43affff640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009ac0 tx=0x7f43a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85457b301421801f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.137+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a002c6b0 con 0x7f43a40047c0 2023-11-18T19:07:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.137+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a002c810 con 0x7f43a40047c0 2023-11-18T19:07:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.137+0000 7f43b67fc640 1 -- 172.21.15.45:0/307320928 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a002cba0 con 0x7f43a40047c0 2023-11-18T19:07:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.137+0000 7f43b7fff640 1 -- 172.21.15.45:0/307320928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a40047c0 msgr2=0x7f43a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.137+0000 7f43b7fff640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009ac0 tx=0x7f43a40057f0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.138+0000 7f43b7fff640 1 -- 172.21.15.45:0/307320928 shutdown_connections 2023-11-18T19:07:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.138+0000 7f43b7fff640 1 --2- 172.21.15.45:0/307320928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.138+0000 7f43b7fff640 1 -- 172.21.15.45:0/307320928 >> 172.21.15.45:0/307320928 conn(0x7f43b8066610 msgr2=0x7f43b8066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.138+0000 7f43b7fff640 1 -- 172.21.15.45:0/307320928 shutdown_connections 2023-11-18T19:07:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.138+0000 7f43b7fff640 1 -- 172.21.15.45:0/307320928 wait complete. 2023-11-18T19:07:17.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.140+0000 7f43b7fff640 1 Processor -- start 2023-11-18T19:07:17.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.140+0000 7f43b7fff640 1 -- start start 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a40047c0 0x7f43b81ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80bd930 0x7f43b80be230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b81edcd0 0x7f43b81e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b7fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80c3cb0 con 0x7f43b81edcd0 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b7fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80bf1f0 con 0x7f43b80bd930 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b7fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80c36f0 con 0x7f43a40047c0 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b81edcd0 0x7f43b81e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b81edcd0 0x7f43b81e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56354/0 (socket says 172.21.15.45:56354) 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b77fe640 1 -- 172.21.15.45:0/2900741111 learned_addr learned my addr 172.21.15.45:0/2900741111 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.141+0000 7f43b6ffd640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a40047c0 0x7f43b81ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43affff640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80bd930 0x7f43b80be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43b77fe640 1 -- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a40047c0 msgr2=0x7f43b81ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43b77fe640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a40047c0 0x7f43b81ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43b77fe640 1 -- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80bd930 msgr2=0x7f43b80be230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43b77fe640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80bd930 0x7f43b80be230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43b77fe640 1 -- 172.21.15.45:0/2900741111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80c39d0 con 0x7f43b81edcd0 2023-11-18T19:07:17.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43b6ffd640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a40047c0 0x7f43b81ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:07:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43b77fe640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b81edcd0 0x7f43b81e7030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f43b80c9dc0 tx=0x7f43b000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43af7fe640 1 -- 172.21.15.45:0/2900741111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000eb90 con 0x7f43b81edcd0 2023-11-18T19:07:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43af7fe640 1 -- 172.21.15.45:0/2900741111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b000ed10 con 0x7f43b81edcd0 2023-11-18T19:07:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.142+0000 7f43af7fe640 1 -- 172.21.15.45:0/2900741111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0013660 con 0x7f43b81edcd0 2023-11-18T19:07:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.143+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b80c1000 con 0x7f43b81edcd0 2023-11-18T19:07:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.143+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b81ee180 con 0x7f43b81edcd0 2023-11-18T19:07:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.144+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b8067910 con 0x7f43b81edcd0 2023-11-18T19:07:17.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.146+0000 7f43af7fe640 1 -- 172.21.15.45:0/2900741111 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43b00137c0 con 0x7f43b81edcd0 2023-11-18T19:07:17.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.147+0000 7f43af7fe640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f439806ae70 0x7f439806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:07:17.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.147+0000 7f43af7fe640 1 -- 172.21.15.45:0/2900741111 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43b0089ce0 con 0x7f43b81edcd0 2023-11-18T19:07:17.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.148+0000 7f43b6ffd640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f439806ae70 0x7f439806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:07:17.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.148+0000 7f43b6ffd640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f439806ae70 0x7f439806d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43a8000c00 tx=0x7f43a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:07:17.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.152+0000 7f43af7fe640 1 -- 172.21.15.45:0/2900741111 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43b0058520 con 0x7f43b81edcd0 2023-11-18T19:07:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.347+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcc14066a90 con 0x7fcc140be410 2023-11-18T19:07:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.348+0000 7fcc10ff9640 1 -- 172.21.15.45:0/3697312408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcc0c058070 con 0x7fcc140be410 2023-11-18T19:07:17.349 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-18T19:07:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.350+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbf406ae70 msgr2=0x7fcbf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.350+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbf406ae70 0x7fcbf406d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcc140681a0 tx=0x7fcc04008040 comp rx=0 tx=0).stop 2023-11-18T19:07:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.350+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc140be410 msgr2=0x7fcc141ed430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.350+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc140be410 0x7fcc141ed430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc140caeb0 tx=0x7fcc0c007bc0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.350+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 shutdown_connections 2023-11-18T19:07:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.350+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc140be410 0x7fcc141ed430 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.351+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc140aabc0 0x7fcc140bded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.351+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fcbf406ae70 0x7fcbf406d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.351+0000 7fcc19ffb640 1 --2- 172.21.15.45:0/3697312408 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc000047c0 0x7fcc141ea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.351+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 >> 172.21.15.45:0/3697312408 conn(0x7fcc140663d0 msgr2=0x7fcc1414d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.351+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 shutdown_connections 2023-11-18T19:07:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.351+0000 7fcc19ffb640 1 -- 172.21.15.45:0/3697312408 wait complete. 2023-11-18T19:07:17.370 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T19:07:17.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T19:07:17.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-11-18T19:07:17.370 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-18T19:07:17.370 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:17.370 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T19:07:17.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T19:07:17.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T19:07:17.371 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-18T19:07:17.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.371 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-11-18T19:07:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.388+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43b80c11f0 con 0x7f43b81edcd0 2023-11-18T19:07:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.388+0000 7f43af7fe640 1 -- 172.21.15.45:0/2900741111 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f43b00580b0 con 0x7f43b81edcd0 2023-11-18T19:07:17.390 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-18T19:07:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f439806ae70 msgr2=0x7f439806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f439806ae70 0x7f439806d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43a8000c00 tx=0x7f43a8009040 comp rx=0 tx=0).stop 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b81edcd0 msgr2=0x7f43b81e7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b81edcd0 0x7f43b81e7030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f43b80c9dc0 tx=0x7f43b000e530 comp rx=0 tx=0).stop 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 shutdown_connections 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b81edcd0 0x7f43b81e7030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43b80bd930 0x7f43b80be230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f439806ae70 0x7f439806d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 --2- 172.21.15.45:0/2900741111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43a40047c0 0x7f43b81ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 >> 172.21.15.45:0/2900741111 conn(0x7f43b8066610 msgr2=0x7f43b80ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 shutdown_connections 2023-11-18T19:07:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:17.391+0000 7f43b7fff640 1 -- 172.21.15.45:0/2900741111 wait complete. 2023-11-18T19:07:17.410 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-18T19:07:17.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-18T19:07:17.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-18T19:07:17.411 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-18T19:07:17.411 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:17.411 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-18T19:07:17.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-18T19:07:17.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-18T19:07:17.411 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-18T19:07:17.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.411 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-18T19:07:17.430 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.431 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42359sec preferred_lft 42359sec 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2023-11-18T19:07:17.432 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:07:17.433 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T19:07:17.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.433 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-11-18T19:07:17.433 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-11-18T19:07:17.433 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2023-11-18T19:07:17.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2023-11-18T19:07:17.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2023-11-18T19:07:17.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T19:07:17.434 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-11-18T19:07:17.510 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-18T19:07:17.511 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-18T19:07:17.511 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-18T19:07:17.511 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:07:17.511 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-18T19:07:17.511 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:07:17.511 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:07:17.511 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42344sec preferred_lft 42344sec 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-18T19:07:17.512 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-18T19:07:17.513 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-18T19:07:17.513 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-18T19:07:17.513 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-18T19:07:17.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.514 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:07:17.514 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:07:17.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-11-18T19:07:17.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-11-18T19:07:17.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-11-18T19:07:17.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-18T19:07:17.514 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:07:17.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.758 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T19:07:17.836 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-18T19:07:17.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.840 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-18T19:07:17.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.880 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-18T19:07:17.886 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-18T19:07:17.886 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T19:07:17.886 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-18T19:07:17.886 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-18T19:07:17.887 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T19:07:17.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.888 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:07:17.888 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:07:17.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-18T19:07:17.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-18T19:07:17.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-18T19:07:17.888 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:07:17.956 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-11-18T19:07:17.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:17.960 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-11-18T19:07:18.008 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-11-18T19:07:18.008 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-18T19:07:18.008 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-18T19:07:18.008 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-18T19:07:18.008 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-18T19:07:18.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.009 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-11-18T19:07:18.009 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-11-18T19:07:18.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-18T19:07:18.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-18T19:07:18.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-18T19:07:18.009 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-11-18T19:07:18.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.127 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-18T19:07:18.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.179 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-11-18T19:07:18.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.235 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:07:18.236 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:07:18.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:07:18.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-18T19:07:18.236 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:07:18.382 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-18T19:07:18.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-18T19:07:18.383 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:07:18.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.650 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-18T19:07:18.650 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-18T19:07:18.650 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-18T19:07:18.650 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T19:07:18.650 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-18T19:07:18.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.740 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-11-18T19:07:18.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.791 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-11-18T19:07:18.827 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-18T19:07:18.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T19:07:18.827 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:18.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:18.836 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-11-18T19:07:18.836 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-11-18T19:07:18.836 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T19:07:18.836 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-18T19:07:18.836 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-11-18T19:07:18.880 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-18T19:07:18.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T19:07:18.880 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:18.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-18T19:07:19.005 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-18T19:07:19.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:19.006 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-11-18T19:07:19.006 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-11-18T19:07:19.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-18T19:07:19.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-18T19:07:19.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-18T19:07:19.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-18T19:07:19.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-18T19:07:19.007 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-11-18T19:07:19.033 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T19:07:19.092 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-18T19:07:19.092 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-18T19:07:19.092 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T19:07:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-18T19:07:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-18T19:07:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-18T19:07:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-18T19:07:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-18T19:07:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-18T19:07:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T19:07:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T19:07:19.095 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T19:07:19.095 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T19:07:19.095 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-18T19:07:19.095 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-18T19:07:19.095 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T19:07:19.095 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T19:07:19.096 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T19:07:19.096 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T19:07:19.096 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-18T19:07:19.096 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:07:19.096 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:07:19.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:19.098 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-18T19:07:19.154 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-18T19:07:19.154 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-18T19:07:19.160 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-18T19:07:19.239 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T19:07:19.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:19.282 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-11-18T19:07:19.282 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-11-18T19:07:19.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2023-11-18T19:07:19.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2023-11-18T19:07:19.282 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-11-18T19:07:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-18T19:07:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-18T19:07:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-18T19:07:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-18T19:07:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-18T19:07:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-18T19:07:19.290 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-18T19:07:19.291 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T19:07:19.292 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T19:07:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T19:07:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-18T19:07:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:07:19.293 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:07:19.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:19.294 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-18T19:07:19.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-18T19:07:19.352+0000 7f5fd5441480 -1 init, newargv = 0x560f576ed3d0 newargc=15 2023-11-18T19:07:19.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[95384]: starting ceph client 2023-11-18T19:07:19.362 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[95384]: starting fuse 2023-11-18T19:07:19.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T19:07:19.438 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:19.481 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-18T19:07:19.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-18T19:07:19.481 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:19.574 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-18T19:07:19.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:19.575 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-18T19:07:19.726 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-18T19:07:19.726 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-18T19:07:20.220 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-18T19:07:20.221 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-18T19:07:20.221 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-11-18T19:07:20.221 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 1@b96c09c0-a884-4d0b-a1ec-074e421eff36.cephfs=/ 2023-11-18T19:07:20.221 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.135:3300/172.21.15.135:3301" will pass to kernel 2023-11-18T19:07:20.225 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-18T19:07:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2023-11-18T19:07:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-18T19:07:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2023-11-18T19:07:20.225 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-18T19:07:20.229 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-18T19:07:20.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:20.229 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:20.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:20.320 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T19:07:20.377 INFO:teuthology.orchestra.run.smithi135.stdout:client4532 2023-11-18T19:07:20.377 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:07:20.377 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:07:20.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:20.429 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T19:07:20.442 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-18T19:07:20.484 INFO:teuthology.orchestra.run.smithi135.stdout:client4532 2023-11-18T19:07:20.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:20.484 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-18T19:07:20.541 INFO:teuthology.orchestra.run.smithi135.stdout:client4532 2023-11-18T19:07:20.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:20.542 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b96c09c0-a884-4d0b-a1ec-074e421eff36.client4532/status') 2023-11-18T19:07:20.556 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-18T19:07:20.621 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-18T19:07:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:07:20.623 INFO:teuthology.orchestra.run.smithi045.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:20.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:20.624 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-18T19:07:20.633 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.4532 (3)192.168.0.1:0/2743056373 2023-11-18T19:07:20.633 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2023-11-18T19:07:20.633 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2023-11-18T19:07:20.634 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2023-11-18T19:07:20.634 INFO:teuthology.orchestra.run.smithi135.stderr:69 bytes copied, 6.545e-05 s, 1.1 MB/s 2023-11-18T19:07:20.637 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-11-18T19:07:20.640 INFO:tasks.workunit:Pulling workunits from ref b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:07:20.641 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-18T19:07:20.641 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:20.682 INFO:teuthology.orchestra.run.smithi045.stdout:41 2023-11-18T19:07:20.682 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-18T19:07:20.682 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-18T19:07:20.683 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-18T19:07:20.684 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-18T19:07:20.694 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:20.694 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-11-18T19:07:20.695 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 27h/39d Inode: 1 Links: 2 2023-11-18T19:07:20.695 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:07:20.695 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:unlabeled_t:s0 2023-11-18T19:07:20.695 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-18T19:07:20.695 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-11-18 19:06:38.033091172 +0000 2023-11-18T19:07:20.695 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-11-18 19:06:51.750513370 +0000 2023-11-18T19:07:20.695 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-11-18 19:06:38.033091172 +0000 2023-11-18T19:07:20.695 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-11-18T19:07:20.695 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-11-18T19:07:20.795 INFO:tasks.workunit:timeout=3h 2023-11-18T19:07:20.795 INFO:tasks.workunit:cleanup=True 2023-11-18T19:07:20.796 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:07:20.853 INFO:tasks.workunit.client.1.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-11-18T19:07:20.871 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.95384.asok 2023-11-18T19:07:20.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:07:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-18T19:07:20.890 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.95384.asok 2023-11-18T19:07:20.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:20.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.95384.asok status 2023-11-18T19:07:21.138 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe", 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7418-gb0f45a51 (b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe) reef (dev)", 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "95384", 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-18T19:07:21.139 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4863, 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4863 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-18T19:07:21.140 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-18T19:07:21.141 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-18T19:07:21.141 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2247194737 2023-11-18T19:07:21.141 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-18T19:07:21.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:07:21.141 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-18T19:07:21.142 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-18T19:07:21.142 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-18T19:07:21.142 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2247194737 2023-11-18T19:07:21.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-18T19:07:21.142 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4863 192.168.0.1:0/2247194737", 2023-11-18T19:07:21.142 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/2247194737", 2023-11-18T19:07:21.143 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-18T19:07:21.143 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 9, 2023-11-18T19:07:21.143 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 27, 2023-11-18T19:07:21.143 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 27, 2023-11-18T19:07:21.143 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-18T19:07:21.143 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-18T19:07:21.143 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:07:21.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:21.154 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-18T19:07:21.154 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:21.212 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-18T19:07:21.212 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:21.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:07:21.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:21.318 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-11-18T19:07:21.318 INFO:tasks.workunit:Pulling workunits from ref b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:07:21.318 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-18T19:07:21.319 DEBUG:teuthology.orchestra.run.smithi045:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 29h/41d Inode: 1 Links: 3 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:fusefs_t:s0 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-18 19:07:20.782875674 +0000 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-18 19:07:20.782875674 +0000 2023-11-18T19:07:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-11-18T19:07:21.376 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-18T19:07:21.376 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-18T19:07:21.491 INFO:tasks.workunit:timeout=3h 2023-11-18T19:07:21.492 INFO:tasks.workunit:cleanup=True 2023-11-18T19:07:21.492 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe 2023-11-18T19:07:21.559 INFO:tasks.workunit.client.0.smithi045.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-18T19:07:35.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:07:35.314 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:08:05.645 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:08:05.652 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:08:12.061 INFO:tasks.workunit.client.1.smithi135.stderr:Updating files: 68% (7978/11620) Updating files: 69% (8018/11620) Updating files: 70% (8134/11620) Updating files: 71% (8251/11620) Updating files: 72% (8367/11620) Updating files: 73% (8483/11620) Updating files: 74% (8599/11620) Updating files: 75% (8715/11620) Updating files: 76% (8832/11620) Updating files: 77% (8948/11620) Updating files: 78% (9064/11620) Updating files: 79% (9180/11620) Updating files: 80% (9296/11620) Updating files: 81% (9413/11620) Updating files: 82% (9529/11620) Updating files: 83% (9645/11620) Updating files: 84% (9761/11620) Updating files: 85% (9877/11620) Updating files: 86% (9994/11620) Updating files: 87% (10110/11620) Updating files: 88% (10226/11620) Updating files: 89% (10342/11620) Updating files: 90% (10458/11620) Updating files: 91% (10575/11620) Updating files: 92% (10691/11620) Updating files: 93% (10807/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr:Note: switching to 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'. 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr:state without impacting any branches by switching back to a branch. 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:12.883 INFO:tasks.workunit.client.1.smithi135.stderr: git switch -c 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr:Or undo this operation with: 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr: git switch - 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:12.884 INFO:tasks.workunit.client.1.smithi135.stderr:HEAD is now at b0f45a51a24 Merge pull request #54530 from yuw1/fix_typo 2023-11-18T19:08:12.895 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-11-18T19:08:12.956 INFO:tasks.workunit.client.1.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-18T19:08:12.963 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-11-18T19:08:12.963 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-18T19:08:13.793 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-18T19:08:13.908 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-18T19:08:13.988 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-11-18T19:08:13.996 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-11-18T19:08:13.996 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-18T19:08:14.077 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-11-18T19:08:14.086 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:08:14.086 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-11-18T19:08:14.135 INFO:tasks.workunit:Running workunits matching kernel_untar_build.sh on client.1... 2023-11-18T19:08:14.136 INFO:tasks.workunit:Running workunit kernel_untar_build.sh... 2023-11-18T19:08:14.136 DEBUG:teuthology.orchestra.run.smithi135:workunit test kernel_untar_build.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh 2023-11-18T19:08:14.257 INFO:tasks.workunit.client.1.smithi135.stderr:+ wget -O linux.tar.gz http://download.ceph.com/qa/linux-5.4.tar.gz 2023-11-18T19:08:14.297 INFO:tasks.workunit.client.1.smithi135.stderr:--2023-11-18 19:08:14-- http://download.ceph.com/qa/linux-5.4.tar.gz 2023-11-18T19:08:14.307 INFO:tasks.workunit.client.1.smithi135.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-11-18T19:08:14.395 INFO:tasks.workunit.client.1.smithi135.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-11-18T19:08:14.488 INFO:tasks.workunit.client.1.smithi135.stderr:HTTP request sent, awaiting response... 200 OK 2023-11-18T19:08:14.488 INFO:tasks.workunit.client.1.smithi135.stderr:Length: 172616875 (165M) [application/octet-stream] 2023-11-18T19:08:14.488 INFO:tasks.workunit.client.1.smithi135.stderr:Saving to: ‘linux.tar.gz’ 2023-11-18T19:08:14.498 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:08:14.671 INFO:tasks.workunit.client.1.smithi135.stderr: 0K .......... .......... .......... .......... .......... 0% 275K 10m14s 2023-11-18T19:08:14.847 INFO:tasks.workunit.client.1.smithi135.stderr: 50K .......... .......... .......... .......... .......... 0% 538K 7m43s 2023-11-18T19:08:14.934 INFO:tasks.workunit.client.1.smithi135.stderr: 100K .......... .......... .......... .......... .......... 0% 293K 8m20s 2023-11-18T19:08:15.018 INFO:tasks.workunit.client.1.smithi135.stderr: 150K .......... .......... .......... .......... .......... 0% 594K 7m26s 2023-11-18T19:08:15.191 INFO:tasks.workunit.client.1.smithi135.stderr: 200K .......... .......... .......... .......... .......... 0% 290K 7m53s 2023-11-18T19:08:15.260 INFO:tasks.workunit.client.0.smithi045.stderr:Updating files: 63% (7435/11620) Updating files: 64% (7437/11620) Updating files: 65% (7553/11620) Updating files: 66% (7670/11620) Updating files: 67% (7786/11620) Updating files: 68% (7902/11620) Updating files: 69% (8018/11620) Updating files: 70% (8134/11620) Updating files: 71% (8251/11620) Updating files: 72% (8367/11620) Updating files: 73% (8483/11620) Updating files: 74% (8599/11620) Updating files: 75% (8715/11620) Updating files: 76% (8832/11620) Updating files: 77% (8948/11620) Updating files: 78% (9064/11620) Updating files: 79% (9180/11620) Updating files: 80% (9296/11620) Updating files: 81% (9413/11620) Updating files: 82% (9529/11620) Updating files: 83% (9645/11620) Updating files: 84% (9761/11620) Updating files: 85% (9877/11620) Updating files: 86% (9994/11620) Updating files: 87% (10110/11620) Updating files: 88% (10226/11620) Updating files: 89% (10342/11620) Updating files: 90% (10458/11620) Updating files: 91% (10575/11620) Updating files: 92% (10691/11620) Updating files: 93% (10807/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-11-18T19:08:15.294 INFO:tasks.workunit.client.1.smithi135.stderr: 250K .......... .......... .......... .......... .......... 0% 484K 7m32s 2023-11-18T19:08:15.465 INFO:tasks.workunit.client.1.smithi135.stderr: 300K .......... .......... .......... .......... .......... 0% 294K 7m49s 2023-11-18T19:08:15.570 INFO:tasks.workunit.client.1.smithi135.stderr: 350K .......... .......... .......... .......... .......... 0% 474K 7m35s 2023-11-18T19:08:15.665 INFO:tasks.workunit.client.1.smithi135.stderr: 400K .......... .......... .......... .......... .......... 0% 521K 7m20s 2023-11-18T19:08:15.833 INFO:tasks.workunit.client.1.smithi135.stderr: 450K .......... .......... .......... .......... .......... 0% 299K 7m32s 2023-11-18T19:08:15.921 INFO:tasks.workunit.client.1.smithi135.stderr: 500K .......... .......... .......... .......... .......... 0% 575K 7m17s 2023-11-18T19:08:16.017 INFO:tasks.workunit.client.1.smithi135.stderr: 550K .......... .......... .......... .......... .......... 0% 511K 7m8s 2023-11-18T19:08:16.106 INFO:tasks.workunit.client.1.smithi135.stderr: 600K .......... .......... .......... .......... .......... 0% 562K 6m58s 2023-11-18T19:08:16.168 INFO:tasks.workunit.client.0.smithi045.stderr:Note: switching to 'b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe'. 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr:state without impacting any branches by switching back to a branch. 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr: git switch -c 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:16.169 INFO:tasks.workunit.client.0.smithi045.stderr:Or undo this operation with: 2023-11-18T19:08:16.170 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:16.170 INFO:tasks.workunit.client.0.smithi045.stderr: git switch - 2023-11-18T19:08:16.170 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:16.170 INFO:tasks.workunit.client.0.smithi045.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-18T19:08:16.170 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:16.170 INFO:tasks.workunit.client.0.smithi045.stderr:HEAD is now at b0f45a51a24 Merge pull request #54530 from yuw1/fix_typo 2023-11-18T19:08:16.182 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-18T19:08:16.196 INFO:tasks.workunit.client.1.smithi135.stderr: 650K .......... .......... .......... .......... .......... 0% 555K 6m50s 2023-11-18T19:08:16.245 INFO:tasks.workunit.client.0.smithi045.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-18T19:08:16.253 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-18T19:08:16.253 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-18T19:08:16.329 INFO:tasks.workunit.client.1.smithi135.stderr: 700K .......... .......... .......... .......... .......... 0% 377K 6m52s 2023-11-18T19:08:16.459 INFO:tasks.workunit.client.1.smithi135.stderr: 750K .......... .......... .......... .......... .......... 0% 382K 6m53s 2023-11-18T19:08:16.554 INFO:tasks.workunit.client.1.smithi135.stderr: 800K .......... .......... .......... .......... .......... 0% 529K 6m48s 2023-11-18T19:08:16.651 INFO:tasks.workunit.client.1.smithi135.stderr: 850K .......... .......... .......... .......... .......... 0% 515K 6m43s 2023-11-18T19:08:16.745 INFO:tasks.workunit.client.1.smithi135.stderr: 900K .......... .......... .......... .......... .......... 0% 533K 6m38s 2023-11-18T19:08:16.836 INFO:tasks.workunit.client.1.smithi135.stderr: 950K .......... .......... .......... .......... .......... 0% 547K 6m33s 2023-11-18T19:08:16.946 INFO:tasks.workunit.client.1.smithi135.stderr: 1000K .......... .......... .......... .......... .......... 0% 527K 6m30s 2023-11-18T19:08:17.021 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-18T19:08:17.032 INFO:tasks.workunit.client.1.smithi135.stderr: 1050K .......... .......... .......... .......... .......... 0% 573K 6m25s 2023-11-18T19:08:17.112 INFO:tasks.workunit.client.1.smithi135.stderr: 1100K .......... .......... .......... .......... .......... 0% 530K 6m22s 2023-11-18T19:08:17.193 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-18T19:08:17.194 INFO:tasks.workunit.client.1.smithi135.stderr: 1150K .......... .......... .......... .......... .......... 0% 613K 6m17s 2023-11-18T19:08:17.277 INFO:tasks.workunit.client.1.smithi135.stderr: 1200K .......... .......... .......... .......... .......... 0% 754K 6m11s 2023-11-18T19:08:17.283 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-18T19:08:17.291 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-18T19:08:17.291 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-18T19:08:17.341 INFO:tasks.workunit.client.1.smithi135.stderr: 1250K .......... .......... .......... .......... .......... 0% 617K 6m7s 2023-11-18T19:08:17.370 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-18T19:08:17.380 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:08:17.380 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-18T19:08:17.426 INFO:tasks.workunit.client.1.smithi135.stderr: 1300K .......... .......... .......... .......... .......... 0% 592K 6m4s 2023-11-18T19:08:17.438 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2023-11-18T19:08:17.439 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2023-11-18T19:08:17.439 DEBUG:teuthology.orchestra.run.smithi045:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2023-11-18T19:08:17.513 INFO:tasks.workunit.client.1.smithi135.stderr: 1350K .......... .......... .......... .......... .......... 0% 575K 6m1s 2023-11-18T19:08:17.534 INFO:tasks.workunit.client.0.smithi045.stdout:getting blogbench 2023-11-18T19:08:17.535 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'getting blogbench' 2023-11-18T19:08:17.535 INFO:tasks.workunit.client.0.smithi045.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-11-18T19:08:17.573 INFO:tasks.workunit.client.0.smithi045.stderr:--2023-11-18 19:08:17-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-11-18T19:08:17.575 INFO:tasks.workunit.client.0.smithi045.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-11-18T19:08:17.597 INFO:tasks.workunit.client.1.smithi135.stderr: 1400K .......... .......... .......... .......... .......... 0% 592K 5m58s 2023-11-18T19:08:17.649 INFO:tasks.workunit.client.0.smithi045.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-11-18T19:08:17.687 INFO:tasks.workunit.client.1.smithi135.stderr: 1450K .......... .......... .......... .......... .......... 0% 560K 5m56s 2023-11-18T19:08:17.726 INFO:tasks.workunit.client.0.smithi045.stderr:HTTP request sent, awaiting response... 200 OK 2023-11-18T19:08:17.727 INFO:tasks.workunit.client.0.smithi045.stderr:Length: 103355 (101K) [application/octet-stream] 2023-11-18T19:08:17.733 INFO:tasks.workunit.client.0.smithi045.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2023-11-18T19:08:17.744 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:17.775 INFO:tasks.workunit.client.1.smithi135.stderr: 1500K .......... .......... .......... .......... .......... 0% 568K 5m54s 2023-11-18T19:08:17.837 INFO:tasks.workunit.client.1.smithi135.stderr: 1550K .......... .......... .......... .......... .......... 0% 799K 5m50s 2023-11-18T19:08:17.881 INFO:tasks.workunit.client.0.smithi045.stderr: 0K .......... .......... .......... .......... .......... 49% 342K 0s 2023-11-18T19:08:17.904 INFO:tasks.workunit.client.1.smithi135.stderr: 1600K .......... .......... .......... .......... .......... 0% 750K 5m46s 2023-11-18T19:08:17.997 INFO:tasks.workunit.client.1.smithi135.stderr: 1650K .......... .......... .......... .......... .......... 1% 542K 5m44s 2023-11-18T19:08:18.036 INFO:tasks.workunit.client.0.smithi045.stderr: 50K .......... .......... .......... .......... .......... 99% 600K 0s 2023-11-18T19:08:18.036 INFO:tasks.workunit.client.0.smithi045.stderr: 100K 100% 13.0K=0.3s 2023-11-18T19:08:18.036 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:18.038 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-18 19:08:18 (335 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2023-11-18T19:08:18.039 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-18T19:08:18.040 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2023-11-18T19:08:18.111 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/ 2023-11-18T19:08:18.115 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/m4/ 2023-11-18T19:08:18.121 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/m4/acx_pthread.m4 2023-11-18T19:08:18.130 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/man/ 2023-11-18T19:08:18.137 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/man/blogbench.8 2023-11-18T19:08:18.139 INFO:tasks.workunit.client.1.smithi135.stderr: 1700K .......... .......... .......... .......... .......... 1% 351K 5m48s 2023-11-18T19:08:18.145 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/man/Makefile.am 2023-11-18T19:08:18.150 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/man/Makefile.in 2023-11-18T19:08:18.162 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/ 2023-11-18T19:08:18.169 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/mysnprintf.c 2023-11-18T19:08:18.177 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/mysnprintf.h 2023-11-18T19:08:18.177 INFO:tasks.workunit.client.1.smithi135.stderr: 1750K .......... .......... .......... .......... .......... 1% 1.28M 5m42s 2023-11-18T19:08:18.185 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/blogbench.c 2023-11-18T19:08:18.193 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/blogbench.h 2023-11-18T19:08:18.201 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/fakesnprintf.c 2023-11-18T19:08:18.210 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/fakesnprintf.h 2023-11-18T19:08:18.216 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/blogbench_p.h 2023-11-18T19:08:18.225 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/bsd-getopt_long.c 2023-11-18T19:08:18.233 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/bsd-getopt_long.h 2023-11-18T19:08:18.240 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/Makefile.am 2023-11-18T19:08:18.248 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/Makefile.in 2023-11-18T19:08:18.257 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/process.c 2023-11-18T19:08:18.265 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/globals.h 2023-11-18T19:08:18.272 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/commenter.c 2023-11-18T19:08:18.278 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/rewriter.c 2023-11-18T19:08:18.284 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/reader.c 2023-11-18T19:08:18.290 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/writer.c 2023-11-18T19:08:18.296 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/src/helpers.c 2023-11-18T19:08:18.302 INFO:tasks.workunit.client.1.smithi135.stderr: 1800K .......... .......... .......... .......... .......... 1% 399K 5m44s 2023-11-18T19:08:18.303 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/NEWS 2023-11-18T19:08:18.311 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/compile 2023-11-18T19:08:18.318 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/depcomp 2023-11-18T19:08:18.326 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/aclocal.m4 2023-11-18T19:08:18.334 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/README 2023-11-18T19:08:18.340 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/configure 2023-11-18T19:08:18.370 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/configure.ac 2023-11-18T19:08:18.378 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/config.guess 2023-11-18T19:08:18.389 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/install-sh 2023-11-18T19:08:18.390 INFO:tasks.workunit.client.1.smithi135.stderr: 1850K .......... .......... .......... .......... .......... 1% 569K 5m42s 2023-11-18T19:08:18.397 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/config.sub 2023-11-18T19:08:18.406 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/missing 2023-11-18T19:08:18.414 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/mkinstalldirs 2023-11-18T19:08:18.419 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/Makefile.am 2023-11-18T19:08:18.426 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/Makefile.in 2023-11-18T19:08:18.433 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/config.h.in 2023-11-18T19:08:18.441 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/AUTHORS 2023-11-18T19:08:18.447 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/INSTALL 2023-11-18T19:08:18.454 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/ChangeLog 2023-11-18T19:08:18.461 INFO:tasks.workunit.client.0.smithi045.stdout:blogbench-1.0/COPYING 2023-11-18T19:08:18.471 INFO:tasks.workunit.client.0.smithi045.stderr:+ cd blogbench-1.0/ 2023-11-18T19:08:18.478 INFO:tasks.workunit.client.0.smithi045.stdout:making blogbench 2023-11-18T19:08:18.478 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'making blogbench' 2023-11-18T19:08:18.478 INFO:tasks.workunit.client.0.smithi045.stderr:+ ./configure 2023-11-18T19:08:18.494 INFO:tasks.workunit.client.1.smithi135.stderr: 1900K .......... .......... .......... .......... .......... 1% 480K 5m42s 2023-11-18T19:08:18.582 INFO:tasks.workunit.client.1.smithi135.stderr: 1950K .......... .......... .......... .......... .......... 1% 567K 5m41s 2023-11-18T19:08:18.672 INFO:tasks.workunit.client.1.smithi135.stderr: 2000K .......... .......... .......... .......... .......... 1% 565K 5m40s 2023-11-18T19:08:18.761 INFO:tasks.workunit.client.1.smithi135.stderr: 2050K .......... .......... .......... .......... .......... 1% 554K 5m39s 2023-11-18T19:08:18.843 INFO:tasks.workunit.client.0.smithi045.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-11-18T19:08:18.851 INFO:tasks.workunit.client.1.smithi135.stderr: 2100K .......... .......... .......... .......... .......... 1% 556K 5m38s 2023-11-18T19:08:18.941 INFO:tasks.workunit.client.1.smithi135.stderr: 2150K .......... .......... .......... .......... .......... 1% 557K 5m37s 2023-11-18T19:08:19.032 INFO:tasks.workunit.client.1.smithi135.stderr: 2200K .......... .......... .......... .......... .......... 1% 546K 5m36s 2023-11-18T19:08:19.126 INFO:tasks.workunit.client.1.smithi135.stderr: 2250K .......... .......... .......... .......... .......... 1% 532K 5m35s 2023-11-18T19:08:19.220 INFO:tasks.workunit.client.1.smithi135.stderr: 2300K .......... .......... .......... .......... .......... 1% 531K 5m35s 2023-11-18T19:08:19.307 INFO:tasks.workunit.client.1.smithi135.stderr: 2350K .......... .......... .......... .......... .......... 1% 575K 5m34s 2023-11-18T19:08:19.385 INFO:tasks.workunit.client.1.smithi135.stderr: 2400K .......... .......... .......... .......... .......... 1% 644K 5m32s 2023-11-18T19:08:19.473 INFO:tasks.workunit.client.1.smithi135.stderr: 2450K .......... .......... .......... .......... .......... 1% 611K 5m31s 2023-11-18T19:08:19.557 INFO:tasks.workunit.client.1.smithi135.stderr: 2500K .......... .......... .......... .......... .......... 1% 814K 5m28s 2023-11-18T19:08:19.616 INFO:tasks.workunit.client.1.smithi135.stderr: 2550K .......... .......... .......... .......... .......... 1% 571K 5m27s 2023-11-18T19:08:19.689 INFO:tasks.workunit.client.1.smithi135.stderr: 2600K .......... .......... .......... .......... .......... 1% 679K 5m26s 2023-11-18T19:08:19.774 INFO:tasks.workunit.client.1.smithi135.stderr: 2650K .......... .......... .......... .......... .......... 1% 590K 5m25s 2023-11-18T19:08:19.863 INFO:tasks.workunit.client.1.smithi135.stderr: 2700K .......... .......... .......... .......... .......... 1% 562K 5m24s 2023-11-18T19:08:19.877 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether build environment is sane... yes 2023-11-18T19:08:19.934 INFO:tasks.workunit.client.0.smithi045.stdout:checking for gawk... gawk 2023-11-18T19:08:19.947 INFO:tasks.workunit.client.1.smithi135.stderr: 2750K .......... .......... .......... .......... .......... 1% 592K 5m23s 2023-11-18T19:08:19.993 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether make sets $(MAKE)... yes 2023-11-18T19:08:20.042 INFO:tasks.workunit.client.1.smithi135.stderr: 2800K .......... .......... .......... .......... .......... 1% 530K 5m23s 2023-11-18T19:08:20.054 INFO:tasks.workunit.client.0.smithi045.stdout:checking for gcc... gcc 2023-11-18T19:08:20.133 INFO:tasks.workunit.client.1.smithi135.stderr: 2850K .......... .......... .......... .......... .......... 1% 550K 5m22s 2023-11-18T19:08:20.201 INFO:tasks.workunit.client.1.smithi135.stderr: 2900K .......... .......... .......... .......... .......... 1% 730K 5m21s 2023-11-18T19:08:20.274 INFO:tasks.workunit.client.0.smithi045.stdout:checking for C compiler default output file name... a.out 2023-11-18T19:08:20.290 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether the C compiler works... yes 2023-11-18T19:08:20.296 INFO:tasks.workunit.client.1.smithi135.stderr: 2950K .......... .......... .......... .......... .......... 1% 532K 5m20s 2023-11-18T19:08:20.301 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether we are cross compiling... no 2023-11-18T19:08:20.476 INFO:tasks.workunit.client.0.smithi045.stdout:checking for suffix of executables... 2023-11-18T19:08:20.479 INFO:tasks.workunit.client.1.smithi135.stderr: 3000K .......... .......... .......... .......... .......... 1% 275K 5m25s 2023-11-18T19:08:20.479 INFO:tasks.workunit.client.1.smithi135.stderr: 3050K .......... .......... .......... .......... .......... 1% 54.0M 5m20s 2023-11-18T19:08:20.559 INFO:tasks.workunit.client.1.smithi135.stderr: 3100K .......... .......... .......... .......... .......... 1% 620K 5m19s 2023-11-18T19:08:20.614 INFO:tasks.workunit.client.0.smithi045.stdout:checking for suffix of object files... o 2023-11-18T19:08:20.664 INFO:tasks.workunit.client.1.smithi135.stderr: 3150K .......... .......... .......... .......... .......... 1% 478K 5m19s 2023-11-18T19:08:20.747 INFO:tasks.workunit.client.1.smithi135.stderr: 3200K .......... .......... .......... .......... .......... 1% 599K 5m18s 2023-11-18T19:08:20.760 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether we are using the GNU C compiler... yes 2023-11-18T19:08:20.844 INFO:tasks.workunit.client.1.smithi135.stderr: 3250K .......... .......... .......... .......... .......... 1% 517K 5m18s 2023-11-18T19:08:20.905 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether gcc accepts -g... yes 2023-11-18T19:08:20.932 INFO:tasks.workunit.client.1.smithi135.stderr: 3300K .......... .......... .......... .......... .......... 1% 566K 5m18s 2023-11-18T19:08:21.024 INFO:tasks.workunit.client.1.smithi135.stderr: 3350K .......... .......... .......... .......... .......... 2% 542K 5m18s 2023-11-18T19:08:21.081 INFO:tasks.workunit.client.0.smithi045.stdout:checking for gcc option to accept ANSI C... none needed 2023-11-18T19:08:21.116 INFO:tasks.workunit.client.1.smithi135.stderr: 3400K .......... .......... .......... .......... .......... 2% 546K 5m17s 2023-11-18T19:08:21.208 INFO:tasks.workunit.client.1.smithi135.stderr: 3450K .......... .......... .......... .......... .......... 2% 541K 5m17s 2023-11-18T19:08:21.283 INFO:tasks.workunit.client.0.smithi045.stdout:checking for style of include used by make... GNU 2023-11-18T19:08:21.301 INFO:tasks.workunit.client.1.smithi135.stderr: 3500K .......... .......... .......... .......... .......... 2% 537K 5m17s 2023-11-18T19:08:21.393 INFO:tasks.workunit.client.1.smithi135.stderr: 3550K .......... .......... .......... .......... .......... 2% 546K 5m16s 2023-11-18T19:08:21.481 INFO:tasks.workunit.client.1.smithi135.stderr: 3600K .......... .......... .......... .......... .......... 2% 566K 5m16s 2023-11-18T19:08:21.569 INFO:tasks.workunit.client.1.smithi135.stderr: 3650K .......... .......... .......... .......... .......... 2% 675K 5m15s 2023-11-18T19:08:21.641 INFO:tasks.workunit.client.1.smithi135.stderr: 3700K .......... .......... .......... .......... .......... 2% 581K 5m14s 2023-11-18T19:08:21.731 INFO:tasks.workunit.client.1.smithi135.stderr: 3750K .......... .......... .......... .......... .......... 2% 557K 5m14s 2023-11-18T19:08:21.764 INFO:tasks.workunit.client.0.smithi045.stdout:checking dependency style of gcc... gcc3 2023-11-18T19:08:21.767 INFO:tasks.workunit.client.0.smithi045.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-11-18T19:08:21.818 INFO:tasks.workunit.client.1.smithi135.stderr: 3800K .......... .......... .......... .......... .......... 2% 579K 5m14s 2023-11-18T19:08:21.896 INFO:tasks.workunit.client.1.smithi135.stderr: 3850K .......... .......... .......... .......... .......... 2% 634K 5m13s 2023-11-18T19:08:21.980 INFO:tasks.workunit.client.1.smithi135.stderr: 3900K .......... .......... .......... .......... .......... 2% 601K 5m12s 2023-11-18T19:08:22.001 INFO:tasks.workunit.client.0.smithi045.stdout:checking how to run the C preprocessor... gcc -E 2023-11-18T19:08:22.072 INFO:tasks.workunit.client.1.smithi135.stderr: 3950K .......... .......... .......... .......... .......... 2% 540K 5m12s 2023-11-18T19:08:22.120 INFO:tasks.workunit.client.1.smithi135.stderr: 4000K .......... .......... .......... .......... .......... 2% 1.01M 5m10s 2023-11-18T19:08:22.186 INFO:tasks.workunit.client.0.smithi045.stdout:checking for egrep... grep -E 2023-11-18T19:08:22.208 INFO:tasks.workunit.client.1.smithi135.stderr: 4050K .......... .......... .......... .......... .......... 2% 579K 5m10s 2023-11-18T19:08:22.238 INFO:tasks.workunit.client.0.smithi045.stdout:checking for AIX... no 2023-11-18T19:08:22.297 INFO:tasks.workunit.client.1.smithi135.stderr: 4100K .......... .......... .......... .......... .......... 2% 556K 5m9s 2023-11-18T19:08:22.367 INFO:tasks.workunit.client.1.smithi135.stderr: 4150K .......... .......... .......... .......... .......... 2% 708K 5m8s 2023-11-18T19:08:22.452 INFO:tasks.workunit.client.1.smithi135.stderr: 4200K .......... .......... .......... .......... .......... 2% 591K 5m8s 2023-11-18T19:08:22.529 INFO:tasks.workunit.client.1.smithi135.stderr: 4250K .......... .......... .......... .......... .......... 2% 680K 5m7s 2023-11-18T19:08:22.539 INFO:tasks.workunit.client.0.smithi045.stdout:checking for library containing strerror... none required 2023-11-18T19:08:22.611 INFO:tasks.workunit.client.1.smithi135.stderr: 4300K .......... .......... .......... .......... .......... 2% 584K 5m7s 2023-11-18T19:08:22.698 INFO:tasks.workunit.client.1.smithi135.stderr: 4350K .......... .......... .......... .......... .......... 2% 577K 5m6s 2023-11-18T19:08:22.745 INFO:tasks.workunit.client.1.smithi135.stderr: 4400K .......... .......... .......... .......... .......... 2% 1.04M 5m5s 2023-11-18T19:08:22.832 INFO:tasks.workunit.client.1.smithi135.stderr: 4450K .......... .......... .......... .......... .......... 2% 575K 5m4s 2023-11-18T19:08:22.927 INFO:tasks.workunit.client.1.smithi135.stderr: 4500K .......... .......... .......... .......... .......... 2% 642K 5m4s 2023-11-18T19:08:23.001 INFO:tasks.workunit.client.1.smithi135.stderr: 4550K .......... .......... .......... .......... .......... 2% 551K 5m3s 2023-11-18T19:08:23.076 INFO:tasks.workunit.client.1.smithi135.stderr: 4600K .......... .......... .......... .......... .......... 2% 665K 5m3s 2023-11-18T19:08:23.148 INFO:tasks.workunit.client.0.smithi045.stdout:checking for ANSI C header files... yes 2023-11-18T19:08:23.159 INFO:tasks.workunit.client.1.smithi135.stderr: 4650K .......... .......... .......... .......... .......... 2% 599K 5m2s 2023-11-18T19:08:23.212 INFO:tasks.workunit.client.1.smithi135.stderr: 4700K .......... .......... .......... .......... .......... 2% 982K 5m1s 2023-11-18T19:08:23.294 INFO:tasks.workunit.client.1.smithi135.stderr: 4750K .......... .......... .......... .......... .......... 2% 594K 5m0s 2023-11-18T19:08:23.320 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether time.h and sys/time.h may both be included... yes 2023-11-18T19:08:23.368 INFO:tasks.workunit.client.1.smithi135.stderr: 4800K .......... .......... .......... .......... .......... 2% 709K 5m0s 2023-11-18T19:08:23.450 INFO:tasks.workunit.client.1.smithi135.stderr: 4850K .......... .......... .......... .......... .......... 2% 585K 4m59s 2023-11-18T19:08:23.545 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sys/types.h... yes 2023-11-18T19:08:23.546 INFO:tasks.workunit.client.1.smithi135.stderr: 4900K .......... .......... .......... .......... .......... 2% 526K 4m59s 2023-11-18T19:08:23.725 INFO:tasks.workunit.client.1.smithi135.stderr: 4950K .......... .......... .......... .......... .......... 2% 281K 5m2s 2023-11-18T19:08:23.725 INFO:tasks.workunit.client.1.smithi135.stderr: 5000K .......... .......... .......... .......... .......... 2% 69.0M 4m59s 2023-11-18T19:08:23.757 INFO:tasks.workunit.client.1.smithi135.stderr: 5050K .......... .......... .......... .......... .......... 3% 1.60M 4m57s 2023-11-18T19:08:23.769 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sys/stat.h... yes 2023-11-18T19:08:23.846 INFO:tasks.workunit.client.1.smithi135.stderr: 5100K .......... .......... .......... .......... .......... 3% 544K 4m57s 2023-11-18T19:08:23.984 INFO:tasks.workunit.client.1.smithi135.stderr: 5150K .......... .......... .......... .......... .......... 3% 365K 4m58s 2023-11-18T19:08:23.993 INFO:tasks.workunit.client.0.smithi045.stdout:checking for stdlib.h... yes 2023-11-18T19:08:24.072 INFO:tasks.workunit.client.1.smithi135.stderr: 5200K .......... .......... .......... .......... .......... 3% 568K 4m58s 2023-11-18T19:08:24.163 INFO:tasks.workunit.client.1.smithi135.stderr: 5250K .......... .......... .......... .......... .......... 3% 548K 4m58s 2023-11-18T19:08:24.210 INFO:tasks.workunit.client.0.smithi045.stdout:checking for string.h... yes 2023-11-18T19:08:24.257 INFO:tasks.workunit.client.1.smithi135.stderr: 5300K .......... .......... .......... .......... .......... 3% 537K 4m58s 2023-11-18T19:08:24.291 INFO:tasks.workunit.client.1.smithi135.stderr: 5350K .......... .......... .......... .......... .......... 3% 1.37M 4m56s 2023-11-18T19:08:24.429 INFO:tasks.workunit.client.0.smithi045.stdout:checking for memory.h... yes 2023-11-18T19:08:24.532 INFO:tasks.workunit.client.1.smithi135.stderr: 5400K .......... .......... .......... .......... .......... 3% 208K 5m1s 2023-11-18T19:08:24.533 INFO:tasks.workunit.client.1.smithi135.stderr: 5450K .......... .......... .......... .......... .......... 3% 35.0M 4m58s 2023-11-18T19:08:24.618 INFO:tasks.workunit.client.1.smithi135.stderr: 5500K .......... .......... .......... .......... .......... 3% 587K 4m58s 2023-11-18T19:08:24.662 INFO:tasks.workunit.client.0.smithi045.stdout:checking for strings.h... yes 2023-11-18T19:08:24.761 INFO:tasks.workunit.client.1.smithi135.stderr: 5550K .......... .......... .......... .......... .......... 3% 433K 4m58s 2023-11-18T19:08:24.858 INFO:tasks.workunit.client.1.smithi135.stderr: 5600K .......... .......... .......... .......... .......... 3% 403K 4m59s 2023-11-18T19:08:24.880 INFO:tasks.workunit.client.0.smithi045.stdout:checking for inttypes.h... yes 2023-11-18T19:08:24.960 INFO:tasks.workunit.client.1.smithi135.stderr: 5650K .......... .......... .......... .......... .......... 3% 490K 4m59s 2023-11-18T19:08:25.101 INFO:tasks.workunit.client.1.smithi135.stderr: 5700K .......... .......... .......... .......... .......... 3% 355K 5m1s 2023-11-18T19:08:25.104 INFO:tasks.workunit.client.0.smithi045.stdout:checking for stdint.h... yes 2023-11-18T19:08:25.197 INFO:tasks.workunit.client.1.smithi135.stderr: 5750K .......... .......... .......... .......... .......... 3% 519K 5m1s 2023-11-18T19:08:25.301 INFO:tasks.workunit.client.1.smithi135.stderr: 5800K .......... .......... .......... .......... .......... 3% 489K 5m1s 2023-11-18T19:08:25.312 INFO:tasks.workunit.client.0.smithi045.stdout:checking for unistd.h... yes 2023-11-18T19:08:25.382 INFO:tasks.workunit.client.0.smithi045.stdout:checking for memory.h... (cached) yes 2023-11-18T19:08:25.421 INFO:tasks.workunit.client.0.smithi045.stdout:checking for strings.h... (cached) yes 2023-11-18T19:08:25.439 INFO:tasks.workunit.client.1.smithi135.stderr: 5850K .......... .......... .......... .......... .......... 3% 362K 5m2s 2023-11-18T19:08:25.458 INFO:tasks.workunit.client.0.smithi045.stdout:checking for unistd.h... (cached) yes 2023-11-18T19:08:25.562 INFO:tasks.workunit.client.1.smithi135.stderr: 5900K .......... .......... .......... .......... .......... 3% 412K 5m3s 2023-11-18T19:08:25.656 INFO:tasks.workunit.client.0.smithi045.stdout:checking locale.h usability... yes 2023-11-18T19:08:25.668 INFO:tasks.workunit.client.1.smithi135.stderr: 5950K .......... .......... .......... .......... .......... 3% 459K 5m3s 2023-11-18T19:08:25.745 INFO:tasks.workunit.client.0.smithi045.stdout:checking locale.h presence... yes 2023-11-18T19:08:25.750 INFO:tasks.workunit.client.0.smithi045.stdout:checking for locale.h... yes 2023-11-18T19:08:25.777 INFO:tasks.workunit.client.1.smithi135.stderr: 6000K .......... .......... .......... .......... .......... 3% 458K 5m3s 2023-11-18T19:08:25.820 INFO:tasks.workunit.client.0.smithi045.stdout:checking for stdlib.h... (cached) yes 2023-11-18T19:08:25.859 INFO:tasks.workunit.client.0.smithi045.stdout:checking for string.h... (cached) yes 2023-11-18T19:08:25.928 INFO:tasks.workunit.client.1.smithi135.stderr: 6050K .......... .......... .......... .......... .......... 3% 331K 5m5s 2023-11-18T19:08:26.037 INFO:tasks.workunit.client.1.smithi135.stderr: 6100K .......... .......... .......... .......... .......... 3% 461K 5m5s 2023-11-18T19:08:26.112 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/socket.h usability... yes 2023-11-18T19:08:26.131 INFO:tasks.workunit.client.1.smithi135.stderr: 6150K .......... .......... .......... .......... .......... 3% 526K 5m5s 2023-11-18T19:08:26.217 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/socket.h presence... yes 2023-11-18T19:08:26.227 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sys/socket.h... yes 2023-11-18T19:08:26.230 INFO:tasks.workunit.client.1.smithi135.stderr: 6200K .......... .......... .......... .......... .......... 3% 520K 5m5s 2023-11-18T19:08:26.320 INFO:tasks.workunit.client.1.smithi135.stderr: 6250K .......... .......... .......... .......... .......... 3% 540K 5m5s 2023-11-18T19:08:26.412 INFO:tasks.workunit.client.1.smithi135.stderr: 6300K .......... .......... .......... .......... .......... 3% 543K 5m5s 2023-11-18T19:08:26.427 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/time.h usability... yes 2023-11-18T19:08:26.511 INFO:tasks.workunit.client.1.smithi135.stderr: 6350K .......... .......... .......... .......... .......... 3% 531K 5m5s 2023-11-18T19:08:26.521 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/time.h presence... yes 2023-11-18T19:08:26.526 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sys/time.h... yes 2023-11-18T19:08:26.608 INFO:tasks.workunit.client.1.smithi135.stderr: 6400K .......... .......... .......... .......... .......... 3% 491K 5m5s 2023-11-18T19:08:26.700 INFO:tasks.workunit.client.1.smithi135.stderr: 6450K .......... .......... .......... .......... .......... 3% 546K 5m4s 2023-11-18T19:08:26.743 INFO:tasks.workunit.client.0.smithi045.stdout:checking fcntl.h usability... yes 2023-11-18T19:08:26.794 INFO:tasks.workunit.client.1.smithi135.stderr: 6500K .......... .......... .......... .......... .......... 3% 532K 5m4s 2023-11-18T19:08:26.840 INFO:tasks.workunit.client.0.smithi045.stdout:checking fcntl.h presence... yes 2023-11-18T19:08:26.844 INFO:tasks.workunit.client.0.smithi045.stdout:checking for fcntl.h... yes 2023-11-18T19:08:26.885 INFO:tasks.workunit.client.1.smithi135.stderr: 6550K .......... .......... .......... .......... .......... 3% 559K 5m4s 2023-11-18T19:08:26.976 INFO:tasks.workunit.client.1.smithi135.stderr: 6600K .......... .......... .......... .......... .......... 3% 543K 5m4s 2023-11-18T19:08:27.021 INFO:tasks.workunit.client.1.smithi135.stderr: 6650K .......... .......... .......... .......... .......... 3% 1.07M 5m3s 2023-11-18T19:08:27.079 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/fcntl.h usability... yes 2023-11-18T19:08:27.103 INFO:tasks.workunit.client.1.smithi135.stderr: 6700K .......... .......... .......... .......... .......... 4% 613K 5m2s 2023-11-18T19:08:27.171 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/fcntl.h presence... yes 2023-11-18T19:08:27.176 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sys/fcntl.h... yes 2023-11-18T19:08:27.194 INFO:tasks.workunit.client.1.smithi135.stderr: 6750K .......... .......... .......... .......... .......... 4% 552K 5m2s 2023-11-18T19:08:27.282 INFO:tasks.workunit.client.1.smithi135.stderr: 6800K .......... .......... .......... .......... .......... 4% 567K 5m2s 2023-11-18T19:08:27.374 INFO:tasks.workunit.client.1.smithi135.stderr: 6850K .......... .......... .......... .......... .......... 4% 697K 5m1s 2023-11-18T19:08:27.441 INFO:tasks.workunit.client.1.smithi135.stderr: 6900K .......... .......... .......... .......... .......... 4% 568K 5m1s 2023-11-18T19:08:27.458 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/param.h usability... yes 2023-11-18T19:08:27.530 INFO:tasks.workunit.client.1.smithi135.stderr: 6950K .......... .......... .......... .......... .......... 4% 566K 5m1s 2023-11-18T19:08:27.546 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/param.h presence... yes 2023-11-18T19:08:27.551 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sys/param.h... yes 2023-11-18T19:08:27.618 INFO:tasks.workunit.client.1.smithi135.stderr: 7000K .......... .......... .......... .......... .......... 4% 574K 5m1s 2023-11-18T19:08:27.709 INFO:tasks.workunit.client.1.smithi135.stderr: 7050K .......... .......... .......... .......... .......... 4% 545K 5m1s 2023-11-18T19:08:27.740 INFO:tasks.workunit.client.0.smithi045.stdout:checking ioctl.h usability... no 2023-11-18T19:08:27.757 INFO:tasks.workunit.client.1.smithi135.stderr: 7100K .......... .......... .......... .......... .......... 4% 1.01M 5m0s 2023-11-18T19:08:27.837 INFO:tasks.workunit.client.1.smithi135.stderr: 7150K .......... .......... .......... .......... .......... 4% 626K 4m59s 2023-11-18T19:08:27.838 INFO:tasks.workunit.client.0.smithi045.stdout:checking ioctl.h presence... no 2023-11-18T19:08:27.843 INFO:tasks.workunit.client.0.smithi045.stdout:checking for ioctl.h... no 2023-11-18T19:08:27.913 INFO:tasks.workunit.client.1.smithi135.stderr: 7200K .......... .......... .......... .......... .......... 4% 654K 4m59s 2023-11-18T19:08:27.991 INFO:tasks.workunit.client.1.smithi135.stderr: 7250K .......... .......... .......... .......... .......... 4% 650K 4m58s 2023-11-18T19:08:28.061 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/ioctl.h usability... yes 2023-11-18T19:08:28.064 INFO:tasks.workunit.client.1.smithi135.stderr: 7300K .......... .......... .......... .......... .......... 4% 679K 4m58s 2023-11-18T19:08:28.113 INFO:tasks.workunit.client.1.smithi135.stderr: 7350K .......... .......... .......... .......... .......... 4% 1.03M 4m57s 2023-11-18T19:08:28.147 INFO:tasks.workunit.client.0.smithi045.stdout:checking sys/ioctl.h presence... yes 2023-11-18T19:08:28.151 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sys/ioctl.h... yes 2023-11-18T19:08:28.187 INFO:tasks.workunit.client.1.smithi135.stderr: 7400K .......... .......... .......... .......... .......... 4% 678K 4m56s 2023-11-18T19:08:28.257 INFO:tasks.workunit.client.1.smithi135.stderr: 7450K .......... .......... .......... .......... .......... 4% 733K 4m56s 2023-11-18T19:08:28.330 INFO:tasks.workunit.client.1.smithi135.stderr: 7500K .......... .......... .......... .......... .......... 4% 655K 4m55s 2023-11-18T19:08:28.356 INFO:tasks.workunit.client.0.smithi045.stdout:checking return type of signal handlers... void 2023-11-18T19:08:28.411 INFO:tasks.workunit.client.1.smithi135.stderr: 7550K .......... .......... .......... .......... .......... 4% 619K 4m55s 2023-11-18T19:08:28.456 INFO:tasks.workunit.client.1.smithi135.stderr: 7600K .......... .......... .......... .......... .......... 4% 1.07M 4m54s 2023-11-18T19:08:28.531 INFO:tasks.workunit.client.0.smithi045.stdout:checking for size_t... yes 2023-11-18T19:08:28.531 INFO:tasks.workunit.client.1.smithi135.stderr: 7650K .......... .......... .......... .......... .......... 4% 668K 4m53s 2023-11-18T19:08:28.609 INFO:tasks.workunit.client.1.smithi135.stderr: 7700K .......... .......... .......... .......... .......... 4% 645K 4m53s 2023-11-18T19:08:28.683 INFO:tasks.workunit.client.0.smithi045.stdout:checking for dev_t... yes 2023-11-18T19:08:28.684 INFO:tasks.workunit.client.1.smithi135.stderr: 7750K .......... .......... .......... .......... .......... 4% 660K 4m53s 2023-11-18T19:08:28.735 INFO:tasks.workunit.client.1.smithi135.stderr: 7800K .......... .......... .......... .......... .......... 4% 1.15M 4m52s 2023-11-18T19:08:28.805 INFO:tasks.workunit.client.1.smithi135.stderr: 7850K .......... .......... .......... .......... .......... 4% 672K 4m51s 2023-11-18T19:08:28.862 INFO:tasks.workunit.client.0.smithi045.stdout:checking for short... yes 2023-11-18T19:08:28.884 INFO:tasks.workunit.client.1.smithi135.stderr: 7900K .......... .......... .......... .......... .......... 4% 601K 4m51s 2023-11-18T19:08:28.924 INFO:tasks.workunit.client.1.smithi135.stderr: 7950K .......... .......... .......... .......... .......... 4% 1.22M 4m50s 2023-11-18T19:08:29.005 INFO:tasks.workunit.client.1.smithi135.stderr: 8000K .......... .......... .......... .......... .......... 4% 621K 4m49s 2023-11-18T19:08:29.066 INFO:tasks.workunit.client.1.smithi135.stderr: 8050K .......... .......... .......... .......... .......... 4% 815K 4m49s 2023-11-18T19:08:29.135 INFO:tasks.workunit.client.1.smithi135.stderr: 8100K .......... .......... .......... .......... .......... 4% 724K 4m48s 2023-11-18T19:08:29.195 INFO:tasks.workunit.client.1.smithi135.stderr: 8150K .......... .......... .......... .......... .......... 4% 901K 4m48s 2023-11-18T19:08:29.202 INFO:tasks.workunit.client.0.smithi045.stdout:checking size of short... 2 2023-11-18T19:08:29.253 INFO:tasks.workunit.client.1.smithi135.stderr: 8200K .......... .......... .......... .......... .......... 4% 798K 4m47s 2023-11-18T19:08:29.319 INFO:tasks.workunit.client.1.smithi135.stderr: 8250K .......... .......... .......... .......... .......... 4% 761K 4m46s 2023-11-18T19:08:29.379 INFO:tasks.workunit.client.1.smithi135.stderr: 8300K .......... .......... .......... .......... .......... 4% 835K 4m46s 2023-11-18T19:08:29.379 INFO:tasks.workunit.client.0.smithi045.stdout:checking for int... yes 2023-11-18T19:08:29.444 INFO:tasks.workunit.client.1.smithi135.stderr: 8350K .......... .......... .......... .......... .......... 4% 768K 4m45s 2023-11-18T19:08:29.518 INFO:tasks.workunit.client.1.smithi135.stderr: 8400K .......... .......... .......... .......... .......... 5% 673K 4m45s 2023-11-18T19:08:29.686 INFO:tasks.workunit.client.1.smithi135.stderr: 8450K .......... .......... .......... .......... .......... 5% 302K 4m46s 2023-11-18T19:08:29.686 INFO:tasks.workunit.client.1.smithi135.stderr: 8500K .......... .......... .......... .......... .......... 5% 47.4M 4m44s 2023-11-18T19:08:29.687 INFO:tasks.workunit.client.0.smithi045.stdout:checking size of int... 4 2023-11-18T19:08:29.701 INFO:tasks.workunit.client.1.smithi135.stderr: 8550K .......... .......... .......... .......... .......... 5% 3.20M 4m43s 2023-11-18T19:08:29.779 INFO:tasks.workunit.client.1.smithi135.stderr: 8600K .......... .......... .......... .......... .......... 5% 638K 4m43s 2023-11-18T19:08:29.844 INFO:tasks.workunit.client.1.smithi135.stderr: 8650K .......... .......... .......... .......... .......... 5% 759K 4m42s 2023-11-18T19:08:29.876 INFO:tasks.workunit.client.0.smithi045.stdout:checking for long... yes 2023-11-18T19:08:29.918 INFO:tasks.workunit.client.1.smithi135.stderr: 8700K .......... .......... .......... .......... .......... 5% 680K 4m42s 2023-11-18T19:08:29.996 INFO:tasks.workunit.client.1.smithi135.stderr: 8750K .......... .......... .......... .......... .......... 5% 637K 4m42s 2023-11-18T19:08:30.055 INFO:tasks.workunit.client.1.smithi135.stderr: 8800K .......... .......... .......... .......... .......... 5% 858K 4m41s 2023-11-18T19:08:30.135 INFO:tasks.workunit.client.1.smithi135.stderr: 8850K .......... .......... .......... .......... .......... 5% 628K 4m41s 2023-11-18T19:08:30.171 INFO:tasks.workunit.client.0.smithi045.stdout:checking size of long... 8 2023-11-18T19:08:30.185 INFO:tasks.workunit.client.1.smithi135.stderr: 8900K .......... .......... .......... .......... .......... 5% 987K 4m40s 2023-11-18T19:08:30.265 INFO:tasks.workunit.client.1.smithi135.stderr: 8950K .......... .......... .......... .......... .......... 5% 629K 4m40s 2023-11-18T19:08:30.343 INFO:tasks.workunit.client.1.smithi135.stderr: 9000K .......... .......... .......... .......... .......... 5% 637K 4m39s 2023-11-18T19:08:30.352 INFO:tasks.workunit.client.0.smithi045.stdout:checking for long long... yes 2023-11-18T19:08:30.432 INFO:tasks.workunit.client.1.smithi135.stderr: 9050K .......... .......... .......... .......... .......... 5% 563K 4m39s 2023-11-18T19:08:30.478 INFO:tasks.workunit.client.1.smithi135.stderr: 9100K .......... .......... .......... .......... .......... 5% 1.05M 4m39s 2023-11-18T19:08:30.537 INFO:tasks.workunit.client.1.smithi135.stderr: 9150K .......... .......... .......... .......... .......... 5% 859K 4m38s 2023-11-18T19:08:30.617 INFO:tasks.workunit.client.1.smithi135.stderr: 9200K .......... .......... .......... .......... .......... 5% 622K 4m38s 2023-11-18T19:08:30.640 INFO:tasks.workunit.client.0.smithi045.stdout:checking size of long long... 8 2023-11-18T19:08:30.708 INFO:tasks.workunit.client.1.smithi135.stderr: 9250K .......... .......... .......... .......... .......... 5% 551K 4m38s 2023-11-18T19:08:30.828 INFO:tasks.workunit.client.0.smithi045.stdout:checking for ssize_t... yes 2023-11-18T19:08:30.847 INFO:tasks.workunit.client.1.smithi135.stderr: 9300K .......... .......... .......... .......... .......... 5% 362K 4m39s 2023-11-18T19:08:30.847 INFO:tasks.workunit.client.1.smithi135.stderr: 9350K .......... .......... .......... .......... .......... 5% 73.4M 4m37s 2023-11-18T19:08:30.909 INFO:tasks.workunit.client.1.smithi135.stderr: 9400K .......... .......... .......... .......... .......... 5% 800K 4m36s 2023-11-18T19:08:30.997 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sig_atomic_t... yes 2023-11-18T19:08:31.000 INFO:tasks.workunit.client.1.smithi135.stderr: 9450K .......... .......... .......... .......... .......... 5% 546K 4m36s 2023-11-18T19:08:31.092 INFO:tasks.workunit.client.1.smithi135.stderr: 9500K .......... .......... .......... .......... .......... 5% 545K 4m36s 2023-11-18T19:08:31.160 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether gcc needs -traditional... no 2023-11-18T19:08:31.183 INFO:tasks.workunit.client.1.smithi135.stderr: 9550K .......... .......... .......... .......... .......... 5% 550K 4m36s 2023-11-18T19:08:31.276 INFO:tasks.workunit.client.1.smithi135.stderr: 9600K .......... .......... .......... .......... .......... 5% 538K 4m36s 2023-11-18T19:08:31.298 INFO:tasks.workunit.client.0.smithi045.stdout:checking for an ANSI C-conforming const... yes 2023-11-18T19:08:31.370 INFO:tasks.workunit.client.1.smithi135.stderr: 9650K .......... .......... .......... .......... .......... 5% 537K 4m36s 2023-11-18T19:08:31.400 INFO:tasks.workunit.client.0.smithi045.stdout:checking for inline... inline 2023-11-18T19:08:31.463 INFO:tasks.workunit.client.1.smithi135.stderr: 9700K .......... .......... .......... .......... .......... 5% 531K 4m37s 2023-11-18T19:08:31.550 INFO:tasks.workunit.client.1.smithi135.stderr: 9750K .......... .......... .......... .......... .......... 5% 573K 4m36s 2023-11-18T19:08:31.636 INFO:tasks.workunit.client.1.smithi135.stderr: 9800K .......... .......... .......... .......... .......... 5% 587K 4m36s 2023-11-18T19:08:31.673 INFO:tasks.workunit.client.0.smithi045.stdout:checking for working alloca.h... yes 2023-11-18T19:08:31.710 INFO:tasks.workunit.client.1.smithi135.stderr: 9850K .......... .......... .......... .......... .......... 5% 677K 4m36s 2023-11-18T19:08:31.794 INFO:tasks.workunit.client.1.smithi135.stderr: 9900K .......... .......... .......... .......... .......... 5% 610K 4m36s 2023-11-18T19:08:31.873 INFO:tasks.workunit.client.1.smithi135.stderr: 9950K .......... .......... .......... .......... .......... 5% 610K 4m36s 2023-11-18T19:08:31.929 INFO:tasks.workunit.client.0.smithi045.stdout:checking for alloca... yes 2023-11-18T19:08:31.959 INFO:tasks.workunit.client.1.smithi135.stderr: 10000K .......... .......... .......... .......... .......... 5% 584K 4m36s 2023-11-18T19:08:32.019 INFO:tasks.workunit.client.1.smithi135.stderr: 10050K .......... .......... .......... .......... .......... 5% 833K 4m35s 2023-11-18T19:08:32.105 INFO:tasks.workunit.client.1.smithi135.stderr: 10100K .......... .......... .......... .......... .......... 6% 592K 4m35s 2023-11-18T19:08:32.169 INFO:tasks.workunit.client.1.smithi135.stderr: 10150K .......... .......... .......... .......... .......... 6% 763K 4m35s 2023-11-18T19:08:32.206 INFO:tasks.workunit.client.0.smithi045.stdout:checking for working memcmp... yes 2023-11-18T19:08:32.255 INFO:tasks.workunit.client.1.smithi135.stderr: 10200K .......... .......... .......... .......... .......... 6% 578K 4m34s 2023-11-18T19:08:32.478 INFO:tasks.workunit.client.1.smithi135.stderr: 10250K .......... .......... .......... .......... .......... 6% 226K 4m36s 2023-11-18T19:08:32.478 INFO:tasks.workunit.client.1.smithi135.stderr: 10300K .......... .......... .......... .......... .......... 6% 50.0M 4m35s 2023-11-18T19:08:32.483 INFO:tasks.workunit.client.0.smithi045.stdout:checking for strftime... yes 2023-11-18T19:08:32.533 INFO:tasks.workunit.client.1.smithi135.stderr: 10350K .......... .......... .......... .......... .......... 6% 963K 4m34s 2023-11-18T19:08:32.623 INFO:tasks.workunit.client.1.smithi135.stderr: 10400K .......... .......... .......... .......... .......... 6% 538K 4m34s 2023-11-18T19:08:32.732 INFO:tasks.workunit.client.1.smithi135.stderr: 10450K .......... .......... .......... .......... .......... 6% 462K 4m35s 2023-11-18T19:08:32.804 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2023-11-18T19:08:32.846 INFO:tasks.workunit.client.1.smithi135.stderr: 10500K .......... .......... .......... .......... .......... 6% 436K 4m35s 2023-11-18T19:08:32.934 INFO:tasks.workunit.client.1.smithi135.stderr: 10550K .......... .......... .......... .......... .......... 6% 566K 4m35s 2023-11-18T19:08:33.024 INFO:tasks.workunit.client.1.smithi135.stderr: 10600K .......... .......... .......... .......... .......... 6% 555K 4m35s 2023-11-18T19:08:33.093 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether stat accepts an empty string... no 2023-11-18T19:08:33.116 INFO:tasks.workunit.client.1.smithi135.stderr: 10650K .......... .......... .......... .......... .......... 6% 540K 4m35s 2023-11-18T19:08:33.210 INFO:tasks.workunit.client.1.smithi135.stderr: 10700K .......... .......... .......... .......... .......... 6% 535K 4m35s 2023-11-18T19:08:33.332 INFO:tasks.workunit.client.0.smithi045.stdout:checking for vprintf... yes 2023-11-18T19:08:33.417 INFO:tasks.workunit.client.1.smithi135.stderr: 10750K .......... .......... .......... .......... .......... 6% 243K 4m37s 2023-11-18T19:08:33.417 INFO:tasks.workunit.client.1.smithi135.stderr: 10800K .......... .......... .......... .......... .......... 6% 78.0M 4m35s 2023-11-18T19:08:33.552 INFO:tasks.workunit.client.1.smithi135.stderr: 10850K .......... .......... .......... .......... .......... 6% 369K 4m36s 2023-11-18T19:08:33.604 INFO:tasks.workunit.client.0.smithi045.stdout:checking for _doprnt... no 2023-11-18T19:08:33.671 INFO:tasks.workunit.client.1.smithi135.stderr: 10900K .......... .......... .......... .......... .......... 6% 419K 4m36s 2023-11-18T19:08:33.700 INFO:tasks.workunit.client.0.smithi045.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-11-18T19:08:33.750 INFO:tasks.workunit.client.0.smithi045.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-11-18T19:08:33.765 INFO:tasks.workunit.client.1.smithi135.stderr: 10950K .......... .......... .......... .......... .......... 6% 533K 4m36s 2023-11-18T19:08:33.886 INFO:tasks.workunit.client.1.smithi135.stderr: 11000K .......... .......... .......... .......... .......... 6% 414K 4m37s 2023-11-18T19:08:33.963 INFO:tasks.workunit.client.0.smithi045.stdout:checking for the pthreads library -lpthreads... no 2023-11-18T19:08:34.015 INFO:tasks.workunit.client.1.smithi135.stderr: 11050K .......... .......... .......... .......... .......... 6% 387K 4m37s 2023-11-18T19:08:34.110 INFO:tasks.workunit.client.1.smithi135.stderr: 11100K .......... .......... .......... .......... .......... 6% 527K 4m37s 2023-11-18T19:08:34.210 INFO:tasks.workunit.client.1.smithi135.stderr: 11150K .......... .......... .......... .......... .......... 6% 501K 4m37s 2023-11-18T19:08:34.214 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether pthreads work without any flags... yes 2023-11-18T19:08:34.301 INFO:tasks.workunit.client.1.smithi135.stderr: 11200K .......... .......... .......... .......... .......... 6% 547K 4m37s 2023-11-18T19:08:34.417 INFO:tasks.workunit.client.1.smithi135.stderr: 11250K .......... .......... .......... .......... .......... 6% 433K 4m37s 2023-11-18T19:08:34.423 INFO:tasks.workunit.client.0.smithi045.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2023-11-18T19:08:34.424 INFO:tasks.workunit.client.0.smithi045.stdout:checking if more special flags are required for pthreads... no 2023-11-18T19:08:34.425 INFO:tasks.workunit.client.0.smithi045.stdout:checking for cc_r... gcc 2023-11-18T19:08:34.502 INFO:tasks.workunit.client.1.smithi135.stderr: 11300K .......... .......... .......... .......... .......... 6% 581K 4m37s 2023-11-18T19:08:34.624 INFO:tasks.workunit.client.1.smithi135.stderr: 11350K .......... .......... .......... .......... .......... 6% 415K 4m38s 2023-11-18T19:08:34.716 INFO:tasks.workunit.client.1.smithi135.stderr: 11400K .......... .......... .......... .......... .......... 6% 540K 4m38s 2023-11-18T19:08:34.725 INFO:tasks.workunit.client.0.smithi045.stdout:checking for setrlimit... yes 2023-11-18T19:08:34.813 INFO:tasks.workunit.client.1.smithi135.stderr: 11450K .......... .......... .......... .......... .......... 6% 532K 4m38s 2023-11-18T19:08:34.904 INFO:tasks.workunit.client.1.smithi135.stderr: 11500K .......... .......... .......... .......... .......... 6% 529K 4m38s 2023-11-18T19:08:34.997 INFO:tasks.workunit.client.1.smithi135.stderr: 11550K .......... .......... .......... .......... .......... 6% 541K 4m38s 2023-11-18T19:08:35.009 INFO:tasks.workunit.client.0.smithi045.stdout:checking for setproctitle... no 2023-11-18T19:08:35.233 INFO:tasks.workunit.client.1.smithi135.stderr: 11600K .......... .......... .......... .......... .......... 6% 212K 4m39s 2023-11-18T19:08:35.294 INFO:tasks.workunit.client.1.smithi135.stderr: 11650K .......... .......... .......... .......... .......... 6% 829K 4m39s 2023-11-18T19:08:35.317 INFO:tasks.workunit.client.0.smithi045.stdout:checking for getopt_long... yes 2023-11-18T19:08:35.365 INFO:tasks.workunit.client.1.smithi135.stderr: 11700K .......... .......... .......... .......... .......... 6% 697K 4m39s 2023-11-18T19:08:35.467 INFO:tasks.workunit.client.1.smithi135.stderr: 11750K .......... .......... .......... .......... .......... 7% 487K 4m39s 2023-11-18T19:08:35.607 INFO:tasks.workunit.client.0.smithi045.stdout:checking for strtoull... yes 2023-11-18T19:08:35.611 INFO:tasks.workunit.client.1.smithi135.stderr: 11800K .......... .......... .......... .......... .......... 7% 348K 4m39s 2023-11-18T19:08:35.709 INFO:tasks.workunit.client.1.smithi135.stderr: 11850K .......... .......... .......... .......... .......... 7% 510K 4m39s 2023-11-18T19:08:35.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:08:35.764 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:08:35.806 INFO:tasks.workunit.client.1.smithi135.stderr: 11900K .......... .......... .......... .......... .......... 7% 555K 4m39s 2023-11-18T19:08:35.855 INFO:tasks.workunit.client.0.smithi045.stdout:checking for strtoq... yes 2023-11-18T19:08:35.972 INFO:tasks.workunit.client.1.smithi135.stderr: 11950K .......... .......... .......... .......... .......... 7% 290K 4m40s 2023-11-18T19:08:36.097 INFO:tasks.workunit.client.1.smithi135.stderr: 12000K .......... .......... .......... .......... .......... 7% 399K 4m41s 2023-11-18T19:08:36.125 INFO:tasks.workunit.client.0.smithi045.stdout:checking for snprintf... yes 2023-11-18T19:08:36.228 INFO:tasks.workunit.client.1.smithi135.stderr: 12050K .......... .......... .......... .......... .......... 7% 384K 4m41s 2023-11-18T19:08:36.355 INFO:tasks.workunit.client.1.smithi135.stderr: 12100K .......... .......... .......... .......... .......... 7% 393K 4m42s 2023-11-18T19:08:36.412 INFO:tasks.workunit.client.0.smithi045.stdout:checking for vsnprintf... yes 2023-11-18T19:08:36.492 INFO:tasks.workunit.client.1.smithi135.stderr: 12150K .......... .......... .......... .......... .......... 7% 376K 4m42s 2023-11-18T19:08:36.658 INFO:tasks.workunit.client.1.smithi135.stderr: 12200K .......... .......... .......... .......... .......... 7% 294K 4m43s 2023-11-18T19:08:36.698 INFO:tasks.workunit.client.0.smithi045.stdout:checking for vfprintf... yes 2023-11-18T19:08:36.807 INFO:tasks.workunit.client.1.smithi135.stderr: 12250K .......... .......... .......... .......... .......... 7% 468K 4m43s 2023-11-18T19:08:36.977 INFO:tasks.workunit.client.0.smithi045.stdout:checking for gethostname... yes 2023-11-18T19:08:37.119 INFO:tasks.workunit.client.1.smithi135.stderr: 12300K .......... .......... .......... .......... .......... 7% 142K 4m46s 2023-11-18T19:08:37.134 INFO:tasks.workunit.client.1.smithi135.stderr: 12350K .......... .......... .......... .......... .......... 7% 3.85M 4m45s 2023-11-18T19:08:37.280 INFO:tasks.workunit.client.0.smithi045.stdout:checking for setlocale... yes 2023-11-18T19:08:37.388 INFO:tasks.workunit.client.1.smithi135.stderr: 12400K .......... .......... .......... .......... .......... 7% 195K 4m47s 2023-11-18T19:08:37.545 INFO:tasks.workunit.client.0.smithi045.stdout:checking for sync... yes 2023-11-18T19:08:37.653 INFO:tasks.workunit.client.1.smithi135.stderr: 12450K .......... .......... .......... .......... .......... 7% 188K 4m49s 2023-11-18T19:08:37.822 INFO:tasks.workunit.client.0.smithi045.stdout:checking whether snprintf is C99 conformant... done 2023-11-18T19:08:37.834 INFO:tasks.workunit.client.1.smithi135.stderr: 12500K .......... .......... .......... .......... .......... 7% 277K 4m50s 2023-11-18T19:08:37.884 INFO:tasks.workunit.client.0.smithi045.stdout:configure: creating ./config.status 2023-11-18T19:08:38.109 INFO:tasks.workunit.client.1.smithi135.stderr: 12550K .......... .......... .......... .......... .......... 7% 181K 4m52s 2023-11-18T19:08:38.288 INFO:tasks.workunit.client.1.smithi135.stderr: 12600K .......... .......... .......... .......... .......... 7% 279K 4m53s 2023-11-18T19:08:38.466 INFO:tasks.workunit.client.1.smithi135.stderr: 12650K .......... .......... .......... .......... .......... 7% 281K 4m54s 2023-11-18T19:08:38.594 INFO:tasks.workunit.client.0.smithi045.stdout:config.status: creating Makefile 2023-11-18T19:08:38.660 INFO:tasks.workunit.client.1.smithi135.stderr: 12700K .......... .......... .......... .......... .......... 7% 267K 4m55s 2023-11-18T19:08:38.666 INFO:tasks.workunit.client.0.smithi045.stdout:config.status: creating src/Makefile 2023-11-18T19:08:38.750 INFO:tasks.workunit.client.0.smithi045.stdout:config.status: creating man/Makefile 2023-11-18T19:08:38.794 INFO:tasks.workunit.client.0.smithi045.stdout:config.status: creating config.h 2023-11-18T19:08:38.840 INFO:tasks.workunit.client.1.smithi135.stderr: 12750K .......... .......... .......... .......... .......... 7% 269K 4m56s 2023-11-18T19:08:39.008 INFO:tasks.workunit.client.1.smithi135.stderr: 12800K .......... .......... .......... .......... .......... 7% 297K 4m57s 2023-11-18T19:08:39.041 INFO:tasks.workunit.client.0.smithi045.stdout:config.status: executing depfiles commands 2023-11-18T19:08:39.151 INFO:tasks.workunit.client.1.smithi135.stderr: 12850K .......... .......... .......... .......... .......... 7% 349K 4m58s 2023-11-18T19:08:39.287 INFO:tasks.workunit.client.1.smithi135.stderr: 12900K .......... .......... .......... .......... .......... 7% 368K 4m58s 2023-11-18T19:08:39.460 INFO:tasks.workunit.client.1.smithi135.stderr: 12950K .......... .......... .......... .......... .......... 7% 303K 4m59s 2023-11-18T19:08:39.563 INFO:tasks.workunit.client.1.smithi135.stderr: 13000K .......... .......... .......... .......... .......... 7% 448K 4m59s 2023-11-18T19:08:39.648 INFO:tasks.workunit.client.0.smithi045.stderr:+ make 2023-11-18T19:08:39.712 INFO:tasks.workunit.client.0.smithi045.stdout:make all-recursive 2023-11-18T19:08:39.720 INFO:tasks.workunit.client.1.smithi135.stderr: 13050K .......... .......... .......... .......... .......... 7% 320K 4m59s 2023-11-18T19:08:39.744 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-18T19:08:39.762 INFO:tasks.workunit.client.0.smithi045.stdout:Making all in src 2023-11-18T19:08:39.817 INFO:tasks.workunit.client.1.smithi135.stderr: 13100K .......... .......... .......... .......... .......... 7% 516K 4m59s 2023-11-18T19:08:39.883 INFO:tasks.workunit.client.0.smithi045.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-11-18T19:08:39.883 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2023-11-18T19:08:39.883 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2023-11-18T19:08:39.986 INFO:tasks.workunit.client.1.smithi135.stderr: 13150K .......... .......... .......... .......... .......... 7% 296K 5m0s 2023-11-18T19:08:40.085 INFO:tasks.workunit.client.1.smithi135.stderr: 13200K .......... .......... .......... .......... .......... 7% 502K 5m0s 2023-11-18T19:08:40.190 INFO:tasks.workunit.client.1.smithi135.stderr: 13250K .......... .......... .......... .......... .......... 7% 476K 5m0s 2023-11-18T19:08:40.323 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2023-11-18T19:08:40.323 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2023-11-18T19:08:40.337 INFO:tasks.workunit.client.1.smithi135.stderr: 13300K .......... .......... .......... .......... .......... 7% 341K 5m1s 2023-11-18T19:08:40.440 INFO:tasks.workunit.client.1.smithi135.stderr: 13350K .......... .......... .......... .......... .......... 7% 483K 5m1s 2023-11-18T19:08:40.538 INFO:tasks.workunit.client.1.smithi135.stderr: 13400K .......... .......... .......... .......... .......... 7% 519K 5m0s 2023-11-18T19:08:40.640 INFO:tasks.workunit.client.1.smithi135.stderr: 13450K .......... .......... .......... .......... .......... 8% 482K 5m0s 2023-11-18T19:08:40.683 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2023-11-18T19:08:40.684 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2023-11-18T19:08:40.741 INFO:tasks.workunit.client.1.smithi135.stderr: 13500K .......... .......... .......... .......... .......... 8% 496K 5m0s 2023-11-18T19:08:40.853 INFO:tasks.workunit.client.1.smithi135.stderr: 13550K .......... .......... .......... .......... .......... 8% 445K 5m0s 2023-11-18T19:08:40.949 INFO:tasks.workunit.client.1.smithi135.stderr: 13600K .......... .......... .......... .......... .......... 8% 537K 5m0s 2023-11-18T19:08:40.972 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2023-11-18T19:08:40.972 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2023-11-18T19:08:41.037 INFO:tasks.workunit.client.1.smithi135.stderr: 13650K .......... .......... .......... .......... .......... 8% 552K 5m0s 2023-11-18T19:08:41.129 INFO:tasks.workunit.client.1.smithi135.stderr: 13700K .......... .......... .......... .......... .......... 8% 548K 5m0s 2023-11-18T19:08:41.212 INFO:tasks.workunit.client.1.smithi135.stderr: 13750K .......... .......... .......... .......... .......... 8% 601K 5m0s 2023-11-18T19:08:41.292 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2023-11-18T19:08:41.292 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2023-11-18T19:08:41.310 INFO:tasks.workunit.client.1.smithi135.stderr: 13800K .......... .......... .......... .......... .......... 8% 507K 5m0s 2023-11-18T19:08:41.399 INFO:tasks.workunit.client.1.smithi135.stderr: 13850K .......... .......... .......... .......... .......... 8% 565K 4m59s 2023-11-18T19:08:41.489 INFO:tasks.workunit.client.1.smithi135.stderr: 13900K .......... .......... .......... .......... .......... 8% 556K 4m59s 2023-11-18T19:08:41.521 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2023-11-18T19:08:41.521 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2023-11-18T19:08:41.611 INFO:tasks.workunit.client.1.smithi135.stderr: 13950K .......... .......... .......... .......... .......... 8% 527K 4m59s 2023-11-18T19:08:41.706 INFO:tasks.workunit.client.1.smithi135.stderr: 14000K .......... .......... .......... .......... .......... 8% 411K 4m59s 2023-11-18T19:08:41.787 INFO:tasks.workunit.client.1.smithi135.stderr: 14050K .......... .......... .......... .......... .......... 8% 834K 4m59s 2023-11-18T19:08:41.798 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2023-11-18T19:08:41.798 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2023-11-18T19:08:41.844 INFO:tasks.workunit.client.1.smithi135.stderr: 14100K .......... .......... .......... .......... .......... 8% 633K 4m59s 2023-11-18T19:08:41.923 INFO:tasks.workunit.client.1.smithi135.stderr: 14150K .......... .......... .......... .......... .......... 8% 648K 4m58s 2023-11-18T19:08:42.000 INFO:tasks.workunit.client.1.smithi135.stderr: 14200K .......... .......... .......... .......... .......... 8% 634K 4m58s 2023-11-18T19:08:42.073 INFO:tasks.workunit.client.1.smithi135.stderr: 14250K .......... .......... .......... .......... .......... 8% 686K 4m58s 2023-11-18T19:08:42.156 INFO:tasks.workunit.client.1.smithi135.stderr: 14300K .......... .......... .......... .......... .......... 8% 609K 4m57s 2023-11-18T19:08:42.200 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2023-11-18T19:08:42.200 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2023-11-18T19:08:42.240 INFO:tasks.workunit.client.1.smithi135.stderr: 14350K .......... .......... .......... .......... .......... 8% 585K 4m57s 2023-11-18T19:08:42.321 INFO:tasks.workunit.client.1.smithi135.stderr: 14400K .......... .......... .......... .......... .......... 8% 632K 4m57s 2023-11-18T19:08:42.399 INFO:tasks.workunit.client.1.smithi135.stderr: 14450K .......... .......... .......... .......... .......... 8% 631K 4m57s 2023-11-18T19:08:42.411 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2023-11-18T19:08:42.411 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2023-11-18T19:08:42.480 INFO:tasks.workunit.client.1.smithi135.stderr: 14500K .......... .......... .......... .......... .......... 8% 614K 4m56s 2023-11-18T19:08:42.524 INFO:tasks.workunit.client.1.smithi135.stderr: 14550K .......... .......... .......... .......... .......... 8% 1.11M 4m56s 2023-11-18T19:08:42.610 INFO:tasks.workunit.client.0.smithi045.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2023-11-18T19:08:42.611 INFO:tasks.workunit.client.0.smithi045.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2023-11-18T19:08:42.612 INFO:tasks.workunit.client.1.smithi135.stderr: 14600K .......... .......... .......... .......... .......... 8% 573K 4m55s 2023-11-18T19:08:42.687 INFO:tasks.workunit.client.1.smithi135.stderr: 14650K .......... .......... .......... .......... .......... 8% 665K 4m55s 2023-11-18T19:08:42.765 INFO:tasks.workunit.client.1.smithi135.stderr: 14700K .......... .......... .......... .......... .......... 8% 640K 4m55s 2023-11-18T19:08:42.823 INFO:tasks.workunit.client.0.smithi045.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2023-11-18T19:08:42.855 INFO:tasks.workunit.client.1.smithi135.stderr: 14750K .......... .......... .......... .......... .......... 8% 572K 4m55s 2023-11-18T19:08:42.932 INFO:tasks.workunit.client.1.smithi135.stderr: 14800K .......... .......... .......... .......... .......... 8% 623K 4m54s 2023-11-18T19:08:43.015 INFO:tasks.workunit.client.1.smithi135.stderr: 14850K .......... .......... .......... .......... .......... 8% 1.12M 4m54s 2023-11-18T19:08:43.051 INFO:tasks.workunit.client.1.smithi135.stderr: 14900K .......... .......... .......... .......... .......... 8% 661K 4m54s 2023-11-18T19:08:43.099 INFO:tasks.workunit.client.0.smithi045.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-11-18T19:08:43.103 INFO:tasks.workunit.client.0.smithi045.stdout:Making all in man 2023-11-18T19:08:43.118 INFO:tasks.workunit.client.1.smithi135.stderr: 14950K .......... .......... .......... .......... .......... 8% 756K 4m53s 2023-11-18T19:08:43.148 INFO:tasks.workunit.client.0.smithi045.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-11-18T19:08:43.148 INFO:tasks.workunit.client.0.smithi045.stdout:make[2]: Nothing to be done for 'all'. 2023-11-18T19:08:43.148 INFO:tasks.workunit.client.0.smithi045.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-11-18T19:08:43.182 INFO:tasks.workunit.client.0.smithi045.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-18T19:08:43.185 INFO:tasks.workunit.client.1.smithi135.stderr: 15000K .......... .......... .......... .......... .......... 8% 738K 4m53s 2023-11-18T19:08:43.196 INFO:tasks.workunit.client.0.smithi045.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-18T19:08:43.199 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-18T19:08:43.203 INFO:tasks.workunit.client.0.smithi045.stderr:+ cd src 2023-11-18T19:08:43.213 INFO:tasks.workunit.client.0.smithi045.stderr:+ mkdir blogtest_in 2023-11-18T19:08:43.220 INFO:tasks.workunit.client.0.smithi045.stdout:running blogbench 2023-11-18T19:08:43.220 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'running blogbench' 2023-11-18T19:08:43.220 INFO:tasks.workunit.client.0.smithi045.stderr:+ ./blogbench -d blogtest_in 2023-11-18T19:08:43.224 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-18T19:08:43.224 INFO:tasks.workunit.client.0.smithi045.stdout:Frequency = 10 secs 2023-11-18T19:08:43.224 INFO:tasks.workunit.client.0.smithi045.stdout:Scratch dir = [blogtest_in] 2023-11-18T19:08:43.266 INFO:tasks.workunit.client.1.smithi135.stderr: 15050K .......... .......... .......... .......... .......... 8% 624K 4m52s 2023-11-18T19:08:43.349 INFO:tasks.workunit.client.1.smithi135.stderr: 15100K .......... .......... .......... .......... .......... 8% 606K 4m52s 2023-11-18T19:08:43.397 INFO:tasks.workunit.client.1.smithi135.stderr: 15150K .......... .......... .......... .......... .......... 9% 1013K 4m52s 2023-11-18T19:08:43.461 INFO:tasks.workunit.client.1.smithi135.stderr: 15200K .......... .......... .......... .......... .......... 9% 849K 4m51s 2023-11-18T19:08:43.534 INFO:tasks.workunit.client.1.smithi135.stderr: 15250K .......... .......... .......... .......... .......... 9% 639K 4m51s 2023-11-18T19:08:43.615 INFO:tasks.workunit.client.1.smithi135.stderr: 15300K .......... .......... .......... .......... .......... 9% 629K 4m51s 2023-11-18T19:08:43.667 INFO:tasks.workunit.client.1.smithi135.stderr: 15350K .......... .......... .......... .......... .......... 9% 949K 4m50s 2023-11-18T19:08:43.737 INFO:tasks.workunit.client.1.smithi135.stderr: 15400K .......... .......... .......... .......... .......... 9% 798K 4m50s 2023-11-18T19:08:43.802 INFO:tasks.workunit.client.1.smithi135.stderr: 15450K .......... .......... .......... .......... .......... 9% 684K 4m49s 2023-11-18T19:08:43.986 INFO:tasks.workunit.client.1.smithi135.stderr: 15500K .......... .......... .......... .......... .......... 9% 274K 4m50s 2023-11-18T19:08:43.986 INFO:tasks.workunit.client.1.smithi135.stderr: 15550K .......... .......... .......... .......... .......... 9% 72.0M 4m49s 2023-11-18T19:08:44.013 INFO:tasks.workunit.client.1.smithi135.stderr: 15600K .......... .......... .......... .......... .......... 9% 1.87M 4m48s 2023-11-18T19:08:44.082 INFO:tasks.workunit.client.1.smithi135.stderr: 15650K .......... .......... .......... .......... .......... 9% 711K 4m48s 2023-11-18T19:08:44.163 INFO:tasks.workunit.client.1.smithi135.stderr: 15700K .......... .......... .......... .......... .......... 9% 665K 4m48s 2023-11-18T19:08:44.238 INFO:tasks.workunit.client.1.smithi135.stderr: 15750K .......... .......... .......... .......... .......... 9% 620K 4m48s 2023-11-18T19:08:44.316 INFO:tasks.workunit.client.1.smithi135.stderr: 15800K .......... .......... .......... .......... .......... 9% 667K 4m47s 2023-11-18T19:08:44.398 INFO:tasks.workunit.client.1.smithi135.stderr: 15850K .......... .......... .......... .......... .......... 9% 592K 4m47s 2023-11-18T19:08:44.459 INFO:tasks.workunit.client.1.smithi135.stderr: 15900K .......... .......... .......... .......... .......... 9% 876K 4m47s 2023-11-18T19:08:44.536 INFO:tasks.workunit.client.1.smithi135.stderr: 15950K .......... .......... .......... .......... .......... 9% 611K 4m47s 2023-11-18T19:08:44.603 INFO:tasks.workunit.client.1.smithi135.stderr: 16000K .......... .......... .......... .......... .......... 9% 753K 4m46s 2023-11-18T19:08:44.679 INFO:tasks.workunit.client.1.smithi135.stderr: 16050K .......... .......... .......... .......... .......... 9% 659K 4m46s 2023-11-18T19:08:44.762 INFO:tasks.workunit.client.1.smithi135.stderr: 16100K .......... .......... .......... .......... .......... 9% 601K 4m46s 2023-11-18T19:08:44.824 INFO:tasks.workunit.client.1.smithi135.stderr: 16150K .......... .......... .......... .......... .......... 9% 836K 4m45s 2023-11-18T19:08:44.906 INFO:tasks.workunit.client.1.smithi135.stderr: 16200K .......... .......... .......... .......... .......... 9% 596K 4m45s 2023-11-18T19:08:45.073 INFO:tasks.workunit.client.0.smithi045.stdout:Spawning 3 writers... 2023-11-18T19:08:45.073 INFO:tasks.workunit.client.0.smithi045.stdout:Spawning 1 rewriters... 2023-11-18T19:08:45.073 INFO:tasks.workunit.client.0.smithi045.stdout:Spawning 5 commenters... 2023-11-18T19:08:45.074 INFO:tasks.workunit.client.0.smithi045.stdout:Spawning 100 readers... 2023-11-18T19:08:45.081 INFO:tasks.workunit.client.0.smithi045.stdout:Benchmarking for 30 iterations. 2023-11-18T19:08:45.081 INFO:tasks.workunit.client.0.smithi045.stdout:The test will run during 5 minutes. 2023-11-18T19:08:45.081 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-18T19:08:45.081 INFO:tasks.workunit.client.0.smithi045.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2023-11-18T19:08:45.097 INFO:tasks.workunit.client.1.smithi135.stderr: 16250K .......... .......... .......... .......... .......... 9% 261K 4m46s 2023-11-18T19:08:45.109 INFO:tasks.workunit.client.1.smithi135.stderr: 16300K .......... .......... .......... .......... .......... 9% 4.15M 4m45s 2023-11-18T19:08:45.146 INFO:tasks.workunit.client.1.smithi135.stderr: 16350K .......... .......... .......... .......... .......... 9% 1.31M 4m44s 2023-11-18T19:08:45.233 INFO:tasks.workunit.client.1.smithi135.stderr: 16400K .......... .......... .......... .......... .......... 9% 572K 4m44s 2023-11-18T19:08:45.322 INFO:tasks.workunit.client.1.smithi135.stderr: 16450K .......... .......... .......... .......... .......... 9% 560K 4m44s 2023-11-18T19:08:45.414 INFO:tasks.workunit.client.1.smithi135.stderr: 16500K .......... .......... .......... .......... .......... 9% 615K 4m44s 2023-11-18T19:08:45.491 INFO:tasks.workunit.client.1.smithi135.stderr: 16550K .......... .......... .......... .......... .......... 9% 579K 4m44s 2023-11-18T19:08:45.583 INFO:tasks.workunit.client.1.smithi135.stderr: 16600K .......... .......... .......... .......... .......... 9% 627K 4m44s 2023-11-18T19:08:45.661 INFO:tasks.workunit.client.1.smithi135.stderr: 16650K .......... .......... .......... .......... .......... 9% 549K 4m43s 2023-11-18T19:08:45.745 INFO:tasks.workunit.client.1.smithi135.stderr: 16700K .......... .......... .......... .......... .......... 9% 599K 4m43s 2023-11-18T19:08:45.839 INFO:tasks.workunit.client.1.smithi135.stderr: 16750K .......... .......... .......... .......... .......... 9% 528K 4m43s 2023-11-18T19:08:45.927 INFO:tasks.workunit.client.1.smithi135.stderr: 16800K .......... .......... .......... .......... .......... 9% 574K 4m43s 2023-11-18T19:08:46.013 INFO:tasks.workunit.client.1.smithi135.stderr: 16850K .......... .......... .......... .......... .......... 10% 580K 4m43s 2023-11-18T19:08:46.106 INFO:tasks.workunit.client.1.smithi135.stderr: 16900K .......... .......... .......... .......... .......... 10% 538K 4m43s 2023-11-18T19:08:46.282 INFO:tasks.workunit.client.1.smithi135.stderr: 16950K .......... .......... .......... .......... .......... 10% 284K 4m43s 2023-11-18T19:08:46.283 INFO:tasks.workunit.client.1.smithi135.stderr: 17000K .......... .......... .......... .......... .......... 10% 32.2M 4m43s 2023-11-18T19:08:46.366 INFO:tasks.workunit.client.1.smithi135.stderr: 17050K .......... .......... .......... .......... .......... 10% 659K 4m42s 2023-11-18T19:08:46.471 INFO:tasks.workunit.client.1.smithi135.stderr: 17100K .......... .......... .......... .......... .......... 10% 447K 4m42s 2023-11-18T19:08:46.562 INFO:tasks.workunit.client.1.smithi135.stderr: 17150K .......... .......... .......... .......... .......... 10% 553K 4m42s 2023-11-18T19:08:46.652 INFO:tasks.workunit.client.1.smithi135.stderr: 17200K .......... .......... .......... .......... .......... 10% 549K 4m42s 2023-11-18T19:08:46.747 INFO:tasks.workunit.client.1.smithi135.stderr: 17250K .......... .......... .......... .......... .......... 10% 536K 4m42s 2023-11-18T19:08:46.834 INFO:tasks.workunit.client.1.smithi135.stderr: 17300K .......... .......... .......... .......... .......... 10% 563K 4m42s 2023-11-18T19:08:46.934 INFO:tasks.workunit.client.1.smithi135.stderr: 17350K .......... .......... .......... .......... .......... 10% 505K 4m42s 2023-11-18T19:08:47.047 INFO:tasks.workunit.client.1.smithi135.stderr: 17400K .......... .......... .......... .......... .......... 10% 461K 4m42s 2023-11-18T19:08:47.139 INFO:tasks.workunit.client.1.smithi135.stderr: 17450K .......... .......... .......... .......... .......... 10% 516K 4m42s 2023-11-18T19:08:47.239 INFO:tasks.workunit.client.1.smithi135.stderr: 17500K .......... .......... .......... .......... .......... 10% 502K 4m42s 2023-11-18T19:08:47.332 INFO:tasks.workunit.client.1.smithi135.stderr: 17550K .......... .......... .......... .......... .......... 10% 536K 4m42s 2023-11-18T19:08:47.435 INFO:tasks.workunit.client.1.smithi135.stderr: 17600K .......... .......... .......... .......... .......... 10% 540K 4m42s 2023-11-18T19:08:47.603 INFO:tasks.workunit.client.1.smithi135.stderr: 17650K .......... .......... .......... .......... .......... 10% 281K 4m42s 2023-11-18T19:08:47.693 INFO:tasks.workunit.client.1.smithi135.stderr: 17700K .......... .......... .......... .......... .......... 10% 910K 4m42s 2023-11-18T19:08:47.803 INFO:tasks.workunit.client.1.smithi135.stderr: 17750K .......... .......... .......... .......... .......... 10% 342K 4m42s 2023-11-18T19:08:47.935 INFO:tasks.workunit.client.1.smithi135.stderr: 17800K .......... .......... .......... .......... .......... 10% 381K 4m42s 2023-11-18T19:08:48.073 INFO:tasks.workunit.client.1.smithi135.stderr: 17850K .......... .......... .......... .......... .......... 10% 364K 4m43s 2023-11-18T19:08:48.168 INFO:tasks.workunit.client.1.smithi135.stderr: 17900K .......... .......... .......... .......... .......... 10% 519K 4m43s 2023-11-18T19:08:48.307 INFO:tasks.workunit.client.1.smithi135.stderr: 17950K .......... .......... .......... .......... .......... 10% 371K 4m43s 2023-11-18T19:08:48.399 INFO:tasks.workunit.client.1.smithi135.stderr: 18000K .......... .......... .......... .......... .......... 10% 527K 4m43s 2023-11-18T19:08:48.492 INFO:tasks.workunit.client.1.smithi135.stderr: 18050K .......... .......... .......... .......... .......... 10% 533K 4m43s 2023-11-18T19:08:48.633 INFO:tasks.workunit.client.1.smithi135.stderr: 18100K .......... .......... .......... .......... .......... 10% 355K 4m43s 2023-11-18T19:08:48.731 INFO:tasks.workunit.client.1.smithi135.stderr: 18150K .......... .......... .......... .......... .......... 10% 511K 4m43s 2023-11-18T19:08:48.822 INFO:tasks.workunit.client.1.smithi135.stderr: 18200K .......... .......... .......... .......... .......... 10% 544K 4m43s 2023-11-18T19:08:48.911 INFO:tasks.workunit.client.1.smithi135.stderr: 18250K .......... .......... .......... .......... .......... 10% 563K 4m43s 2023-11-18T19:08:49.017 INFO:tasks.workunit.client.1.smithi135.stderr: 18300K .......... .......... .......... .......... .......... 10% 473K 4m43s 2023-11-18T19:08:49.116 INFO:tasks.workunit.client.1.smithi135.stderr: 18350K .......... .......... .......... .......... .......... 10% 505K 4m43s 2023-11-18T19:08:49.234 INFO:tasks.workunit.client.1.smithi135.stderr: 18400K .......... .......... .......... .......... .......... 10% 532K 4m43s 2023-11-18T19:08:49.325 INFO:tasks.workunit.client.1.smithi135.stderr: 18450K .......... .......... .......... .......... .......... 10% 434K 4m43s 2023-11-18T19:08:49.412 INFO:tasks.workunit.client.1.smithi135.stderr: 18500K .......... .......... .......... .......... .......... 11% 575K 4m42s 2023-11-18T19:08:49.515 INFO:tasks.workunit.client.1.smithi135.stderr: 18550K .......... .......... .......... .......... .......... 11% 483K 4m42s 2023-11-18T19:08:49.609 INFO:tasks.workunit.client.1.smithi135.stderr: 18600K .......... .......... .......... .......... .......... 11% 538K 4m42s 2023-11-18T19:08:49.721 INFO:tasks.workunit.client.1.smithi135.stderr: 18650K .......... .......... .......... .......... .......... 11% 442K 4m42s 2023-11-18T19:08:49.811 INFO:tasks.workunit.client.1.smithi135.stderr: 18700K .......... .......... .......... .......... .......... 11% 556K 4m42s 2023-11-18T19:08:49.909 INFO:tasks.workunit.client.1.smithi135.stderr: 18750K .......... .......... .......... .......... .......... 11% 525K 4m42s 2023-11-18T19:08:50.011 INFO:tasks.workunit.client.1.smithi135.stderr: 18800K .......... .......... .......... .......... .......... 11% 477K 4m42s 2023-11-18T19:08:50.123 INFO:tasks.workunit.client.1.smithi135.stderr: 18850K .......... .......... .......... .......... .......... 11% 450K 4m42s 2023-11-18T19:08:50.238 INFO:tasks.workunit.client.1.smithi135.stderr: 18900K .......... .......... .......... .......... .......... 11% 434K 4m42s 2023-11-18T19:08:50.442 INFO:tasks.workunit.client.1.smithi135.stderr: 18950K .......... .......... .......... .......... .......... 11% 245K 4m43s 2023-11-18T19:08:50.492 INFO:tasks.workunit.client.1.smithi135.stderr: 19000K .......... .......... .......... .......... .......... 11% 1.41M 4m42s 2023-11-18T19:08:50.583 INFO:tasks.workunit.client.1.smithi135.stderr: 19050K .......... .......... .......... .......... .......... 11% 468K 4m42s 2023-11-18T19:08:50.743 INFO:tasks.workunit.client.1.smithi135.stderr: 19100K .......... .......... .......... .......... .......... 11% 313K 4m43s 2023-11-18T19:08:50.839 INFO:tasks.workunit.client.1.smithi135.stderr: 19150K .......... .......... .......... .......... .......... 11% 525K 4m43s 2023-11-18T19:08:50.943 INFO:tasks.workunit.client.1.smithi135.stderr: 19200K .......... .......... .......... .......... .......... 11% 476K 4m43s 2023-11-18T19:08:51.030 INFO:tasks.workunit.client.1.smithi135.stderr: 19250K .......... .......... .......... .......... .......... 11% 593K 4m43s 2023-11-18T19:08:51.116 INFO:tasks.workunit.client.1.smithi135.stderr: 19300K .......... .......... .......... .......... .......... 11% 571K 4m42s 2023-11-18T19:08:51.198 INFO:tasks.workunit.client.1.smithi135.stderr: 19350K .......... .......... .......... .......... .......... 11% 608K 4m42s 2023-11-18T19:08:51.322 INFO:tasks.workunit.client.1.smithi135.stderr: 19400K .......... .......... .......... .......... .......... 11% 401K 4m42s 2023-11-18T19:08:51.412 INFO:tasks.workunit.client.1.smithi135.stderr: 19450K .......... .......... .......... .......... .......... 11% 557K 4m42s 2023-11-18T19:08:51.517 INFO:tasks.workunit.client.1.smithi135.stderr: 19500K .......... .......... .......... .......... .......... 11% 475K 4m42s 2023-11-18T19:08:51.662 INFO:tasks.workunit.client.1.smithi135.stderr: 19550K .......... .......... .......... .......... .......... 11% 345K 4m43s 2023-11-18T19:08:51.833 INFO:tasks.workunit.client.1.smithi135.stderr: 19600K .......... .......... .......... .......... .......... 11% 295K 4m43s 2023-11-18T19:08:51.945 INFO:tasks.workunit.client.1.smithi135.stderr: 19650K .......... .......... .......... .......... .......... 11% 442K 4m43s 2023-11-18T19:08:52.133 INFO:tasks.workunit.client.1.smithi135.stderr: 19700K .......... .......... .......... .......... .......... 11% 266K 4m44s 2023-11-18T19:08:52.337 INFO:tasks.workunit.client.1.smithi135.stderr: 19750K .......... .......... .......... .......... .......... 11% 245K 4m44s 2023-11-18T19:08:52.550 INFO:tasks.workunit.client.1.smithi135.stderr: 19800K .......... .......... .......... .......... .......... 11% 235K 4m45s 2023-11-18T19:08:52.781 INFO:tasks.workunit.client.1.smithi135.stderr: 19850K .......... .......... .......... .......... .......... 11% 251K 4m46s 2023-11-18T19:08:52.970 INFO:tasks.workunit.client.1.smithi135.stderr: 19900K .......... .......... .......... .......... .......... 11% 227K 4m47s 2023-11-18T19:08:53.217 INFO:tasks.workunit.client.1.smithi135.stderr: 19950K .......... .......... .......... .......... .......... 11% 203K 4m48s 2023-11-18T19:08:53.408 INFO:tasks.workunit.client.1.smithi135.stderr: 20000K .......... .......... .......... .......... .......... 11% 262K 4m48s 2023-11-18T19:08:53.600 INFO:tasks.workunit.client.1.smithi135.stderr: 20050K .......... .......... .......... .......... .......... 11% 260K 4m49s 2023-11-18T19:08:53.881 INFO:tasks.workunit.client.1.smithi135.stderr: 20100K .......... .......... .......... .......... .......... 11% 212K 4m50s 2023-11-18T19:08:54.080 INFO:tasks.workunit.client.1.smithi135.stderr: 20150K .......... .......... .......... .......... .......... 11% 205K 4m51s 2023-11-18T19:08:54.346 INFO:tasks.workunit.client.1.smithi135.stderr: 20200K .......... .......... .......... .......... .......... 12% 188K 4m52s 2023-11-18T19:08:54.469 INFO:tasks.workunit.client.1.smithi135.stderr: 20250K .......... .......... .......... .......... .......... 12% 426K 4m52s 2023-11-18T19:08:54.658 INFO:tasks.workunit.client.1.smithi135.stderr: 20300K .......... .......... .......... .......... .......... 12% 257K 4m53s 2023-11-18T19:08:54.875 INFO:tasks.workunit.client.1.smithi135.stderr: 20350K .......... .......... .......... .......... .......... 12% 229K 4m53s 2023-11-18T19:08:55.050 INFO:tasks.workunit.client.1.smithi135.stderr: 20400K .......... .......... .......... .......... .......... 12% 285K 4m54s 2023-11-18T19:08:55.081 INFO:tasks.workunit.client.0.smithi045.stdout: 4 7253 441 1574 202 4728 617 2023-11-18T19:08:55.234 INFO:tasks.workunit.client.1.smithi135.stderr: 20450K .......... .......... .......... .......... .......... 12% 271K 4m54s 2023-11-18T19:08:55.421 INFO:tasks.workunit.client.1.smithi135.stderr: 20500K .......... .......... .......... .......... .......... 12% 268K 4m55s 2023-11-18T19:08:55.569 INFO:tasks.workunit.client.1.smithi135.stderr: 20550K .......... .......... .......... .......... .......... 12% 339K 4m55s 2023-11-18T19:08:55.716 INFO:tasks.workunit.client.1.smithi135.stderr: 20600K .......... .......... .......... .......... .......... 12% 339K 4m55s 2023-11-18T19:08:55.831 INFO:tasks.workunit.client.1.smithi135.stderr: 20650K .......... .......... .......... .......... .......... 12% 436K 4m55s 2023-11-18T19:08:55.959 INFO:tasks.workunit.client.1.smithi135.stderr: 20700K .......... .......... .......... .......... .......... 12% 387K 4m55s 2023-11-18T19:08:56.120 INFO:tasks.workunit.client.1.smithi135.stderr: 20750K .......... .......... .......... .......... .......... 12% 341K 4m56s 2023-11-18T19:08:56.245 INFO:tasks.workunit.client.1.smithi135.stderr: 20800K .......... .......... .......... .......... .......... 12% 360K 4m56s 2023-11-18T19:08:56.372 INFO:tasks.workunit.client.1.smithi135.stderr: 20850K .......... .......... .......... .......... .......... 12% 395K 4m56s 2023-11-18T19:08:56.599 INFO:tasks.workunit.client.1.smithi135.stderr: 20900K .......... .......... .......... .......... .......... 12% 221K 4m57s 2023-11-18T19:08:56.670 INFO:tasks.workunit.client.1.smithi135.stderr: 20950K .......... .......... .......... .......... .......... 12% 697K 4m56s 2023-11-18T19:08:56.814 INFO:tasks.workunit.client.1.smithi135.stderr: 21000K .......... .......... .......... .......... .......... 12% 348K 4m57s 2023-11-18T19:08:56.963 INFO:tasks.workunit.client.1.smithi135.stderr: 21050K .......... .......... .......... .......... .......... 12% 337K 4m57s 2023-11-18T19:08:57.106 INFO:tasks.workunit.client.1.smithi135.stderr: 21100K .......... .......... .......... .......... .......... 12% 350K 4m57s 2023-11-18T19:08:57.229 INFO:tasks.workunit.client.1.smithi135.stderr: 21150K .......... .......... .......... .......... .......... 12% 404K 4m57s 2023-11-18T19:08:57.386 INFO:tasks.workunit.client.1.smithi135.stderr: 21200K .......... .......... .......... .......... .......... 12% 319K 4m57s 2023-11-18T19:08:57.494 INFO:tasks.workunit.client.1.smithi135.stderr: 21250K .......... .......... .......... .......... .......... 12% 462K 4m57s 2023-11-18T19:08:57.734 INFO:tasks.workunit.client.1.smithi135.stderr: 21300K .......... .......... .......... .......... .......... 12% 208K 4m58s 2023-11-18T19:08:57.809 INFO:tasks.workunit.client.1.smithi135.stderr: 21350K .......... .......... .......... .......... .......... 12% 664K 4m58s 2023-11-18T19:08:57.947 INFO:tasks.workunit.client.1.smithi135.stderr: 21400K .......... .......... .......... .......... .......... 12% 363K 4m58s 2023-11-18T19:08:58.090 INFO:tasks.workunit.client.1.smithi135.stderr: 21450K .......... .......... .......... .......... .......... 12% 357K 4m58s 2023-11-18T19:08:58.266 INFO:tasks.workunit.client.1.smithi135.stderr: 21500K .......... .......... .......... .......... .......... 12% 279K 4m59s 2023-11-18T19:08:58.445 INFO:tasks.workunit.client.1.smithi135.stderr: 21550K .......... .......... .......... .......... .......... 12% 279K 4m59s 2023-11-18T19:08:58.600 INFO:tasks.workunit.client.1.smithi135.stderr: 21600K .......... .......... .......... .......... .......... 12% 331K 4m59s 2023-11-18T19:08:58.758 INFO:tasks.workunit.client.1.smithi135.stderr: 21650K .......... .......... .......... .......... .......... 12% 309K 5m0s 2023-11-18T19:08:58.958 INFO:tasks.workunit.client.1.smithi135.stderr: 21700K .......... .......... .......... .......... .......... 12% 250K 5m0s 2023-11-18T19:08:59.101 INFO:tasks.workunit.client.1.smithi135.stderr: 21750K .......... .......... .......... .......... .......... 12% 351K 5m0s 2023-11-18T19:08:59.235 INFO:tasks.workunit.client.1.smithi135.stderr: 21800K .......... .......... .......... .......... .......... 12% 374K 5m0s 2023-11-18T19:08:59.348 INFO:tasks.workunit.client.1.smithi135.stderr: 21850K .......... .......... .......... .......... .......... 12% 441K 5m0s 2023-11-18T19:08:59.493 INFO:tasks.workunit.client.1.smithi135.stderr: 21900K .......... .......... .......... .......... .......... 13% 354K 5m1s 2023-11-18T19:08:59.609 INFO:tasks.workunit.client.1.smithi135.stderr: 21950K .......... .......... .......... .......... .......... 13% 419K 5m1s 2023-11-18T19:08:59.759 INFO:tasks.workunit.client.1.smithi135.stderr: 22000K .......... .......... .......... .......... .......... 13% 334K 5m1s 2023-11-18T19:08:59.852 INFO:tasks.workunit.client.1.smithi135.stderr: 22050K .......... .......... .......... .......... .......... 13% 537K 5m1s 2023-11-18T19:08:59.980 INFO:tasks.workunit.client.1.smithi135.stderr: 22100K .......... .......... .......... .......... .......... 13% 390K 5m1s 2023-11-18T19:09:00.075 INFO:tasks.workunit.client.1.smithi135.stderr: 22150K .......... .......... .......... .......... .......... 13% 527K 5m1s 2023-11-18T19:09:00.226 INFO:tasks.workunit.client.1.smithi135.stderr: 22200K .......... .......... .......... .......... .......... 13% 331K 5m1s 2023-11-18T19:09:00.318 INFO:tasks.workunit.client.1.smithi135.stderr: 22250K .......... .......... .......... .......... .......... 13% 541K 5m1s 2023-11-18T19:09:00.452 INFO:tasks.workunit.client.1.smithi135.stderr: 22300K .......... .......... .......... .......... .......... 13% 378K 5m1s 2023-11-18T19:09:00.586 INFO:tasks.workunit.client.1.smithi135.stderr: 22350K .......... .......... .......... .......... .......... 13% 369K 5m1s 2023-11-18T19:09:00.690 INFO:tasks.workunit.client.1.smithi135.stderr: 22400K .......... .......... .......... .......... .......... 13% 484K 5m1s 2023-11-18T19:09:00.832 INFO:tasks.workunit.client.1.smithi135.stderr: 22450K .......... .......... .......... .......... .......... 13% 352K 5m1s 2023-11-18T19:09:00.960 INFO:tasks.workunit.client.1.smithi135.stderr: 22500K .......... .......... .......... .......... .......... 13% 391K 5m1s 2023-11-18T19:09:01.056 INFO:tasks.workunit.client.1.smithi135.stderr: 22550K .......... .......... .......... .......... .......... 13% 525K 5m1s 2023-11-18T19:09:01.156 INFO:tasks.workunit.client.1.smithi135.stderr: 22600K .......... .......... .......... .......... .......... 13% 494K 5m1s 2023-11-18T19:09:01.249 INFO:tasks.workunit.client.1.smithi135.stderr: 22650K .......... .......... .......... .......... .......... 13% 544K 5m0s 2023-11-18T19:09:01.347 INFO:tasks.workunit.client.1.smithi135.stderr: 22700K .......... .......... .......... .......... .......... 13% 503K 5m0s 2023-11-18T19:09:01.430 INFO:tasks.workunit.client.1.smithi135.stderr: 22750K .......... .......... .......... .......... .......... 13% 601K 5m0s 2023-11-18T19:09:01.518 INFO:tasks.workunit.client.1.smithi135.stderr: 22800K .......... .......... .......... .......... .......... 13% 570K 5m0s 2023-11-18T19:09:01.632 INFO:tasks.workunit.client.1.smithi135.stderr: 22850K .......... .......... .......... .......... .......... 13% 438K 5m0s 2023-11-18T19:09:01.820 INFO:tasks.workunit.client.1.smithi135.stderr: 22900K .......... .......... .......... .......... .......... 13% 267K 5m0s 2023-11-18T19:09:01.828 INFO:tasks.workunit.client.1.smithi135.stderr: 22950K .......... .......... .......... .......... .......... 13% 7.74M 5m0s 2023-11-18T19:09:01.942 INFO:tasks.workunit.client.1.smithi135.stderr: 23000K .......... .......... .......... .......... .......... 13% 431K 5m0s 2023-11-18T19:09:02.114 INFO:tasks.workunit.client.1.smithi135.stderr: 23050K .......... .......... .......... .......... .......... 13% 290K 5m0s 2023-11-18T19:09:02.210 INFO:tasks.workunit.client.1.smithi135.stderr: 23100K .......... .......... .......... .......... .......... 13% 522K 5m0s 2023-11-18T19:09:02.301 INFO:tasks.workunit.client.1.smithi135.stderr: 23150K .......... .......... .......... .......... .......... 13% 550K 5m0s 2023-11-18T19:09:02.387 INFO:tasks.workunit.client.1.smithi135.stderr: 23200K .......... .......... .......... .......... .......... 13% 580K 4m59s 2023-11-18T19:09:02.473 INFO:tasks.workunit.client.1.smithi135.stderr: 23250K .......... .......... .......... .......... .......... 13% 585K 4m59s 2023-11-18T19:09:02.590 INFO:tasks.workunit.client.1.smithi135.stderr: 23300K .......... .......... .......... .......... .......... 13% 427K 4m59s 2023-11-18T19:09:02.675 INFO:tasks.workunit.client.1.smithi135.stderr: 23350K .......... .......... .......... .......... .......... 13% 597K 4m59s 2023-11-18T19:09:02.785 INFO:tasks.workunit.client.1.smithi135.stderr: 23400K .......... .......... .......... .......... .......... 13% 449K 4m59s 2023-11-18T19:09:02.877 INFO:tasks.workunit.client.1.smithi135.stderr: 23450K .......... .......... .......... .......... .......... 13% 542K 4m59s 2023-11-18T19:09:02.962 INFO:tasks.workunit.client.1.smithi135.stderr: 23500K .......... .......... .......... .......... .......... 13% 587K 4m59s 2023-11-18T19:09:03.053 INFO:tasks.workunit.client.1.smithi135.stderr: 23550K .......... .......... .......... .......... .......... 14% 551K 4m58s 2023-11-18T19:09:03.144 INFO:tasks.workunit.client.1.smithi135.stderr: 23600K .......... .......... .......... .......... .......... 14% 548K 4m58s 2023-11-18T19:09:03.246 INFO:tasks.workunit.client.1.smithi135.stderr: 23650K .......... .......... .......... .......... .......... 14% 489K 4m58s 2023-11-18T19:09:03.341 INFO:tasks.workunit.client.1.smithi135.stderr: 23700K .......... .......... .......... .......... .......... 14% 532K 4m58s 2023-11-18T19:09:03.437 INFO:tasks.workunit.client.1.smithi135.stderr: 23750K .......... .......... .......... .......... .......... 14% 520K 4m58s 2023-11-18T19:09:03.577 INFO:tasks.workunit.client.1.smithi135.stderr: 23800K .......... .......... .......... .......... .......... 14% 357K 4m58s 2023-11-18T19:09:03.623 INFO:tasks.workunit.client.1.smithi135.stderr: 23850K .......... .......... .......... .......... .......... 14% 1.06M 4m57s 2023-11-18T19:09:03.700 INFO:tasks.workunit.client.1.smithi135.stderr: 23900K .......... .......... .......... .......... .......... 14% 657K 4m57s 2023-11-18T19:09:03.847 INFO:tasks.workunit.client.1.smithi135.stderr: 23950K .......... .......... .......... .......... .......... 14% 337K 4m57s 2023-11-18T19:09:03.930 INFO:tasks.workunit.client.1.smithi135.stderr: 24000K .......... .......... .......... .......... .......... 14% 602K 4m57s 2023-11-18T19:09:04.026 INFO:tasks.workunit.client.1.smithi135.stderr: 24050K .......... .......... .......... .......... .......... 14% 521K 4m57s 2023-11-18T19:09:04.154 INFO:tasks.workunit.client.1.smithi135.stderr: 24100K .......... .......... .......... .......... .......... 14% 390K 4m57s 2023-11-18T19:09:04.269 INFO:tasks.workunit.client.1.smithi135.stderr: 24150K .......... .......... .......... .......... .......... 14% 435K 4m57s 2023-11-18T19:09:04.363 INFO:tasks.workunit.client.1.smithi135.stderr: 24200K .......... .......... .......... .......... .......... 14% 531K 4m57s 2023-11-18T19:09:04.459 INFO:tasks.workunit.client.1.smithi135.stderr: 24250K .......... .......... .......... .......... .......... 14% 527K 4m57s 2023-11-18T19:09:04.600 INFO:tasks.workunit.client.1.smithi135.stderr: 24300K .......... .......... .......... .......... .......... 14% 354K 4m57s 2023-11-18T19:09:04.721 INFO:tasks.workunit.client.1.smithi135.stderr: 24350K .......... .......... .......... .......... .......... 14% 423K 4m57s 2023-11-18T19:09:04.804 INFO:tasks.workunit.client.1.smithi135.stderr: 24400K .......... .......... .......... .......... .......... 14% 578K 4m57s 2023-11-18T19:09:04.888 INFO:tasks.workunit.client.1.smithi135.stderr: 24450K .......... .......... .......... .......... .......... 14% 600K 4m56s 2023-11-18T19:09:04.971 INFO:tasks.workunit.client.1.smithi135.stderr: 24500K .......... .......... .......... .......... .......... 14% 600K 4m56s 2023-11-18T19:09:05.055 INFO:tasks.workunit.client.1.smithi135.stderr: 24550K .......... .......... .......... .......... .......... 14% 596K 4m56s 2023-11-18T19:09:05.081 INFO:tasks.workunit.client.0.smithi045.stdout: 9 10697 211 3997 185 1667 411 2023-11-18T19:09:05.149 INFO:tasks.workunit.client.1.smithi135.stderr: 24600K .......... .......... .......... .......... .......... 14% 535K 4m56s 2023-11-18T19:09:05.266 INFO:tasks.workunit.client.1.smithi135.stderr: 24650K .......... .......... .......... .......... .......... 14% 423K 4m56s 2023-11-18T19:09:05.353 INFO:tasks.workunit.client.1.smithi135.stderr: 24700K .......... .......... .......... .......... .......... 14% 578K 4m56s 2023-11-18T19:09:05.446 INFO:tasks.workunit.client.1.smithi135.stderr: 24750K .......... .......... .......... .......... .......... 14% 533K 4m55s 2023-11-18T19:09:05.546 INFO:tasks.workunit.client.1.smithi135.stderr: 24800K .......... .......... .......... .......... .......... 14% 562K 4m55s 2023-11-18T19:09:05.639 INFO:tasks.workunit.client.1.smithi135.stderr: 24850K .......... .......... .......... .......... .......... 14% 483K 4m55s 2023-11-18T19:09:05.841 INFO:tasks.workunit.client.1.smithi135.stderr: 24900K .......... .......... .......... .......... .......... 14% 248K 4m56s 2023-11-18T19:09:05.842 INFO:tasks.workunit.client.1.smithi135.stderr: 24950K .......... .......... .......... .......... .......... 14% 72.8M 4m55s 2023-11-18T19:09:05.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:09:05.909 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:09:05.920 INFO:tasks.workunit.client.1.smithi135.stderr: 25000K .......... .......... .......... .......... .......... 14% 630K 4m55s 2023-11-18T19:09:06.028 INFO:tasks.workunit.client.1.smithi135.stderr: 25050K .......... .......... .......... .......... .......... 14% 467K 4m55s 2023-11-18T19:09:06.114 INFO:tasks.workunit.client.1.smithi135.stderr: 25100K .......... .......... .......... .......... .......... 14% 578K 4m54s 2023-11-18T19:09:06.211 INFO:tasks.workunit.client.1.smithi135.stderr: 25150K .......... .......... .......... .......... .......... 14% 529K 4m54s 2023-11-18T19:09:06.314 INFO:tasks.workunit.client.1.smithi135.stderr: 25200K .......... .......... .......... .......... .......... 14% 474K 4m54s 2023-11-18T19:09:06.418 INFO:tasks.workunit.client.1.smithi135.stderr: 25250K .......... .......... .......... .......... .......... 15% 483K 4m54s 2023-11-18T19:09:06.500 INFO:tasks.workunit.client.1.smithi135.stderr: 25300K .......... .......... .......... .......... .......... 15% 606K 4m54s 2023-11-18T19:09:06.596 INFO:tasks.workunit.client.1.smithi135.stderr: 25350K .......... .......... .......... .......... .......... 15% 523K 4m54s 2023-11-18T19:09:06.689 INFO:tasks.workunit.client.1.smithi135.stderr: 25400K .......... .......... .......... .......... .......... 15% 610K 4m53s 2023-11-18T19:09:06.777 INFO:tasks.workunit.client.1.smithi135.stderr: 25450K .......... .......... .......... .......... .......... 15% 505K 4m53s 2023-11-18T19:09:06.884 INFO:tasks.workunit.client.1.smithi135.stderr: 25500K .......... .......... .......... .......... .......... 15% 521K 4m53s 2023-11-18T19:09:06.978 INFO:tasks.workunit.client.1.smithi135.stderr: 25550K .......... .......... .......... .......... .......... 15% 475K 4m53s 2023-11-18T19:09:07.096 INFO:tasks.workunit.client.1.smithi135.stderr: 25600K .......... .......... .......... .......... .......... 15% 468K 4m53s 2023-11-18T19:09:07.186 INFO:tasks.workunit.client.1.smithi135.stderr: 25650K .......... .......... .......... .......... .......... 15% 493K 4m53s 2023-11-18T19:09:07.298 INFO:tasks.workunit.client.1.smithi135.stderr: 25700K .......... .......... .......... .......... .......... 15% 450K 4m53s 2023-11-18T19:09:07.414 INFO:tasks.workunit.client.1.smithi135.stderr: 25750K .......... .......... .......... .......... .......... 15% 429K 4m53s 2023-11-18T19:09:07.534 INFO:tasks.workunit.client.1.smithi135.stderr: 25800K .......... .......... .......... .......... .......... 15% 415K 4m53s 2023-11-18T19:09:07.627 INFO:tasks.workunit.client.1.smithi135.stderr: 25850K .......... .......... .......... .......... .......... 15% 542K 4m53s 2023-11-18T19:09:07.714 INFO:tasks.workunit.client.1.smithi135.stderr: 25900K .......... .......... .......... .......... .......... 15% 570K 4m53s 2023-11-18T19:09:07.815 INFO:tasks.workunit.client.1.smithi135.stderr: 25950K .......... .......... .......... .......... .......... 15% 495K 4m52s 2023-11-18T19:09:07.920 INFO:tasks.workunit.client.1.smithi135.stderr: 26000K .......... .......... .......... .......... .......... 15% 478K 4m52s 2023-11-18T19:09:08.125 INFO:tasks.workunit.client.1.smithi135.stderr: 26050K .......... .......... .......... .......... .......... 15% 264K 4m53s 2023-11-18T19:09:08.162 INFO:tasks.workunit.client.1.smithi135.stderr: 26100K .......... .......... .......... .......... .......... 15% 1.23M 4m52s 2023-11-18T19:09:08.284 INFO:tasks.workunit.client.1.smithi135.stderr: 26150K .......... .......... .......... .......... .......... 15% 371K 4m52s 2023-11-18T19:09:08.384 INFO:tasks.workunit.client.1.smithi135.stderr: 26200K .......... .......... .......... .......... .......... 15% 497K 4m52s 2023-11-18T19:09:08.528 INFO:tasks.workunit.client.1.smithi135.stderr: 26250K .......... .......... .......... .......... .......... 15% 347K 4m52s 2023-11-18T19:09:08.632 INFO:tasks.workunit.client.1.smithi135.stderr: 26300K .......... .......... .......... .......... .......... 15% 484K 4m52s 2023-11-18T19:09:08.754 INFO:tasks.workunit.client.1.smithi135.stderr: 26350K .......... .......... .......... .......... .......... 15% 409K 4m52s 2023-11-18T19:09:08.868 INFO:tasks.workunit.client.1.smithi135.stderr: 26400K .......... .......... .......... .......... .......... 15% 478K 4m52s 2023-11-18T19:09:08.981 INFO:tasks.workunit.client.1.smithi135.stderr: 26450K .......... .......... .......... .......... .......... 15% 409K 4m52s 2023-11-18T19:09:09.096 INFO:tasks.workunit.client.1.smithi135.stderr: 26500K .......... .......... .......... .......... .......... 15% 436K 4m52s 2023-11-18T19:09:09.200 INFO:tasks.workunit.client.1.smithi135.stderr: 26550K .......... .......... .......... .......... .......... 15% 481K 4m52s 2023-11-18T19:09:09.335 INFO:tasks.workunit.client.1.smithi135.stderr: 26600K .......... .......... .......... .......... .......... 15% 474K 4m52s 2023-11-18T19:09:09.430 INFO:tasks.workunit.client.1.smithi135.stderr: 26650K .......... .......... .......... .......... .......... 15% 402K 4m52s 2023-11-18T19:09:09.539 INFO:tasks.workunit.client.1.smithi135.stderr: 26700K .......... .......... .......... .......... .......... 15% 458K 4m52s 2023-11-18T19:09:09.646 INFO:tasks.workunit.client.1.smithi135.stderr: 26750K .......... .......... .......... .......... .......... 15% 464K 4m52s 2023-11-18T19:09:09.754 INFO:tasks.workunit.client.1.smithi135.stderr: 26800K .......... .......... .......... .......... .......... 15% 464K 4m52s 2023-11-18T19:09:09.885 INFO:tasks.workunit.client.1.smithi135.stderr: 26850K .......... .......... .......... .......... .......... 15% 384K 4m52s 2023-11-18T19:09:09.984 INFO:tasks.workunit.client.1.smithi135.stderr: 26900K .......... .......... .......... .......... .......... 15% 504K 4m52s 2023-11-18T19:09:10.081 INFO:tasks.workunit.client.1.smithi135.stderr: 26950K .......... .......... .......... .......... .......... 16% 571K 4m51s 2023-11-18T19:09:10.188 INFO:tasks.workunit.client.1.smithi135.stderr: 27000K .......... .......... .......... .......... .......... 16% 427K 4m51s 2023-11-18T19:09:10.293 INFO:tasks.workunit.client.1.smithi135.stderr: 27050K .......... .......... .......... .......... .......... 16% 482K 4m51s 2023-11-18T19:09:10.421 INFO:tasks.workunit.client.1.smithi135.stderr: 27100K .......... .......... .......... .......... .......... 16% 391K 4m51s 2023-11-18T19:09:10.517 INFO:tasks.workunit.client.1.smithi135.stderr: 27150K .......... .......... .......... .......... .......... 16% 515K 4m51s 2023-11-18T19:09:10.637 INFO:tasks.workunit.client.1.smithi135.stderr: 27200K .......... .......... .......... .......... .......... 16% 416K 4m51s 2023-11-18T19:09:10.738 INFO:tasks.workunit.client.1.smithi135.stderr: 27250K .......... .......... .......... .......... .......... 16% 495K 4m51s 2023-11-18T19:09:10.820 INFO:tasks.workunit.client.1.smithi135.stderr: 27300K .......... .......... .......... .......... .......... 16% 630K 4m51s 2023-11-18T19:09:10.975 INFO:tasks.workunit.client.1.smithi135.stderr: 27350K .......... .......... .......... .......... .......... 16% 329K 4m51s 2023-11-18T19:09:11.077 INFO:tasks.workunit.client.1.smithi135.stderr: 27400K .......... .......... .......... .......... .......... 16% 485K 4m51s 2023-11-18T19:09:11.170 INFO:tasks.workunit.client.1.smithi135.stderr: 27450K .......... .......... .......... .......... .......... 16% 514K 4m51s 2023-11-18T19:09:11.319 INFO:tasks.workunit.client.1.smithi135.stderr: 27500K .......... .......... .......... .......... .......... 16% 336K 4m51s 2023-11-18T19:09:11.420 INFO:tasks.workunit.client.1.smithi135.stderr: 27550K .......... .......... .......... .......... .......... 16% 494K 4m51s 2023-11-18T19:09:11.606 INFO:tasks.workunit.client.1.smithi135.stderr: 27600K .......... .......... .......... .......... .......... 16% 270K 4m51s 2023-11-18T19:09:11.653 INFO:tasks.workunit.client.1.smithi135.stderr: 27650K .......... .......... .......... .......... .......... 16% 1.35M 4m51s 2023-11-18T19:09:11.796 INFO:tasks.workunit.client.1.smithi135.stderr: 27700K .......... .......... .......... .......... .......... 16% 325K 4m51s 2023-11-18T19:09:11.910 INFO:tasks.workunit.client.1.smithi135.stderr: 27750K .......... .......... .......... .......... .......... 16% 439K 4m51s 2023-11-18T19:09:12.052 INFO:tasks.workunit.client.1.smithi135.stderr: 27800K .......... .......... .......... .......... .......... 16% 352K 4m51s 2023-11-18T19:09:12.198 INFO:tasks.workunit.client.1.smithi135.stderr: 27850K .......... .......... .......... .......... .......... 16% 364K 4m51s 2023-11-18T19:09:12.342 INFO:tasks.workunit.client.1.smithi135.stderr: 27900K .......... .......... .......... .......... .......... 16% 326K 4m51s 2023-11-18T19:09:12.466 INFO:tasks.workunit.client.1.smithi135.stderr: 27950K .......... .......... .......... .......... .......... 16% 406K 4m51s 2023-11-18T19:09:12.606 INFO:tasks.workunit.client.1.smithi135.stderr: 28000K .......... .......... .......... .......... .......... 16% 355K 4m51s 2023-11-18T19:09:12.731 INFO:tasks.workunit.client.1.smithi135.stderr: 28050K .......... .......... .......... .......... .......... 16% 402K 4m51s 2023-11-18T19:09:12.806 INFO:tasks.workunit.client.1.smithi135.stderr: 28100K .......... .......... .......... .......... .......... 16% 680K 4m51s 2023-11-18T19:09:12.913 INFO:tasks.workunit.client.1.smithi135.stderr: 28150K .......... .......... .......... .......... .......... 16% 458K 4m51s 2023-11-18T19:09:13.001 INFO:tasks.workunit.client.1.smithi135.stderr: 28200K .......... .......... .......... .......... .......... 16% 602K 4m51s 2023-11-18T19:09:13.110 INFO:tasks.workunit.client.1.smithi135.stderr: 28250K .......... .......... .......... .......... .......... 16% 439K 4m51s 2023-11-18T19:09:13.211 INFO:tasks.workunit.client.1.smithi135.stderr: 28300K .......... .......... .......... .......... .......... 16% 533K 4m50s 2023-11-18T19:09:13.312 INFO:tasks.workunit.client.1.smithi135.stderr: 28350K .......... .......... .......... .......... .......... 16% 462K 4m50s 2023-11-18T19:09:13.397 INFO:tasks.workunit.client.1.smithi135.stderr: 28400K .......... .......... .......... .......... .......... 16% 586K 4m50s 2023-11-18T19:09:13.493 INFO:tasks.workunit.client.1.smithi135.stderr: 28450K .......... .......... .......... .......... .......... 16% 521K 4m50s 2023-11-18T19:09:13.612 INFO:tasks.workunit.client.1.smithi135.stderr: 28500K .......... .......... .......... .......... .......... 16% 421K 4m50s 2023-11-18T19:09:13.705 INFO:tasks.workunit.client.1.smithi135.stderr: 28550K .......... .......... .......... .......... .......... 16% 553K 4m50s 2023-11-18T19:09:13.802 INFO:tasks.workunit.client.1.smithi135.stderr: 28600K .......... .......... .......... .......... .......... 16% 505K 4m50s 2023-11-18T19:09:13.893 INFO:tasks.workunit.client.1.smithi135.stderr: 28650K .......... .......... .......... .......... .......... 17% 550K 4m50s 2023-11-18T19:09:13.984 INFO:tasks.workunit.client.1.smithi135.stderr: 28700K .......... .......... .......... .......... .......... 17% 543K 4m49s 2023-11-18T19:09:14.084 INFO:tasks.workunit.client.1.smithi135.stderr: 28750K .......... .......... .......... .......... .......... 17% 527K 4m49s 2023-11-18T19:09:14.178 INFO:tasks.workunit.client.1.smithi135.stderr: 28800K .......... .......... .......... .......... .......... 17% 506K 4m49s 2023-11-18T19:09:14.378 INFO:tasks.workunit.client.1.smithi135.stderr: 28850K .......... .......... .......... .......... .......... 17% 250K 4m49s 2023-11-18T19:09:14.384 INFO:tasks.workunit.client.1.smithi135.stderr: 28900K .......... .......... .......... .......... .......... 17% 8.48M 4m49s 2023-11-18T19:09:14.519 INFO:tasks.workunit.client.1.smithi135.stderr: 28950K .......... .......... .......... .......... .......... 17% 370K 4m49s 2023-11-18T19:09:14.610 INFO:tasks.workunit.client.1.smithi135.stderr: 29000K .......... .......... .......... .......... .......... 17% 544K 4m49s 2023-11-18T19:09:14.731 INFO:tasks.workunit.client.1.smithi135.stderr: 29050K .......... .......... .......... .......... .......... 17% 422K 4m49s 2023-11-18T19:09:14.867 INFO:tasks.workunit.client.1.smithi135.stderr: 29100K .......... .......... .......... .......... .......... 17% 363K 4m49s 2023-11-18T19:09:14.950 INFO:tasks.workunit.client.1.smithi135.stderr: 29150K .......... .......... .......... .......... .......... 17% 601K 4m49s 2023-11-18T19:09:15.031 INFO:tasks.workunit.client.1.smithi135.stderr: 29200K .......... .......... .......... .......... .......... 17% 621K 4m48s 2023-11-18T19:09:15.081 INFO:tasks.workunit.client.0.smithi045.stdout: 11 10706 141 5177 90 2772 206 2023-11-18T19:09:15.124 INFO:tasks.workunit.client.1.smithi135.stderr: 29250K .......... .......... .......... .......... .......... 17% 596K 4m48s 2023-11-18T19:09:15.201 INFO:tasks.workunit.client.1.smithi135.stderr: 29300K .......... .......... .......... .......... .......... 17% 578K 4m48s 2023-11-18T19:09:15.293 INFO:tasks.workunit.client.1.smithi135.stderr: 29350K .......... .......... .......... .......... .......... 17% 540K 4m48s 2023-11-18T19:09:15.399 INFO:tasks.workunit.client.1.smithi135.stderr: 29400K .......... .......... .......... .......... .......... 17% 499K 4m48s 2023-11-18T19:09:15.521 INFO:tasks.workunit.client.1.smithi135.stderr: 29450K .......... .......... .......... .......... .......... 17% 391K 4m48s 2023-11-18T19:09:15.622 INFO:tasks.workunit.client.1.smithi135.stderr: 29500K .......... .......... .......... .......... .......... 17% 599K 4m48s 2023-11-18T19:09:15.704 INFO:tasks.workunit.client.1.smithi135.stderr: 29550K .......... .......... .......... .......... .......... 17% 507K 4m47s 2023-11-18T19:09:15.789 INFO:tasks.workunit.client.1.smithi135.stderr: 29600K .......... .......... .......... .......... .......... 17% 598K 4m47s 2023-11-18T19:09:15.875 INFO:tasks.workunit.client.1.smithi135.stderr: 29650K .......... .......... .......... .......... .......... 17% 572K 4m47s 2023-11-18T19:09:16.085 INFO:tasks.workunit.client.1.smithi135.stderr: 29700K .......... .......... .......... .......... .......... 17% 473K 4m47s 2023-11-18T19:09:16.140 INFO:tasks.workunit.client.1.smithi135.stderr: 29750K .......... .......... .......... .......... .......... 17% 315K 4m47s 2023-11-18T19:09:16.163 INFO:tasks.workunit.client.1.smithi135.stderr: 29800K .......... .......... .......... .......... .......... 17% 2.01M 4m47s 2023-11-18T19:09:16.283 INFO:tasks.workunit.client.1.smithi135.stderr: 29850K .......... .......... .......... .......... .......... 17% 419K 4m47s 2023-11-18T19:09:16.379 INFO:tasks.workunit.client.1.smithi135.stderr: 29900K .......... .......... .......... .......... .......... 17% 584K 4m46s 2023-11-18T19:09:16.513 INFO:tasks.workunit.client.1.smithi135.stderr: 29950K .......... .......... .......... .......... .......... 17% 347K 4m46s 2023-11-18T19:09:16.616 INFO:tasks.workunit.client.1.smithi135.stderr: 30000K .......... .......... .......... .......... .......... 17% 486K 4m46s 2023-11-18T19:09:16.708 INFO:tasks.workunit.client.1.smithi135.stderr: 30050K .......... .......... .......... .......... .......... 17% 545K 4m46s 2023-11-18T19:09:16.843 INFO:tasks.workunit.client.1.smithi135.stderr: 30100K .......... .......... .......... .......... .......... 17% 370K 4m46s 2023-11-18T19:09:16.927 INFO:tasks.workunit.client.1.smithi135.stderr: 30150K .......... .......... .......... .......... .......... 17% 602K 4m46s 2023-11-18T19:09:17.021 INFO:tasks.workunit.client.1.smithi135.stderr: 30200K .......... .......... .......... .......... .......... 17% 526K 4m46s 2023-11-18T19:09:17.255 INFO:tasks.workunit.client.1.smithi135.stderr: 30250K .......... .......... .......... .......... .......... 17% 214K 4m46s 2023-11-18T19:09:17.265 INFO:tasks.workunit.client.1.smithi135.stderr: 30300K .......... .......... .......... .......... .......... 18% 4.74M 4m46s 2023-11-18T19:09:17.393 INFO:tasks.workunit.client.1.smithi135.stderr: 30350K .......... .......... .......... .......... .......... 18% 401K 4m46s 2023-11-18T19:09:17.510 INFO:tasks.workunit.client.1.smithi135.stderr: 30400K .......... .......... .......... .......... .......... 18% 474K 4m46s 2023-11-18T19:09:17.610 INFO:tasks.workunit.client.1.smithi135.stderr: 30450K .......... .......... .......... .......... .......... 18% 438K 4m46s 2023-11-18T19:09:17.740 INFO:tasks.workunit.client.1.smithi135.stderr: 30500K .......... .......... .......... .......... .......... 18% 393K 4m46s 2023-11-18T19:09:17.833 INFO:tasks.workunit.client.1.smithi135.stderr: 30550K .......... .......... .......... .......... .......... 18% 519K 4m46s 2023-11-18T19:09:17.951 INFO:tasks.workunit.client.1.smithi135.stderr: 30600K .......... .......... .......... .......... .......... 18% 424K 4m46s 2023-11-18T19:09:18.050 INFO:tasks.workunit.client.1.smithi135.stderr: 30650K .......... .......... .......... .......... .......... 18% 504K 4m45s 2023-11-18T19:09:18.149 INFO:tasks.workunit.client.1.smithi135.stderr: 30700K .......... .......... .......... .......... .......... 18% 504K 4m45s 2023-11-18T19:09:18.283 INFO:tasks.workunit.client.1.smithi135.stderr: 30750K .......... .......... .......... .......... .......... 18% 375K 4m45s 2023-11-18T19:09:18.406 INFO:tasks.workunit.client.1.smithi135.stderr: 30800K .......... .......... .......... .......... .......... 18% 407K 4m45s 2023-11-18T19:09:18.524 INFO:tasks.workunit.client.1.smithi135.stderr: 30850K .......... .......... .......... .......... .......... 18% 490K 4m45s 2023-11-18T19:09:18.640 INFO:tasks.workunit.client.1.smithi135.stderr: 30900K .......... .......... .......... .......... .......... 18% 378K 4m45s 2023-11-18T19:09:18.750 INFO:tasks.workunit.client.1.smithi135.stderr: 30950K .......... .......... .......... .......... .......... 18% 460K 4m45s 2023-11-18T19:09:18.915 INFO:tasks.workunit.client.1.smithi135.stderr: 31000K .......... .......... .......... .......... .......... 18% 300K 4m45s 2023-11-18T19:09:19.030 INFO:tasks.workunit.client.1.smithi135.stderr: 31050K .......... .......... .......... .......... .......... 18% 444K 4m45s 2023-11-18T19:09:19.139 INFO:tasks.workunit.client.1.smithi135.stderr: 31100K .......... .......... .......... .......... .......... 18% 449K 4m45s 2023-11-18T19:09:19.250 INFO:tasks.workunit.client.1.smithi135.stderr: 31150K .......... .......... .......... .......... .......... 18% 453K 4m45s 2023-11-18T19:09:19.374 INFO:tasks.workunit.client.1.smithi135.stderr: 31200K .......... .......... .......... .......... .......... 18% 416K 4m45s 2023-11-18T19:09:19.488 INFO:tasks.workunit.client.1.smithi135.stderr: 31250K .......... .......... .......... .......... .......... 18% 424K 4m45s 2023-11-18T19:09:19.604 INFO:tasks.workunit.client.1.smithi135.stderr: 31300K .......... .......... .......... .......... .......... 18% 454K 4m45s 2023-11-18T19:09:19.704 INFO:tasks.workunit.client.1.smithi135.stderr: 31350K .......... .......... .......... .......... .......... 18% 471K 4m45s 2023-11-18T19:09:19.833 INFO:tasks.workunit.client.1.smithi135.stderr: 31400K .......... .......... .......... .......... .......... 18% 390K 4m45s 2023-11-18T19:09:19.940 INFO:tasks.workunit.client.1.smithi135.stderr: 31450K .......... .......... .......... .......... .......... 18% 465K 4m45s 2023-11-18T19:09:20.037 INFO:tasks.workunit.client.1.smithi135.stderr: 31500K .......... .......... .......... .......... .......... 18% 516K 4m45s 2023-11-18T19:09:20.187 INFO:tasks.workunit.client.1.smithi135.stderr: 31550K .......... .......... .......... .......... .......... 18% 335K 4m45s 2023-11-18T19:09:20.310 INFO:tasks.workunit.client.1.smithi135.stderr: 31600K .......... .......... .......... .......... .......... 18% 407K 4m45s 2023-11-18T19:09:20.470 INFO:tasks.workunit.client.1.smithi135.stderr: 31650K .......... .......... .......... .......... .......... 18% 315K 4m45s 2023-11-18T19:09:20.609 INFO:tasks.workunit.client.1.smithi135.stderr: 31700K .......... .......... .......... .......... .......... 18% 355K 4m45s 2023-11-18T19:09:20.731 INFO:tasks.workunit.client.1.smithi135.stderr: 31750K .......... .......... .......... .......... .......... 18% 423K 4m45s 2023-11-18T19:09:20.875 INFO:tasks.workunit.client.1.smithi135.stderr: 31800K .......... .......... .......... .......... .......... 18% 339K 4m45s 2023-11-18T19:09:21.034 INFO:tasks.workunit.client.1.smithi135.stderr: 31850K .......... .......... .......... .......... .......... 18% 391K 4m45s 2023-11-18T19:09:21.163 INFO:tasks.workunit.client.1.smithi135.stderr: 31900K .......... .......... .......... .......... .......... 18% 311K 4m45s 2023-11-18T19:09:21.314 INFO:tasks.workunit.client.1.smithi135.stderr: 31950K .......... .......... .......... .......... .......... 18% 373K 4m45s 2023-11-18T19:09:21.439 INFO:tasks.workunit.client.1.smithi135.stderr: 32000K .......... .......... .......... .......... .......... 19% 354K 4m45s 2023-11-18T19:09:21.556 INFO:tasks.workunit.client.1.smithi135.stderr: 32050K .......... .......... .......... .......... .......... 19% 426K 4m45s 2023-11-18T19:09:21.668 INFO:tasks.workunit.client.1.smithi135.stderr: 32100K .......... .......... .......... .......... .......... 19% 449K 4m45s 2023-11-18T19:09:21.781 INFO:tasks.workunit.client.1.smithi135.stderr: 32150K .......... .......... .......... .......... .......... 19% 440K 4m45s 2023-11-18T19:09:21.890 INFO:tasks.workunit.client.1.smithi135.stderr: 32200K .......... .......... .......... .......... .......... 19% 461K 4m45s 2023-11-18T19:09:21.989 INFO:tasks.workunit.client.1.smithi135.stderr: 32250K .......... .......... .......... .......... .......... 19% 499K 4m45s 2023-11-18T19:09:22.102 INFO:tasks.workunit.client.1.smithi135.stderr: 32300K .......... .......... .......... .......... .......... 19% 509K 4m45s 2023-11-18T19:09:22.198 INFO:tasks.workunit.client.1.smithi135.stderr: 32350K .......... .......... .......... .......... .......... 19% 455K 4m45s 2023-11-18T19:09:22.291 INFO:tasks.workunit.client.1.smithi135.stderr: 32400K .......... .......... .......... .......... .......... 19% 534K 4m44s 2023-11-18T19:09:22.365 INFO:tasks.workunit.client.1.smithi135.stderr: 32450K .......... .......... .......... .......... .......... 19% 677K 4m44s 2023-11-18T19:09:22.452 INFO:tasks.workunit.client.1.smithi135.stderr: 32500K .......... .......... .......... .......... .......... 19% 576K 4m44s 2023-11-18T19:09:22.543 INFO:tasks.workunit.client.1.smithi135.stderr: 32550K .......... .......... .......... .......... .......... 19% 549K 4m44s 2023-11-18T19:09:22.613 INFO:tasks.workunit.client.1.smithi135.stderr: 32600K .......... .......... .......... .......... .......... 19% 718K 4m44s 2023-11-18T19:09:22.690 INFO:tasks.workunit.client.1.smithi135.stderr: 32650K .......... .......... .......... .......... .......... 19% 667K 4m43s 2023-11-18T19:09:22.781 INFO:tasks.workunit.client.1.smithi135.stderr: 32700K .......... .......... .......... .......... .......... 19% 536K 4m43s 2023-11-18T19:09:22.873 INFO:tasks.workunit.client.1.smithi135.stderr: 32750K .......... .......... .......... .......... .......... 19% 544K 4m43s 2023-11-18T19:09:22.957 INFO:tasks.workunit.client.1.smithi135.stderr: 32800K .......... .......... .......... .......... .......... 19% 590K 4m43s 2023-11-18T19:09:23.012 INFO:tasks.workunit.client.1.smithi135.stderr: 32850K .......... .......... .......... .......... .......... 19% 908K 4m43s 2023-11-18T19:09:23.082 INFO:tasks.workunit.client.1.smithi135.stderr: 32900K .......... .......... .......... .......... .......... 19% 714K 4m42s 2023-11-18T19:09:23.150 INFO:tasks.workunit.client.1.smithi135.stderr: 32950K .......... .......... .......... .......... .......... 19% 740K 4m42s 2023-11-18T19:09:23.218 INFO:tasks.workunit.client.1.smithi135.stderr: 33000K .......... .......... .......... .......... .......... 19% 741K 4m42s 2023-11-18T19:09:23.298 INFO:tasks.workunit.client.1.smithi135.stderr: 33050K .......... .......... .......... .......... .......... 19% 618K 4m42s 2023-11-18T19:09:23.375 INFO:tasks.workunit.client.1.smithi135.stderr: 33100K .......... .......... .......... .......... .......... 19% 874K 4m41s 2023-11-18T19:09:23.422 INFO:tasks.workunit.client.1.smithi135.stderr: 33150K .......... .......... .......... .......... .......... 19% 758K 4m41s 2023-11-18T19:09:23.503 INFO:tasks.workunit.client.1.smithi135.stderr: 33200K .......... .......... .......... .......... .......... 19% 697K 4m41s 2023-11-18T19:09:23.573 INFO:tasks.workunit.client.1.smithi135.stderr: 33250K .......... .......... .......... .......... .......... 19% 628K 4m41s 2023-11-18T19:09:23.655 INFO:tasks.workunit.client.1.smithi135.stderr: 33300K .......... .......... .......... .......... .......... 19% 611K 4m40s 2023-11-18T19:09:23.705 INFO:tasks.workunit.client.1.smithi135.stderr: 33350K .......... .......... .......... .......... .......... 19% 1001K 4m40s 2023-11-18T19:09:23.774 INFO:tasks.workunit.client.1.smithi135.stderr: 33400K .......... .......... .......... .......... .......... 19% 726K 4m40s 2023-11-18T19:09:23.843 INFO:tasks.workunit.client.1.smithi135.stderr: 33450K .......... .......... .......... .......... .......... 19% 736K 4m40s 2023-11-18T19:09:23.925 INFO:tasks.workunit.client.1.smithi135.stderr: 33500K .......... .......... .......... .......... .......... 19% 597K 4m39s 2023-11-18T19:09:23.990 INFO:tasks.workunit.client.1.smithi135.stderr: 33550K .......... .......... .......... .......... .......... 19% 963K 4m39s 2023-11-18T19:09:24.149 INFO:tasks.workunit.client.1.smithi135.stderr: 33600K .......... .......... .......... .......... .......... 19% 295K 4m39s 2023-11-18T19:09:24.160 INFO:tasks.workunit.client.1.smithi135.stderr: 33650K .......... .......... .......... .......... .......... 19% 3.73M 4m39s 2023-11-18T19:09:24.238 INFO:tasks.workunit.client.1.smithi135.stderr: 33700K .......... .......... .......... .......... .......... 20% 680K 4m39s 2023-11-18T19:09:24.315 INFO:tasks.workunit.client.1.smithi135.stderr: 33750K .......... .......... .......... .......... .......... 20% 618K 4m38s 2023-11-18T19:09:24.391 INFO:tasks.workunit.client.1.smithi135.stderr: 33800K .......... .......... .......... .......... .......... 20% 650K 4m38s 2023-11-18T19:09:24.464 INFO:tasks.workunit.client.1.smithi135.stderr: 33850K .......... .......... .......... .......... .......... 20% 721K 4m38s 2023-11-18T19:09:24.539 INFO:tasks.workunit.client.1.smithi135.stderr: 33900K .......... .......... .......... .......... .......... 20% 637K 4m38s 2023-11-18T19:09:24.622 INFO:tasks.workunit.client.1.smithi135.stderr: 33950K .......... .......... .......... .......... .......... 20% 651K 4m38s 2023-11-18T19:09:24.703 INFO:tasks.workunit.client.1.smithi135.stderr: 34000K .......... .......... .......... .......... .......... 20% 578K 4m37s 2023-11-18T19:09:24.793 INFO:tasks.workunit.client.1.smithi135.stderr: 34050K .......... .......... .......... .......... .......... 20% 556K 4m37s 2023-11-18T19:09:24.867 INFO:tasks.workunit.client.1.smithi135.stderr: 34100K .......... .......... .......... .......... .......... 20% 672K 4m37s 2023-11-18T19:09:24.918 INFO:tasks.workunit.client.1.smithi135.stderr: 34150K .......... .......... .......... .......... .......... 20% 975K 4m37s 2023-11-18T19:09:24.994 INFO:tasks.workunit.client.1.smithi135.stderr: 34200K .......... .......... .......... .......... .......... 20% 660K 4m37s 2023-11-18T19:09:25.081 INFO:tasks.workunit.client.0.smithi045.stdout: 13 9902 96 4861 82 3512 224 2023-11-18T19:09:25.102 INFO:tasks.workunit.client.1.smithi135.stderr: 34250K .......... .......... .......... .......... .......... 20% 462K 4m36s 2023-11-18T19:09:25.318 INFO:tasks.workunit.client.1.smithi135.stderr: 34300K .......... .......... .......... .......... .......... 20% 233K 4m37s 2023-11-18T19:09:25.319 INFO:tasks.workunit.client.1.smithi135.stderr: 34350K .......... .......... .......... .......... .......... 20% 57.7M 4m36s 2023-11-18T19:09:25.450 INFO:tasks.workunit.client.1.smithi135.stderr: 34400K .......... .......... .......... .......... .......... 20% 380K 4m36s 2023-11-18T19:09:25.561 INFO:tasks.workunit.client.1.smithi135.stderr: 34450K .......... .......... .......... .......... .......... 20% 449K 4m36s 2023-11-18T19:09:25.663 INFO:tasks.workunit.client.1.smithi135.stderr: 34500K .......... .......... .......... .......... .......... 20% 499K 4m36s 2023-11-18T19:09:25.769 INFO:tasks.workunit.client.1.smithi135.stderr: 34550K .......... .......... .......... .......... .......... 20% 463K 4m36s 2023-11-18T19:09:25.899 INFO:tasks.workunit.client.1.smithi135.stderr: 34600K .......... .......... .......... .......... .......... 20% 392K 4m36s 2023-11-18T19:09:26.048 INFO:tasks.workunit.client.1.smithi135.stderr: 34650K .......... .......... .......... .......... .......... 20% 331K 4m36s 2023-11-18T19:09:26.238 INFO:tasks.workunit.client.1.smithi135.stderr: 34700K .......... .......... .......... .......... .......... 20% 263K 4m36s 2023-11-18T19:09:26.550 INFO:tasks.workunit.client.1.smithi135.stderr: 34750K .......... .......... .......... .......... .......... 20% 161K 4m37s 2023-11-18T19:09:26.594 INFO:tasks.workunit.client.1.smithi135.stderr: 34800K .......... .......... .......... .......... .......... 20% 1.08M 4m37s 2023-11-18T19:09:26.820 INFO:tasks.workunit.client.1.smithi135.stderr: 34850K .......... .......... .......... .......... .......... 20% 221K 4m37s 2023-11-18T19:09:27.053 INFO:tasks.workunit.client.1.smithi135.stderr: 34900K .......... .......... .......... .......... .......... 20% 217K 4m37s 2023-11-18T19:09:27.215 INFO:tasks.workunit.client.1.smithi135.stderr: 34950K .......... .......... .......... .......... .......... 20% 304K 4m38s 2023-11-18T19:09:27.331 INFO:tasks.workunit.client.1.smithi135.stderr: 35000K .......... .......... .......... .......... .......... 20% 428K 4m37s 2023-11-18T19:09:27.482 INFO:tasks.workunit.client.1.smithi135.stderr: 35050K .......... .......... .......... .......... .......... 20% 334K 4m38s 2023-11-18T19:09:27.660 INFO:tasks.workunit.client.1.smithi135.stderr: 35100K .......... .......... .......... .......... .......... 20% 279K 4m38s 2023-11-18T19:09:27.797 INFO:tasks.workunit.client.1.smithi135.stderr: 35150K .......... .......... .......... .......... .......... 20% 367K 4m38s 2023-11-18T19:09:27.952 INFO:tasks.workunit.client.1.smithi135.stderr: 35200K .......... .......... .......... .......... .......... 20% 323K 4m38s 2023-11-18T19:09:28.171 INFO:tasks.workunit.client.1.smithi135.stderr: 35250K .......... .......... .......... .......... .......... 20% 229K 4m38s 2023-11-18T19:09:28.279 INFO:tasks.workunit.client.1.smithi135.stderr: 35300K .......... .......... .......... .......... .......... 20% 458K 4m38s 2023-11-18T19:09:28.435 INFO:tasks.workunit.client.1.smithi135.stderr: 35350K .......... .......... .......... .......... .......... 21% 320K 4m38s 2023-11-18T19:09:28.639 INFO:tasks.workunit.client.1.smithi135.stderr: 35400K .......... .......... .......... .......... .......... 21% 246K 4m38s 2023-11-18T19:09:28.768 INFO:tasks.workunit.client.1.smithi135.stderr: 35450K .......... .......... .......... .......... .......... 21% 384K 4m38s 2023-11-18T19:09:28.955 INFO:tasks.workunit.client.1.smithi135.stderr: 35500K .......... .......... .......... .......... .......... 21% 271K 4m39s 2023-11-18T19:09:29.117 INFO:tasks.workunit.client.1.smithi135.stderr: 35550K .......... .......... .......... .......... .......... 21% 305K 4m39s 2023-11-18T19:09:29.263 INFO:tasks.workunit.client.1.smithi135.stderr: 35600K .......... .......... .......... .......... .......... 21% 341K 4m39s 2023-11-18T19:09:29.394 INFO:tasks.workunit.client.1.smithi135.stderr: 35650K .......... .......... .......... .......... .......... 21% 383K 4m39s 2023-11-18T19:09:29.514 INFO:tasks.workunit.client.1.smithi135.stderr: 35700K .......... .......... .......... .......... .......... 21% 415K 4m39s 2023-11-18T19:09:29.635 INFO:tasks.workunit.client.1.smithi135.stderr: 35750K .......... .......... .......... .......... .......... 21% 416K 4m39s 2023-11-18T19:09:29.775 INFO:tasks.workunit.client.1.smithi135.stderr: 35800K .......... .......... .......... .......... .......... 21% 356K 4m39s 2023-11-18T19:09:29.898 INFO:tasks.workunit.client.1.smithi135.stderr: 35850K .......... .......... .......... .......... .......... 21% 408K 4m39s 2023-11-18T19:09:30.045 INFO:tasks.workunit.client.1.smithi135.stderr: 35900K .......... .......... .......... .......... .......... 21% 341K 4m39s 2023-11-18T19:09:30.155 INFO:tasks.workunit.client.1.smithi135.stderr: 35950K .......... .......... .......... .......... .......... 21% 449K 4m39s 2023-11-18T19:09:30.250 INFO:tasks.workunit.client.1.smithi135.stderr: 36000K .......... .......... .......... .......... .......... 21% 526K 4m39s 2023-11-18T19:09:30.483 INFO:tasks.workunit.client.1.smithi135.stderr: 36050K .......... .......... .......... .......... .......... 21% 216K 4m39s 2023-11-18T19:09:30.522 INFO:tasks.workunit.client.1.smithi135.stderr: 36100K .......... .......... .......... .......... .......... 21% 1.24M 4m39s 2023-11-18T19:09:30.675 INFO:tasks.workunit.client.1.smithi135.stderr: 36150K .......... .......... .......... .......... .......... 21% 327K 4m39s 2023-11-18T19:09:30.797 INFO:tasks.workunit.client.1.smithi135.stderr: 36200K .......... .......... .......... .......... .......... 21% 411K 4m39s 2023-11-18T19:09:30.922 INFO:tasks.workunit.client.1.smithi135.stderr: 36250K .......... .......... .......... .......... .......... 21% 399K 4m39s 2023-11-18T19:09:31.080 INFO:tasks.workunit.client.1.smithi135.stderr: 36300K .......... .......... .......... .......... .......... 21% 326K 4m39s 2023-11-18T19:09:31.219 INFO:tasks.workunit.client.1.smithi135.stderr: 36350K .......... .......... .......... .......... .......... 21% 348K 4m39s 2023-11-18T19:09:31.385 INFO:tasks.workunit.client.1.smithi135.stderr: 36400K .......... .......... .......... .......... .......... 21% 302K 4m39s 2023-11-18T19:09:31.539 INFO:tasks.workunit.client.1.smithi135.stderr: 36450K .......... .......... .......... .......... .......... 21% 323K 4m39s 2023-11-18T19:09:31.624 INFO:tasks.workunit.client.1.smithi135.stderr: 36500K .......... .......... .......... .......... .......... 21% 590K 4m39s 2023-11-18T19:09:31.756 INFO:tasks.workunit.client.1.smithi135.stderr: 36550K .......... .......... .......... .......... .......... 21% 390K 4m39s 2023-11-18T19:09:31.863 INFO:tasks.workunit.client.1.smithi135.stderr: 36600K .......... .......... .......... .......... .......... 21% 452K 4m39s 2023-11-18T19:09:31.951 INFO:tasks.workunit.client.1.smithi135.stderr: 36650K .......... .......... .......... .......... .......... 21% 586K 4m38s 2023-11-18T19:09:32.090 INFO:tasks.workunit.client.1.smithi135.stderr: 36700K .......... .......... .......... .......... .......... 21% 353K 4m38s 2023-11-18T19:09:32.213 INFO:tasks.workunit.client.1.smithi135.stderr: 36750K .......... .......... .......... .......... .......... 21% 407K 4m38s 2023-11-18T19:09:32.298 INFO:tasks.workunit.client.1.smithi135.stderr: 36800K .......... .......... .......... .......... .......... 21% 581K 4m38s 2023-11-18T19:09:32.428 INFO:tasks.workunit.client.1.smithi135.stderr: 36850K .......... .......... .......... .......... .......... 21% 386K 4m38s 2023-11-18T19:09:32.536 INFO:tasks.workunit.client.1.smithi135.stderr: 36900K .......... .......... .......... .......... .......... 21% 463K 4m38s 2023-11-18T19:09:32.659 INFO:tasks.workunit.client.1.smithi135.stderr: 36950K .......... .......... .......... .......... .......... 21% 406K 4m38s 2023-11-18T19:09:32.785 INFO:tasks.workunit.client.1.smithi135.stderr: 37000K .......... .......... .......... .......... .......... 21% 399K 4m38s 2023-11-18T19:09:32.867 INFO:tasks.workunit.client.1.smithi135.stderr: 37050K .......... .......... .......... .......... .......... 22% 603K 4m38s 2023-11-18T19:09:32.971 INFO:tasks.workunit.client.1.smithi135.stderr: 37100K .......... .......... .......... .......... .......... 22% 483K 4m38s 2023-11-18T19:09:33.116 INFO:tasks.workunit.client.1.smithi135.stderr: 37150K .......... .......... .......... .......... .......... 22% 343K 4m38s 2023-11-18T19:09:33.216 INFO:tasks.workunit.client.1.smithi135.stderr: 37200K .......... .......... .......... .......... .......... 22% 505K 4m38s 2023-11-18T19:09:33.351 INFO:tasks.workunit.client.1.smithi135.stderr: 37250K .......... .......... .......... .......... .......... 22% 369K 4m38s 2023-11-18T19:09:33.459 INFO:tasks.workunit.client.1.smithi135.stderr: 37300K .......... .......... .......... .......... .......... 22% 463K 4m37s 2023-11-18T19:09:33.598 INFO:tasks.workunit.client.1.smithi135.stderr: 37350K .......... .......... .......... .......... .......... 22% 361K 4m37s 2023-11-18T19:09:33.696 INFO:tasks.workunit.client.1.smithi135.stderr: 37400K .......... .......... .......... .......... .......... 22% 505K 4m37s 2023-11-18T19:09:33.844 INFO:tasks.workunit.client.1.smithi135.stderr: 37450K .......... .......... .......... .......... .......... 22% 340K 4m37s 2023-11-18T19:09:33.983 INFO:tasks.workunit.client.1.smithi135.stderr: 37500K .......... .......... .......... .......... .......... 22% 359K 4m37s 2023-11-18T19:09:34.101 INFO:tasks.workunit.client.1.smithi135.stderr: 37550K .......... .......... .......... .......... .......... 22% 459K 4m37s 2023-11-18T19:09:34.219 INFO:tasks.workunit.client.1.smithi135.stderr: 37600K .......... .......... .......... .......... .......... 22% 393K 4m37s 2023-11-18T19:09:34.395 INFO:tasks.workunit.client.1.smithi135.stderr: 37650K .......... .......... .......... .......... .......... 22% 355K 4m37s 2023-11-18T19:09:34.541 INFO:tasks.workunit.client.1.smithi135.stderr: 37700K .......... .......... .......... .......... .......... 22% 276K 4m37s 2023-11-18T19:09:34.709 INFO:tasks.workunit.client.1.smithi135.stderr: 37750K .......... .......... .......... .......... .......... 22% 298K 4m38s 2023-11-18T19:09:34.843 INFO:tasks.workunit.client.1.smithi135.stderr: 37800K .......... .......... .......... .......... .......... 22% 374K 4m38s 2023-11-18T19:09:35.071 INFO:tasks.workunit.client.1.smithi135.stderr: 37850K .......... .......... .......... .......... .......... 22% 219K 4m38s 2023-11-18T19:09:35.081 INFO:tasks.workunit.client.0.smithi045.stdout: 16 10323 172 4993 50 3569 210 2023-11-18T19:09:35.104 INFO:tasks.workunit.client.1.smithi135.stderr: 37900K .......... .......... .......... .......... .......... 22% 1.69M 4m37s 2023-11-18T19:09:35.239 INFO:tasks.workunit.client.1.smithi135.stderr: 37950K .......... .......... .......... .......... .......... 22% 360K 4m37s 2023-11-18T19:09:35.378 INFO:tasks.workunit.client.1.smithi135.stderr: 38000K .......... .......... .......... .......... .......... 22% 361K 4m37s 2023-11-18T19:09:35.547 INFO:tasks.workunit.client.1.smithi135.stderr: 38050K .......... .......... .......... .......... .......... 22% 295K 4m38s 2023-11-18T19:09:35.661 INFO:tasks.workunit.client.1.smithi135.stderr: 38100K .......... .......... .......... .......... .......... 22% 438K 4m38s 2023-11-18T19:09:35.773 INFO:tasks.workunit.client.1.smithi135.stderr: 38150K .......... .......... .......... .......... .......... 22% 446K 4m37s 2023-11-18T19:09:35.895 INFO:tasks.workunit.client.1.smithi135.stderr: 38200K .......... .......... .......... .......... .......... 22% 412K 4m37s 2023-11-18T19:09:36.022 INFO:tasks.workunit.client.1.smithi135.stderr: 38250K .......... .......... .......... .......... .......... 22% 392K 4m37s 2023-11-18T19:09:36.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:09:36.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:09:36.164 INFO:tasks.workunit.client.1.smithi135.stderr: 38300K .......... .......... .......... .......... .......... 22% 352K 4m37s 2023-11-18T19:09:36.275 INFO:tasks.workunit.client.1.smithi135.stderr: 38350K .......... .......... .......... .......... .......... 22% 458K 4m37s 2023-11-18T19:09:36.403 INFO:tasks.workunit.client.1.smithi135.stderr: 38400K .......... .......... .......... .......... .......... 22% 388K 4m37s 2023-11-18T19:09:36.517 INFO:tasks.workunit.client.1.smithi135.stderr: 38450K .......... .......... .......... .......... .......... 22% 435K 4m37s 2023-11-18T19:09:36.628 INFO:tasks.workunit.client.1.smithi135.stderr: 38500K .......... .......... .......... .......... .......... 22% 450K 4m37s 2023-11-18T19:09:36.747 INFO:tasks.workunit.client.1.smithi135.stderr: 38550K .......... .......... .......... .......... .......... 22% 421K 4m37s 2023-11-18T19:09:36.849 INFO:tasks.workunit.client.1.smithi135.stderr: 38600K .......... .......... .......... .......... .......... 22% 492K 4m37s 2023-11-18T19:09:36.925 INFO:tasks.workunit.client.1.smithi135.stderr: 38650K .......... .......... .......... .......... .......... 22% 660K 4m37s 2023-11-18T19:09:37.031 INFO:tasks.workunit.client.1.smithi135.stderr: 38700K .......... .......... .......... .......... .......... 22% 471K 4m37s 2023-11-18T19:09:37.143 INFO:tasks.workunit.client.1.smithi135.stderr: 38750K .......... .......... .......... .......... .......... 23% 447K 4m36s 2023-11-18T19:09:37.219 INFO:tasks.workunit.client.1.smithi135.stderr: 38800K .......... .......... .......... .......... .......... 23% 649K 4m36s 2023-11-18T19:09:37.301 INFO:tasks.workunit.client.1.smithi135.stderr: 38850K .......... .......... .......... .......... .......... 23% 613K 4m36s 2023-11-18T19:09:37.387 INFO:tasks.workunit.client.1.smithi135.stderr: 38900K .......... .......... .......... .......... .......... 23% 604K 4m36s 2023-11-18T19:09:37.499 INFO:tasks.workunit.client.1.smithi135.stderr: 38950K .......... .......... .......... .......... .......... 23% 432K 4m36s 2023-11-18T19:09:37.583 INFO:tasks.workunit.client.1.smithi135.stderr: 39000K .......... .......... .......... .......... .......... 23% 596K 4m36s 2023-11-18T19:09:37.670 INFO:tasks.workunit.client.1.smithi135.stderr: 39050K .......... .......... .......... .......... .......... 23% 577K 4m35s 2023-11-18T19:09:37.760 INFO:tasks.workunit.client.1.smithi135.stderr: 39100K .......... .......... .......... .......... .......... 23% 557K 4m35s 2023-11-18T19:09:37.877 INFO:tasks.workunit.client.1.smithi135.stderr: 39150K .......... .......... .......... .......... .......... 23% 426K 4m35s 2023-11-18T19:09:37.965 INFO:tasks.workunit.client.1.smithi135.stderr: 39200K .......... .......... .......... .......... .......... 23% 566K 4m35s 2023-11-18T19:09:38.057 INFO:tasks.workunit.client.1.smithi135.stderr: 39250K .......... .......... .......... .......... .......... 23% 549K 4m35s 2023-11-18T19:09:38.154 INFO:tasks.workunit.client.1.smithi135.stderr: 39300K .......... .......... .......... .......... .......... 23% 514K 4m35s 2023-11-18T19:09:38.281 INFO:tasks.workunit.client.1.smithi135.stderr: 39350K .......... .......... .......... .......... .......... 23% 399K 4m35s 2023-11-18T19:09:38.415 INFO:tasks.workunit.client.1.smithi135.stderr: 39400K .......... .......... .......... .......... .......... 23% 369K 4m35s 2023-11-18T19:09:38.513 INFO:tasks.workunit.client.1.smithi135.stderr: 39450K .......... .......... .......... .......... .......... 23% 512K 4m35s 2023-11-18T19:09:38.620 INFO:tasks.workunit.client.1.smithi135.stderr: 39500K .......... .......... .......... .......... .......... 23% 466K 4m34s 2023-11-18T19:09:38.671 INFO:tasks.workunit.client.1.smithi135.stderr: 39550K .......... .......... .......... .......... .......... 23% 975K 4m34s 2023-11-18T19:09:38.787 INFO:tasks.workunit.client.1.smithi135.stderr: 39600K .......... .......... .......... .......... .......... 23% 430K 4m34s 2023-11-18T19:09:38.910 INFO:tasks.workunit.client.1.smithi135.stderr: 39650K .......... .......... .......... .......... .......... 23% 407K 4m34s 2023-11-18T19:09:39.024 INFO:tasks.workunit.client.1.smithi135.stderr: 39700K .......... .......... .......... .......... .......... 23% 441K 4m34s 2023-11-18T19:09:39.126 INFO:tasks.workunit.client.1.smithi135.stderr: 39750K .......... .......... .......... .......... .......... 23% 488K 4m34s 2023-11-18T19:09:39.293 INFO:tasks.workunit.client.1.smithi135.stderr: 39800K .......... .......... .......... .......... .......... 23% 299K 4m34s 2023-11-18T19:09:39.328 INFO:tasks.workunit.client.1.smithi135.stderr: 39850K .......... .......... .......... .......... .......... 23% 1.41M 4m34s 2023-11-18T19:09:39.423 INFO:tasks.workunit.client.1.smithi135.stderr: 39900K .......... .......... .......... .......... .......... 23% 524K 4m33s 2023-11-18T19:09:39.612 INFO:tasks.workunit.client.1.smithi135.stderr: 39950K .......... .......... .......... .......... .......... 23% 265K 4m34s 2023-11-18T19:09:39.719 INFO:tasks.workunit.client.1.smithi135.stderr: 40000K .......... .......... .......... .......... .......... 23% 466K 4m34s 2023-11-18T19:09:39.810 INFO:tasks.workunit.client.1.smithi135.stderr: 40050K .......... .......... .......... .......... .......... 23% 552K 4m33s 2023-11-18T19:09:39.923 INFO:tasks.workunit.client.1.smithi135.stderr: 40100K .......... .......... .......... .......... .......... 23% 547K 4m33s 2023-11-18T19:09:40.015 INFO:tasks.workunit.client.1.smithi135.stderr: 40150K .......... .......... .......... .......... .......... 23% 444K 4m33s 2023-11-18T19:09:40.107 INFO:tasks.workunit.client.1.smithi135.stderr: 40200K .......... .......... .......... .......... .......... 23% 546K 4m33s 2023-11-18T19:09:40.199 INFO:tasks.workunit.client.1.smithi135.stderr: 40250K .......... .......... .......... .......... .......... 23% 532K 4m33s 2023-11-18T19:09:40.287 INFO:tasks.workunit.client.1.smithi135.stderr: 40300K .......... .......... .......... .......... .......... 23% 586K 4m33s 2023-11-18T19:09:40.371 INFO:tasks.workunit.client.1.smithi135.stderr: 40350K .......... .......... .......... .......... .......... 23% 583K 4m32s 2023-11-18T19:09:40.438 INFO:tasks.workunit.client.1.smithi135.stderr: 40400K .......... .......... .......... .......... .......... 23% 737K 4m32s 2023-11-18T19:09:40.530 INFO:tasks.workunit.client.1.smithi135.stderr: 40450K .......... .......... .......... .......... .......... 24% 543K 4m32s 2023-11-18T19:09:40.622 INFO:tasks.workunit.client.1.smithi135.stderr: 40500K .......... .......... .......... .......... .......... 24% 543K 4m32s 2023-11-18T19:09:40.804 INFO:tasks.workunit.client.1.smithi135.stderr: 40550K .......... .......... .......... .......... .......... 24% 276K 4m32s 2023-11-18T19:09:40.832 INFO:tasks.workunit.client.1.smithi135.stderr: 40600K .......... .......... .......... .......... .......... 24% 1.70M 4m32s 2023-11-18T19:09:40.933 INFO:tasks.workunit.client.1.smithi135.stderr: 40650K .......... .......... .......... .......... .......... 24% 556K 4m32s 2023-11-18T19:09:41.059 INFO:tasks.workunit.client.1.smithi135.stderr: 40700K .......... .......... .......... .......... .......... 24% 366K 4m32s 2023-11-18T19:09:41.186 INFO:tasks.workunit.client.1.smithi135.stderr: 40750K .......... .......... .......... .......... .......... 24% 395K 4m32s 2023-11-18T19:09:41.285 INFO:tasks.workunit.client.1.smithi135.stderr: 40800K .......... .......... .......... .......... .......... 24% 506K 4m31s 2023-11-18T19:09:41.374 INFO:tasks.workunit.client.1.smithi135.stderr: 40850K .......... .......... .......... .......... .......... 24% 557K 4m31s 2023-11-18T19:09:41.463 INFO:tasks.workunit.client.1.smithi135.stderr: 40900K .......... .......... .......... .......... .......... 24% 562K 4m31s 2023-11-18T19:09:41.586 INFO:tasks.workunit.client.1.smithi135.stderr: 40950K .......... .......... .......... .......... .......... 24% 406K 4m31s 2023-11-18T19:09:41.676 INFO:tasks.workunit.client.1.smithi135.stderr: 41000K .......... .......... .......... .......... .......... 24% 580K 4m31s 2023-11-18T19:09:41.782 INFO:tasks.workunit.client.1.smithi135.stderr: 41050K .......... .......... .......... .......... .......... 24% 456K 4m31s 2023-11-18T19:09:41.880 INFO:tasks.workunit.client.1.smithi135.stderr: 41100K .......... .......... .......... .......... .......... 24% 515K 4m31s 2023-11-18T19:09:41.970 INFO:tasks.workunit.client.1.smithi135.stderr: 41150K .......... .......... .......... .......... .......... 24% 551K 4m30s 2023-11-18T19:09:42.071 INFO:tasks.workunit.client.1.smithi135.stderr: 41200K .......... .......... .......... .......... .......... 24% 507K 4m30s 2023-11-18T19:09:42.171 INFO:tasks.workunit.client.1.smithi135.stderr: 41250K .......... .......... .......... .......... .......... 24% 489K 4m30s 2023-11-18T19:09:42.340 INFO:tasks.workunit.client.1.smithi135.stderr: 41300K .......... .......... .......... .......... .......... 24% 299K 4m30s 2023-11-18T19:09:42.518 INFO:tasks.workunit.client.1.smithi135.stderr: 41350K .......... .......... .......... .......... .......... 24% 279K 4m30s 2023-11-18T19:09:42.579 INFO:tasks.workunit.client.1.smithi135.stderr: 41400K .......... .......... .......... .......... .......... 24% 807K 4m30s 2023-11-18T19:09:42.740 INFO:tasks.workunit.client.1.smithi135.stderr: 41450K .......... .......... .......... .......... .......... 24% 315K 4m30s 2023-11-18T19:09:42.901 INFO:tasks.workunit.client.1.smithi135.stderr: 41500K .......... .......... .......... .......... .......... 24% 307K 4m30s 2023-11-18T19:09:43.053 INFO:tasks.workunit.client.1.smithi135.stderr: 41550K .......... .......... .......... .......... .......... 24% 342K 4m30s 2023-11-18T19:09:43.222 INFO:tasks.workunit.client.1.smithi135.stderr: 41600K .......... .......... .......... .......... .......... 24% 285K 4m30s 2023-11-18T19:09:43.408 INFO:tasks.workunit.client.1.smithi135.stderr: 41650K .......... .......... .......... .......... .......... 24% 269K 4m31s 2023-11-18T19:09:43.551 INFO:tasks.workunit.client.1.smithi135.stderr: 41700K .......... .......... .......... .......... .......... 24% 348K 4m31s 2023-11-18T19:09:43.680 INFO:tasks.workunit.client.1.smithi135.stderr: 41750K .......... .......... .......... .......... .......... 24% 391K 4m30s 2023-11-18T19:09:43.809 INFO:tasks.workunit.client.1.smithi135.stderr: 41800K .......... .......... .......... .......... .......... 24% 385K 4m30s 2023-11-18T19:09:43.924 INFO:tasks.workunit.client.1.smithi135.stderr: 41850K .......... .......... .......... .......... .......... 24% 434K 4m30s 2023-11-18T19:09:44.053 INFO:tasks.workunit.client.1.smithi135.stderr: 41900K .......... .......... .......... .......... .......... 24% 390K 4m30s 2023-11-18T19:09:44.187 INFO:tasks.workunit.client.1.smithi135.stderr: 41950K .......... .......... .......... .......... .......... 24% 372K 4m30s 2023-11-18T19:09:44.320 INFO:tasks.workunit.client.1.smithi135.stderr: 42000K .......... .......... .......... .......... .......... 24% 377K 4m30s 2023-11-18T19:09:44.430 INFO:tasks.workunit.client.1.smithi135.stderr: 42050K .......... .......... .......... .......... .......... 24% 452K 4m30s 2023-11-18T19:09:44.553 INFO:tasks.workunit.client.1.smithi135.stderr: 42100K .......... .......... .......... .......... .......... 25% 424K 4m30s 2023-11-18T19:09:44.690 INFO:tasks.workunit.client.1.smithi135.stderr: 42150K .......... .......... .......... .......... .......... 25% 353K 4m30s 2023-11-18T19:09:44.818 INFO:tasks.workunit.client.1.smithi135.stderr: 42200K .......... .......... .......... .......... .......... 25% 390K 4m30s 2023-11-18T19:09:44.939 INFO:tasks.workunit.client.1.smithi135.stderr: 42250K .......... .......... .......... .......... .......... 25% 412K 4m30s 2023-11-18T19:09:45.082 INFO:tasks.workunit.client.0.smithi045.stdout: 17 10126 61 4972 130 3853 179 2023-11-18T19:09:45.090 INFO:tasks.workunit.client.1.smithi135.stderr: 42300K .......... .......... .......... .......... .......... 25% 333K 4m30s 2023-11-18T19:09:45.206 INFO:tasks.workunit.client.1.smithi135.stderr: 42350K .......... .......... .......... .......... .......... 25% 429K 4m30s 2023-11-18T19:09:45.346 INFO:tasks.workunit.client.1.smithi135.stderr: 42400K .......... .......... .......... .......... .......... 25% 358K 4m30s 2023-11-18T19:09:45.458 INFO:tasks.workunit.client.1.smithi135.stderr: 42450K .......... .......... .......... .......... .......... 25% 491K 4m30s 2023-11-18T19:09:45.565 INFO:tasks.workunit.client.1.smithi135.stderr: 42500K .......... .......... .......... .......... .......... 25% 425K 4m30s 2023-11-18T19:09:45.690 INFO:tasks.workunit.client.1.smithi135.stderr: 42550K .......... .......... .......... .......... .......... 25% 410K 4m30s 2023-11-18T19:09:45.949 INFO:tasks.workunit.client.1.smithi135.stderr: 42600K .......... .......... .......... .......... .......... 25% 192K 4m30s 2023-11-18T19:09:45.985 INFO:tasks.workunit.client.1.smithi135.stderr: 42650K .......... .......... .......... .......... .......... 25% 1.35M 4m30s 2023-11-18T19:09:46.136 INFO:tasks.workunit.client.1.smithi135.stderr: 42700K .......... .......... .......... .......... .......... 25% 330K 4m30s 2023-11-18T19:09:46.260 INFO:tasks.workunit.client.1.smithi135.stderr: 42750K .......... .......... .......... .......... .......... 25% 404K 4m30s 2023-11-18T19:09:46.427 INFO:tasks.workunit.client.1.smithi135.stderr: 42800K .......... .......... .......... .......... .......... 25% 299K 4m30s 2023-11-18T19:09:46.559 INFO:tasks.workunit.client.1.smithi135.stderr: 42850K .......... .......... .......... .......... .......... 25% 378K 4m30s 2023-11-18T19:09:46.713 INFO:tasks.workunit.client.1.smithi135.stderr: 42900K .......... .......... .......... .......... .......... 25% 350K 4m30s 2023-11-18T19:09:46.847 INFO:tasks.workunit.client.1.smithi135.stderr: 42950K .......... .......... .......... .......... .......... 25% 345K 4m30s 2023-11-18T19:09:47.002 INFO:tasks.workunit.client.1.smithi135.stderr: 43000K .......... .......... .......... .......... .......... 25% 324K 4m30s 2023-11-18T19:09:47.130 INFO:tasks.workunit.client.1.smithi135.stderr: 43050K .......... .......... .......... .......... .......... 25% 391K 4m30s 2023-11-18T19:09:47.215 INFO:tasks.workunit.client.1.smithi135.stderr: 43100K .......... .......... .......... .......... .......... 25% 579K 4m30s 2023-11-18T19:09:47.332 INFO:tasks.workunit.client.1.smithi135.stderr: 43150K .......... .......... .......... .......... .......... 25% 430K 4m29s 2023-11-18T19:09:47.403 INFO:tasks.workunit.client.1.smithi135.stderr: 43200K .......... .......... .......... .......... .......... 25% 699K 4m29s 2023-11-18T19:09:47.502 INFO:tasks.workunit.client.1.smithi135.stderr: 43250K .......... .......... .......... .......... .......... 25% 517K 4m29s 2023-11-18T19:09:47.644 INFO:tasks.workunit.client.1.smithi135.stderr: 43300K .......... .......... .......... .......... .......... 25% 348K 4m29s 2023-11-18T19:09:47.717 INFO:tasks.workunit.client.1.smithi135.stderr: 43350K .......... .......... .......... .......... .......... 25% 687K 4m29s 2023-11-18T19:09:47.812 INFO:tasks.workunit.client.1.smithi135.stderr: 43400K .......... .......... .......... .......... .......... 25% 526K 4m29s 2023-11-18T19:09:47.920 INFO:tasks.workunit.client.1.smithi135.stderr: 43450K .......... .......... .......... .......... .......... 25% 585K 4m29s 2023-11-18T19:09:48.030 INFO:tasks.workunit.client.1.smithi135.stderr: 43500K .......... .......... .......... .......... .......... 25% 376K 4m29s 2023-11-18T19:09:48.154 INFO:tasks.workunit.client.1.smithi135.stderr: 43550K .......... .......... .......... .......... .......... 25% 406K 4m28s 2023-11-18T19:09:48.272 INFO:tasks.workunit.client.1.smithi135.stderr: 43600K .......... .......... .......... .......... .......... 25% 422K 4m28s 2023-11-18T19:09:48.396 INFO:tasks.workunit.client.1.smithi135.stderr: 43650K .......... .......... .......... .......... .......... 25% 403K 4m28s 2023-11-18T19:09:48.511 INFO:tasks.workunit.client.1.smithi135.stderr: 43700K .......... .......... .......... .......... .......... 25% 434K 4m28s 2023-11-18T19:09:48.649 INFO:tasks.workunit.client.1.smithi135.stderr: 43750K .......... .......... .......... .......... .......... 25% 361K 4m28s 2023-11-18T19:09:48.828 INFO:tasks.workunit.client.1.smithi135.stderr: 43800K .......... .......... .......... .......... .......... 26% 281K 4m28s 2023-11-18T19:09:48.942 INFO:tasks.workunit.client.1.smithi135.stderr: 43850K .......... .......... .......... .......... .......... 26% 434K 4m28s 2023-11-18T19:09:49.101 INFO:tasks.workunit.client.1.smithi135.stderr: 43900K .......... .......... .......... .......... .......... 26% 361K 4m28s 2023-11-18T19:09:49.260 INFO:tasks.workunit.client.1.smithi135.stderr: 43950K .......... .......... .......... .......... .......... 26% 279K 4m28s 2023-11-18T19:09:49.357 INFO:tasks.workunit.client.1.smithi135.stderr: 44000K .......... .......... .......... .......... .......... 26% 514K 4m28s 2023-11-18T19:09:49.468 INFO:tasks.workunit.client.1.smithi135.stderr: 44050K .......... .......... .......... .......... .......... 26% 451K 4m28s 2023-11-18T19:09:49.599 INFO:tasks.workunit.client.1.smithi135.stderr: 44100K .......... .......... .......... .......... .......... 26% 386K 4m28s 2023-11-18T19:09:49.719 INFO:tasks.workunit.client.1.smithi135.stderr: 44150K .......... .......... .......... .......... .......... 26% 424K 4m28s 2023-11-18T19:09:49.815 INFO:tasks.workunit.client.1.smithi135.stderr: 44200K .......... .......... .......... .......... .......... 26% 503K 4m28s 2023-11-18T19:09:49.913 INFO:tasks.workunit.client.1.smithi135.stderr: 44250K .......... .......... .......... .......... .......... 26% 511K 4m28s 2023-11-18T19:09:50.023 INFO:tasks.workunit.client.1.smithi135.stderr: 44300K .......... .......... .......... .......... .......... 26% 453K 4m28s 2023-11-18T19:09:50.127 INFO:tasks.workunit.client.1.smithi135.stderr: 44350K .......... .......... .......... .......... .......... 26% 485K 4m27s 2023-11-18T19:09:50.244 INFO:tasks.workunit.client.1.smithi135.stderr: 44400K .......... .......... .......... .......... .......... 26% 425K 4m27s 2023-11-18T19:09:50.429 INFO:tasks.workunit.client.1.smithi135.stderr: 44450K .......... .......... .......... .......... .......... 26% 271K 4m27s 2023-11-18T19:09:50.484 INFO:tasks.workunit.client.1.smithi135.stderr: 44500K .......... .......... .......... .......... .......... 26% 906K 4m27s 2023-11-18T19:09:50.632 INFO:tasks.workunit.client.1.smithi135.stderr: 44550K .......... .......... .......... .......... .......... 26% 338K 4m27s 2023-11-18T19:09:50.739 INFO:tasks.workunit.client.1.smithi135.stderr: 44600K .......... .......... .......... .......... .......... 26% 551K 4m27s 2023-11-18T19:09:50.870 INFO:tasks.workunit.client.1.smithi135.stderr: 44650K .......... .......... .......... .......... .......... 26% 338K 4m27s 2023-11-18T19:09:50.967 INFO:tasks.workunit.client.1.smithi135.stderr: 44700K .......... .......... .......... .......... .......... 26% 516K 4m27s 2023-11-18T19:09:51.081 INFO:tasks.workunit.client.1.smithi135.stderr: 44750K .......... .......... .......... .......... .......... 26% 440K 4m27s 2023-11-18T19:09:51.215 INFO:tasks.workunit.client.1.smithi135.stderr: 44800K .......... .......... .......... .......... .......... 26% 373K 4m27s 2023-11-18T19:09:51.303 INFO:tasks.workunit.client.1.smithi135.stderr: 44850K .......... .......... .......... .......... .......... 26% 569K 4m27s 2023-11-18T19:09:51.387 INFO:tasks.workunit.client.1.smithi135.stderr: 44900K .......... .......... .......... .......... .......... 26% 589K 4m26s 2023-11-18T19:09:51.511 INFO:tasks.workunit.client.1.smithi135.stderr: 44950K .......... .......... .......... .......... .......... 26% 403K 4m26s 2023-11-18T19:09:51.644 INFO:tasks.workunit.client.1.smithi135.stderr: 45000K .......... .......... .......... .......... .......... 26% 378K 4m26s 2023-11-18T19:09:51.726 INFO:tasks.workunit.client.1.smithi135.stderr: 45050K .......... .......... .......... .......... .......... 26% 610K 4m26s 2023-11-18T19:09:51.809 INFO:tasks.workunit.client.1.smithi135.stderr: 45100K .......... .......... .......... .......... .......... 26% 598K 4m26s 2023-11-18T19:09:51.888 INFO:tasks.workunit.client.1.smithi135.stderr: 45150K .......... .......... .......... .......... .......... 26% 639K 4m26s 2023-11-18T19:09:51.970 INFO:tasks.workunit.client.1.smithi135.stderr: 45200K .......... .......... .......... .......... .......... 26% 604K 4m26s 2023-11-18T19:09:52.089 INFO:tasks.workunit.client.1.smithi135.stderr: 45250K .......... .......... .......... .......... .......... 26% 422K 4m26s 2023-11-18T19:09:52.194 INFO:tasks.workunit.client.1.smithi135.stderr: 45300K .......... .......... .......... .......... .......... 26% 476K 4m25s 2023-11-18T19:09:52.285 INFO:tasks.workunit.client.1.smithi135.stderr: 45350K .......... .......... .......... .......... .......... 26% 549K 4m25s 2023-11-18T19:09:52.358 INFO:tasks.workunit.client.1.smithi135.stderr: 45400K .......... .......... .......... .......... .......... 26% 689K 4m25s 2023-11-18T19:09:52.431 INFO:tasks.workunit.client.1.smithi135.stderr: 45450K .......... .......... .......... .......... .......... 26% 684K 4m25s 2023-11-18T19:09:52.513 INFO:tasks.workunit.client.1.smithi135.stderr: 45500K .......... .......... .......... .......... .......... 27% 659K 4m25s 2023-11-18T19:09:52.588 INFO:tasks.workunit.client.1.smithi135.stderr: 45550K .......... .......... .......... .......... .......... 27% 613K 4m25s 2023-11-18T19:09:52.670 INFO:tasks.workunit.client.1.smithi135.stderr: 45600K .......... .......... .......... .......... .......... 27% 620K 4m24s 2023-11-18T19:09:52.750 INFO:tasks.workunit.client.1.smithi135.stderr: 45650K .......... .......... .......... .......... .......... 27% 614K 4m24s 2023-11-18T19:09:52.830 INFO:tasks.workunit.client.1.smithi135.stderr: 45700K .......... .......... .......... .......... .......... 27% 630K 4m24s 2023-11-18T19:09:52.909 INFO:tasks.workunit.client.1.smithi135.stderr: 45750K .......... .......... .......... .......... .......... 27% 633K 4m24s 2023-11-18T19:09:52.988 INFO:tasks.workunit.client.1.smithi135.stderr: 45800K .......... .......... .......... .......... .......... 27% 630K 4m24s 2023-11-18T19:09:53.072 INFO:tasks.workunit.client.1.smithi135.stderr: 45850K .......... .......... .......... .......... .......... 27% 597K 4m23s 2023-11-18T19:09:53.149 INFO:tasks.workunit.client.1.smithi135.stderr: 45900K .......... .......... .......... .......... .......... 27% 645K 4m23s 2023-11-18T19:09:53.239 INFO:tasks.workunit.client.1.smithi135.stderr: 45950K .......... .......... .......... .......... .......... 27% 576K 4m23s 2023-11-18T19:09:53.325 INFO:tasks.workunit.client.1.smithi135.stderr: 46000K .......... .......... .......... .......... .......... 27% 562K 4m23s 2023-11-18T19:09:53.415 INFO:tasks.workunit.client.1.smithi135.stderr: 46050K .......... .......... .......... .......... .......... 27% 558K 4m23s 2023-11-18T19:09:53.503 INFO:tasks.workunit.client.1.smithi135.stderr: 46100K .......... .......... .......... .......... .......... 27% 564K 4m23s 2023-11-18T19:09:53.576 INFO:tasks.workunit.client.1.smithi135.stderr: 46150K .......... .......... .......... .......... .......... 27% 685K 4m22s 2023-11-18T19:09:53.664 INFO:tasks.workunit.client.1.smithi135.stderr: 46200K .......... .......... .......... .......... .......... 27% 570K 4m22s 2023-11-18T19:09:53.759 INFO:tasks.workunit.client.1.smithi135.stderr: 46250K .......... .......... .......... .......... .......... 27% 528K 4m22s 2023-11-18T19:09:53.885 INFO:tasks.workunit.client.1.smithi135.stderr: 46300K .......... .......... .......... .......... .......... 27% 401K 4m22s 2023-11-18T19:09:53.951 INFO:tasks.workunit.client.1.smithi135.stderr: 46350K .......... .......... .......... .......... .......... 27% 741K 4m22s 2023-11-18T19:09:54.055 INFO:tasks.workunit.client.1.smithi135.stderr: 46400K .......... .......... .......... .......... .......... 27% 533K 4m22s 2023-11-18T19:09:54.135 INFO:tasks.workunit.client.1.smithi135.stderr: 46450K .......... .......... .......... .......... .......... 27% 553K 4m22s 2023-11-18T19:09:54.215 INFO:tasks.workunit.client.1.smithi135.stderr: 46500K .......... .......... .......... .......... .......... 27% 644K 4m21s 2023-11-18T19:09:54.305 INFO:tasks.workunit.client.1.smithi135.stderr: 46550K .......... .......... .......... .......... .......... 27% 543K 4m21s 2023-11-18T19:09:54.406 INFO:tasks.workunit.client.1.smithi135.stderr: 46600K .......... .......... .......... .......... .......... 27% 497K 4m21s 2023-11-18T19:09:54.496 INFO:tasks.workunit.client.1.smithi135.stderr: 46650K .......... .......... .......... .......... .......... 27% 554K 4m21s 2023-11-18T19:09:54.586 INFO:tasks.workunit.client.1.smithi135.stderr: 46700K .......... .......... .......... .......... .......... 27% 554K 4m21s 2023-11-18T19:09:54.673 INFO:tasks.workunit.client.1.smithi135.stderr: 46750K .......... .......... .......... .......... .......... 27% 578K 4m21s 2023-11-18T19:09:54.758 INFO:tasks.workunit.client.1.smithi135.stderr: 46800K .......... .......... .......... .......... .......... 27% 582K 4m21s 2023-11-18T19:09:54.852 INFO:tasks.workunit.client.1.smithi135.stderr: 46850K .......... .......... .......... .......... .......... 27% 633K 4m20s 2023-11-18T19:09:54.933 INFO:tasks.workunit.client.1.smithi135.stderr: 46900K .......... .......... .......... .......... .......... 27% 523K 4m20s 2023-11-18T19:09:55.025 INFO:tasks.workunit.client.1.smithi135.stderr: 46950K .......... .......... .......... .......... .......... 27% 605K 4m20s 2023-11-18T19:09:55.082 INFO:tasks.workunit.client.0.smithi045.stdout: 20 9539 44 4982 115 3600 181 2023-11-18T19:09:55.103 INFO:tasks.workunit.client.1.smithi135.stderr: 47000K .......... .......... .......... .......... .......... 27% 569K 4m20s 2023-11-18T19:09:55.182 INFO:tasks.workunit.client.1.smithi135.stderr: 47050K .......... .......... .......... .......... .......... 27% 638K 4m20s 2023-11-18T19:09:55.257 INFO:tasks.workunit.client.1.smithi135.stderr: 47100K .......... .......... .......... .......... .......... 27% 664K 4m20s 2023-11-18T19:09:55.329 INFO:tasks.workunit.client.1.smithi135.stderr: 47150K .......... .......... .......... .......... .......... 28% 693K 4m19s 2023-11-18T19:09:55.393 INFO:tasks.workunit.client.1.smithi135.stderr: 47200K .......... .......... .......... .......... .......... 28% 834K 4m19s 2023-11-18T19:09:55.470 INFO:tasks.workunit.client.1.smithi135.stderr: 47250K .......... .......... .......... .......... .......... 28% 621K 4m19s 2023-11-18T19:09:55.542 INFO:tasks.workunit.client.1.smithi135.stderr: 47300K .......... .......... .......... .......... .......... 28% 696K 4m19s 2023-11-18T19:09:55.629 INFO:tasks.workunit.client.1.smithi135.stderr: 47350K .......... .......... .......... .......... .......... 28% 573K 4m19s 2023-11-18T19:09:55.713 INFO:tasks.workunit.client.1.smithi135.stderr: 47400K .......... .......... .......... .......... .......... 28% 733K 4m18s 2023-11-18T19:09:55.764 INFO:tasks.workunit.client.1.smithi135.stderr: 47450K .......... .......... .......... .......... .......... 28% 748K 4m18s 2023-11-18T19:09:55.850 INFO:tasks.workunit.client.1.smithi135.stderr: 47500K .......... .......... .......... .......... .......... 28% 581K 4m18s 2023-11-18T19:09:55.934 INFO:tasks.workunit.client.1.smithi135.stderr: 47550K .......... .......... .......... .......... .......... 28% 595K 4m18s 2023-11-18T19:09:56.014 INFO:tasks.workunit.client.1.smithi135.stderr: 47600K .......... .......... .......... .......... .......... 28% 625K 4m18s 2023-11-18T19:09:56.103 INFO:tasks.workunit.client.1.smithi135.stderr: 47650K .......... .......... .......... .......... .......... 28% 585K 4m17s 2023-11-18T19:09:56.167 INFO:tasks.workunit.client.1.smithi135.stderr: 47700K .......... .......... .......... .......... .......... 28% 737K 4m17s 2023-11-18T19:09:56.253 INFO:tasks.workunit.client.1.smithi135.stderr: 47750K .......... .......... .......... .......... .......... 28% 584K 4m17s 2023-11-18T19:09:56.316 INFO:tasks.workunit.client.1.smithi135.stderr: 47800K .......... .......... .......... .......... .......... 28% 786K 4m17s 2023-11-18T19:09:56.380 INFO:tasks.workunit.client.1.smithi135.stderr: 47850K .......... .......... .......... .......... .......... 28% 791K 4m17s 2023-11-18T19:09:56.451 INFO:tasks.workunit.client.1.smithi135.stderr: 47900K .......... .......... .......... .......... .......... 28% 701K 4m16s 2023-11-18T19:09:56.516 INFO:tasks.workunit.client.1.smithi135.stderr: 47950K .......... .......... .......... .......... .......... 28% 769K 4m16s 2023-11-18T19:09:56.596 INFO:tasks.workunit.client.1.smithi135.stderr: 48000K .......... .......... .......... .......... .......... 28% 630K 4m16s 2023-11-18T19:09:56.653 INFO:tasks.workunit.client.1.smithi135.stderr: 48050K .......... .......... .......... .......... .......... 28% 865K 4m16s 2023-11-18T19:09:56.721 INFO:tasks.workunit.client.1.smithi135.stderr: 48100K .......... .......... .......... .......... .......... 28% 761K 4m16s 2023-11-18T19:09:56.795 INFO:tasks.workunit.client.1.smithi135.stderr: 48150K .......... .......... .......... .......... .......... 28% 663K 4m15s 2023-11-18T19:09:56.874 INFO:tasks.workunit.client.1.smithi135.stderr: 48200K .......... .......... .......... .......... .......... 28% 642K 4m15s 2023-11-18T19:09:56.938 INFO:tasks.workunit.client.1.smithi135.stderr: 48250K .......... .......... .......... .......... .......... 28% 757K 4m15s 2023-11-18T19:09:57.017 INFO:tasks.workunit.client.1.smithi135.stderr: 48300K .......... .......... .......... .......... .......... 28% 637K 4m15s 2023-11-18T19:09:57.064 INFO:tasks.workunit.client.1.smithi135.stderr: 48350K .......... .......... .......... .......... .......... 28% 1.04M 4m15s 2023-11-18T19:09:57.151 INFO:tasks.workunit.client.1.smithi135.stderr: 48400K .......... .......... .......... .......... .......... 28% 575K 4m15s 2023-11-18T19:09:57.337 INFO:tasks.workunit.client.1.smithi135.stderr: 48450K .......... .......... .......... .......... .......... 28% 269K 4m15s 2023-11-18T19:09:57.395 INFO:tasks.workunit.client.1.smithi135.stderr: 48500K .......... .......... .......... .......... .......... 28% 859K 4m14s 2023-11-18T19:09:57.476 INFO:tasks.workunit.client.1.smithi135.stderr: 48550K .......... .......... .......... .......... .......... 28% 612K 4m14s 2023-11-18T19:09:57.554 INFO:tasks.workunit.client.1.smithi135.stderr: 48600K .......... .......... .......... .......... .......... 28% 698K 4m14s 2023-11-18T19:09:57.679 INFO:tasks.workunit.client.1.smithi135.stderr: 48650K .......... .......... .......... .......... .......... 28% 394K 4m14s 2023-11-18T19:09:57.867 INFO:tasks.workunit.client.1.smithi135.stderr: 48700K .......... .......... .......... .......... .......... 28% 260K 4m14s 2023-11-18T19:09:58.002 INFO:tasks.workunit.client.1.smithi135.stderr: 48750K .......... .......... .......... .......... .......... 28% 387K 4m14s 2023-11-18T19:09:58.120 INFO:tasks.workunit.client.1.smithi135.stderr: 48800K .......... .......... .......... .......... .......... 28% 406K 4m14s 2023-11-18T19:09:58.249 INFO:tasks.workunit.client.1.smithi135.stderr: 48850K .......... .......... .......... .......... .......... 29% 404K 4m14s 2023-11-18T19:09:58.359 INFO:tasks.workunit.client.1.smithi135.stderr: 48900K .......... .......... .......... .......... .......... 29% 432K 4m14s 2023-11-18T19:09:58.496 INFO:tasks.workunit.client.1.smithi135.stderr: 48950K .......... .......... .......... .......... .......... 29% 365K 4m14s 2023-11-18T19:09:58.630 INFO:tasks.workunit.client.1.smithi135.stderr: 49000K .......... .......... .......... .......... .......... 29% 408K 4m14s 2023-11-18T19:09:58.735 INFO:tasks.workunit.client.1.smithi135.stderr: 49050K .......... .......... .......... .......... .......... 29% 430K 4m14s 2023-11-18T19:09:58.862 INFO:tasks.workunit.client.1.smithi135.stderr: 49100K .......... .......... .......... .......... .......... 29% 426K 4m14s 2023-11-18T19:09:58.981 INFO:tasks.workunit.client.1.smithi135.stderr: 49150K .......... .......... .......... .......... .......... 29% 388K 4m14s 2023-11-18T19:09:59.157 INFO:tasks.workunit.client.1.smithi135.stderr: 49200K .......... .......... .......... .......... .......... 29% 284K 4m14s 2023-11-18T19:09:59.246 INFO:tasks.workunit.client.1.smithi135.stderr: 49250K .......... .......... .......... .......... .......... 29% 665K 4m13s 2023-11-18T19:09:59.370 INFO:tasks.workunit.client.1.smithi135.stderr: 49300K .......... .......... .......... .......... .......... 29% 379K 4m13s 2023-11-18T19:09:59.515 INFO:tasks.workunit.client.1.smithi135.stderr: 49350K .......... .......... .......... .......... .......... 29% 330K 4m13s 2023-11-18T19:09:59.625 INFO:tasks.workunit.client.1.smithi135.stderr: 49400K .......... .......... .......... .......... .......... 29% 457K 4m13s 2023-11-18T19:09:59.774 INFO:tasks.workunit.client.1.smithi135.stderr: 49450K .......... .......... .......... .......... .......... 29% 371K 4m13s 2023-11-18T19:09:59.890 INFO:tasks.workunit.client.1.smithi135.stderr: 49500K .......... .......... .......... .......... .......... 29% 384K 4m13s 2023-11-18T19:10:00.020 INFO:tasks.workunit.client.1.smithi135.stderr: 49550K .......... .......... .......... .......... .......... 29% 469K 4m13s 2023-11-18T19:10:00.151 INFO:tasks.workunit.client.1.smithi135.stderr: 49600K .......... .......... .......... .......... .......... 29% 323K 4m13s 2023-11-18T19:10:00.295 INFO:tasks.workunit.client.1.smithi135.stderr: 49650K .......... .......... .......... .......... .......... 29% 348K 4m13s 2023-11-18T19:10:00.418 INFO:tasks.workunit.client.1.smithi135.stderr: 49700K .......... .......... .......... .......... .......... 29% 406K 4m13s 2023-11-18T19:10:00.573 INFO:tasks.workunit.client.1.smithi135.stderr: 49750K .......... .......... .......... .......... .......... 29% 323K 4m13s 2023-11-18T19:10:00.740 INFO:tasks.workunit.client.1.smithi135.stderr: 49800K .......... .......... .......... .......... .......... 29% 300K 4m13s 2023-11-18T19:10:00.844 INFO:tasks.workunit.client.1.smithi135.stderr: 49850K .......... .......... .......... .......... .......... 29% 477K 4m13s 2023-11-18T19:10:01.000 INFO:tasks.workunit.client.1.smithi135.stderr: 49900K .......... .......... .......... .......... .......... 29% 320K 4m13s 2023-11-18T19:10:01.143 INFO:tasks.workunit.client.1.smithi135.stderr: 49950K .......... .......... .......... .......... .......... 29% 352K 4m13s 2023-11-18T19:10:01.267 INFO:tasks.workunit.client.1.smithi135.stderr: 50000K .......... .......... .......... .......... .......... 29% 409K 4m13s 2023-11-18T19:10:01.485 INFO:tasks.workunit.client.1.smithi135.stderr: 50050K .......... .......... .......... .......... .......... 29% 228K 4m13s 2023-11-18T19:10:01.578 INFO:tasks.workunit.client.1.smithi135.stderr: 50100K .......... .......... .......... .......... .......... 29% 536K 4m13s 2023-11-18T19:10:01.723 INFO:tasks.workunit.client.1.smithi135.stderr: 50150K .......... .......... .......... .......... .......... 29% 345K 4m13s 2023-11-18T19:10:01.851 INFO:tasks.workunit.client.1.smithi135.stderr: 50200K .......... .......... .......... .......... .......... 29% 392K 4m13s 2023-11-18T19:10:02.016 INFO:tasks.workunit.client.1.smithi135.stderr: 50250K .......... .......... .......... .......... .......... 29% 302K 4m13s 2023-11-18T19:10:02.125 INFO:tasks.workunit.client.1.smithi135.stderr: 50300K .......... .......... .......... .......... .......... 29% 458K 4m13s 2023-11-18T19:10:02.262 INFO:tasks.workunit.client.1.smithi135.stderr: 50350K .......... .......... .......... .......... .......... 29% 366K 4m13s 2023-11-18T19:10:02.430 INFO:tasks.workunit.client.1.smithi135.stderr: 50400K .......... .......... .......... .......... .......... 29% 297K 4m13s 2023-11-18T19:10:02.532 INFO:tasks.workunit.client.1.smithi135.stderr: 50450K .......... .......... .......... .......... .......... 29% 501K 4m13s 2023-11-18T19:10:02.702 INFO:tasks.workunit.client.1.smithi135.stderr: 50500K .......... .......... .......... .......... .......... 29% 290K 4m13s 2023-11-18T19:10:02.825 INFO:tasks.workunit.client.1.smithi135.stderr: 50550K .......... .......... .......... .......... .......... 30% 532K 4m13s 2023-11-18T19:10:02.955 INFO:tasks.workunit.client.1.smithi135.stderr: 50600K .......... .......... .......... .......... .......... 30% 316K 4m13s 2023-11-18T19:10:03.058 INFO:tasks.workunit.client.1.smithi135.stderr: 50650K .......... .......... .......... .......... .......... 30% 482K 4m12s 2023-11-18T19:10:03.173 INFO:tasks.workunit.client.1.smithi135.stderr: 50700K .......... .......... .......... .......... .......... 30% 436K 4m12s 2023-11-18T19:10:03.312 INFO:tasks.workunit.client.1.smithi135.stderr: 50750K .......... .......... .......... .......... .......... 30% 360K 4m12s 2023-11-18T19:10:03.404 INFO:tasks.workunit.client.1.smithi135.stderr: 50800K .......... .......... .......... .......... .......... 30% 554K 4m12s 2023-11-18T19:10:03.531 INFO:tasks.workunit.client.1.smithi135.stderr: 50850K .......... .......... .......... .......... .......... 30% 385K 4m12s 2023-11-18T19:10:03.719 INFO:tasks.workunit.client.1.smithi135.stderr: 50900K .......... .......... .......... .......... .......... 30% 267K 4m12s 2023-11-18T19:10:03.855 INFO:tasks.workunit.client.1.smithi135.stderr: 50950K .......... .......... .......... .......... .......... 30% 367K 4m12s 2023-11-18T19:10:03.968 INFO:tasks.workunit.client.1.smithi135.stderr: 51000K .......... .......... .......... .......... .......... 30% 452K 4m12s 2023-11-18T19:10:04.099 INFO:tasks.workunit.client.1.smithi135.stderr: 51050K .......... .......... .......... .......... .......... 30% 373K 4m12s 2023-11-18T19:10:04.211 INFO:tasks.workunit.client.1.smithi135.stderr: 51100K .......... .......... .......... .......... .......... 30% 449K 4m12s 2023-11-18T19:10:04.329 INFO:tasks.workunit.client.1.smithi135.stderr: 51150K .......... .......... .......... .......... .......... 30% 425K 4m12s 2023-11-18T19:10:04.431 INFO:tasks.workunit.client.1.smithi135.stderr: 51200K .......... .......... .......... .......... .......... 30% 486K 4m12s 2023-11-18T19:10:04.587 INFO:tasks.workunit.client.1.smithi135.stderr: 51250K .......... .......... .......... .......... .......... 30% 324K 4m12s 2023-11-18T19:10:04.692 INFO:tasks.workunit.client.1.smithi135.stderr: 51300K .......... .......... .......... .......... .......... 30% 469K 4m12s 2023-11-18T19:10:04.798 INFO:tasks.workunit.client.1.smithi135.stderr: 51350K .......... .......... .......... .......... .......... 30% 480K 4m11s 2023-11-18T19:10:04.906 INFO:tasks.workunit.client.1.smithi135.stderr: 51400K .......... .......... .......... .......... .......... 30% 457K 4m11s 2023-11-18T19:10:05.014 INFO:tasks.workunit.client.1.smithi135.stderr: 51450K .......... .......... .......... .......... .......... 30% 498K 4m11s 2023-11-18T19:10:05.082 INFO:tasks.workunit.client.0.smithi045.stdout: 20 9594 43 5015 78 4266 132 2023-11-18T19:10:05.104 INFO:tasks.workunit.client.1.smithi135.stderr: 51500K .......... .......... .......... .......... .......... 30% 514K 4m11s 2023-11-18T19:10:05.192 INFO:tasks.workunit.client.1.smithi135.stderr: 51550K .......... .......... .......... .......... .......... 30% 565K 4m11s 2023-11-18T19:10:05.385 INFO:tasks.workunit.client.1.smithi135.stderr: 51600K .......... .......... .......... .......... .......... 30% 260K 4m11s 2023-11-18T19:10:05.393 INFO:tasks.workunit.client.1.smithi135.stderr: 51650K .......... .......... .......... .......... .......... 30% 5.61M 4m11s 2023-11-18T19:10:05.516 INFO:tasks.workunit.client.1.smithi135.stderr: 51700K .......... .......... .......... .......... .......... 30% 406K 4m11s 2023-11-18T19:10:05.632 INFO:tasks.workunit.client.1.smithi135.stderr: 51750K .......... .......... .......... .......... .......... 30% 443K 4m11s 2023-11-18T19:10:05.744 INFO:tasks.workunit.client.1.smithi135.stderr: 51800K .......... .......... .......... .......... .......... 30% 435K 4m10s 2023-11-18T19:10:05.838 INFO:tasks.workunit.client.1.smithi135.stderr: 51850K .......... .......... .......... .......... .......... 30% 563K 4m10s 2023-11-18T19:10:05.932 INFO:tasks.workunit.client.1.smithi135.stderr: 51900K .......... .......... .......... .......... .......... 30% 504K 4m10s 2023-11-18T19:10:06.072 INFO:tasks.workunit.client.1.smithi135.stderr: 51950K .......... .......... .......... .......... .......... 30% 359K 4m10s 2023-11-18T19:10:06.164 INFO:tasks.workunit.client.1.smithi135.stderr: 52000K .......... .......... .......... .......... .......... 30% 535K 4m10s 2023-11-18T19:10:06.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:10:06.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:10:06.258 INFO:tasks.workunit.client.1.smithi135.stderr: 52050K .......... .......... .......... .......... .......... 30% 533K 4m10s 2023-11-18T19:10:06.385 INFO:tasks.workunit.client.1.smithi135.stderr: 52100K .......... .......... .......... .......... .......... 30% 535K 4m10s 2023-11-18T19:10:06.482 INFO:tasks.workunit.client.1.smithi135.stderr: 52150K .......... .......... .......... .......... .......... 30% 384K 4m10s 2023-11-18T19:10:06.667 INFO:tasks.workunit.client.1.smithi135.stderr: 52200K .......... .......... .......... .......... .......... 30% 271K 4m10s 2023-11-18T19:10:06.735 INFO:tasks.workunit.client.1.smithi135.stderr: 52250K .......... .......... .......... .......... .......... 31% 769K 4m10s 2023-11-18T19:10:06.836 INFO:tasks.workunit.client.1.smithi135.stderr: 52300K .......... .......... .......... .......... .......... 31% 478K 4m9s 2023-11-18T19:10:06.982 INFO:tasks.workunit.client.1.smithi135.stderr: 52350K .......... .......... .......... .......... .......... 31% 496K 4m9s 2023-11-18T19:10:07.090 INFO:tasks.workunit.client.1.smithi135.stderr: 52400K .......... .......... .......... .......... .......... 31% 349K 4m9s 2023-11-18T19:10:07.202 INFO:tasks.workunit.client.1.smithi135.stderr: 52450K .......... .......... .......... .......... .......... 31% 407K 4m9s 2023-11-18T19:10:07.294 INFO:tasks.workunit.client.1.smithi135.stderr: 52500K .......... .......... .......... .......... .......... 31% 547K 4m9s 2023-11-18T19:10:07.440 INFO:tasks.workunit.client.1.smithi135.stderr: 52550K .......... .......... .......... .......... .......... 31% 342K 4m9s 2023-11-18T19:10:07.644 INFO:tasks.workunit.client.1.smithi135.stderr: 52600K .......... .......... .......... .......... .......... 31% 246K 4m9s 2023-11-18T19:10:07.725 INFO:tasks.workunit.client.1.smithi135.stderr: 52650K .......... .......... .......... .......... .......... 31% 615K 4m9s 2023-11-18T19:10:07.900 INFO:tasks.workunit.client.1.smithi135.stderr: 52700K .......... .......... .......... .......... .......... 31% 286K 4m9s 2023-11-18T19:10:08.016 INFO:tasks.workunit.client.1.smithi135.stderr: 52750K .......... .......... .......... .......... .......... 31% 431K 4m9s 2023-11-18T19:10:08.176 INFO:tasks.workunit.client.1.smithi135.stderr: 52800K .......... .......... .......... .......... .......... 31% 311K 4m9s 2023-11-18T19:10:08.298 INFO:tasks.workunit.client.1.smithi135.stderr: 52850K .......... .......... .......... .......... .......... 31% 414K 4m9s 2023-11-18T19:10:08.444 INFO:tasks.workunit.client.1.smithi135.stderr: 52900K .......... .......... .......... .......... .......... 31% 342K 4m9s 2023-11-18T19:10:08.545 INFO:tasks.workunit.client.1.smithi135.stderr: 52950K .......... .......... .......... .......... .......... 31% 491K 4m9s 2023-11-18T19:10:08.667 INFO:tasks.workunit.client.1.smithi135.stderr: 53000K .......... .......... .......... .......... .......... 31% 465K 4m9s 2023-11-18T19:10:08.800 INFO:tasks.workunit.client.1.smithi135.stderr: 53050K .......... .......... .......... .......... .......... 31% 339K 4m9s 2023-11-18T19:10:08.913 INFO:tasks.workunit.client.1.smithi135.stderr: 53100K .......... .......... .......... .......... .......... 31% 445K 4m8s 2023-11-18T19:10:09.023 INFO:tasks.workunit.client.1.smithi135.stderr: 53150K .......... .......... .......... .......... .......... 31% 455K 4m8s 2023-11-18T19:10:09.170 INFO:tasks.workunit.client.1.smithi135.stderr: 53200K .......... .......... .......... .......... .......... 31% 432K 4m8s 2023-11-18T19:10:09.266 INFO:tasks.workunit.client.1.smithi135.stderr: 53250K .......... .......... .......... .......... .......... 31% 393K 4m8s 2023-11-18T19:10:09.365 INFO:tasks.workunit.client.1.smithi135.stderr: 53300K .......... .......... .......... .......... .......... 31% 506K 4m8s 2023-11-18T19:10:09.507 INFO:tasks.workunit.client.1.smithi135.stderr: 53350K .......... .......... .......... .......... .......... 31% 351K 4m8s 2023-11-18T19:10:09.607 INFO:tasks.workunit.client.1.smithi135.stderr: 53400K .......... .......... .......... .......... .......... 31% 499K 4m8s 2023-11-18T19:10:09.725 INFO:tasks.workunit.client.1.smithi135.stderr: 53450K .......... .......... .......... .......... .......... 31% 429K 4m8s 2023-11-18T19:10:09.814 INFO:tasks.workunit.client.1.smithi135.stderr: 53500K .......... .......... .......... .......... .......... 31% 553K 4m8s 2023-11-18T19:10:09.923 INFO:tasks.workunit.client.1.smithi135.stderr: 53550K .......... .......... .......... .......... .......... 31% 531K 4m8s 2023-11-18T19:10:10.040 INFO:tasks.workunit.client.1.smithi135.stderr: 53600K .......... .......... .......... .......... .......... 31% 378K 4m8s 2023-11-18T19:10:10.133 INFO:tasks.workunit.client.1.smithi135.stderr: 53650K .......... .......... .......... .......... .......... 31% 543K 4m7s 2023-11-18T19:10:10.229 INFO:tasks.workunit.client.1.smithi135.stderr: 53700K .......... .......... .......... .......... .......... 31% 521K 4m7s 2023-11-18T19:10:10.323 INFO:tasks.workunit.client.1.smithi135.stderr: 53750K .......... .......... .......... .......... .......... 31% 532K 4m7s 2023-11-18T19:10:10.424 INFO:tasks.workunit.client.1.smithi135.stderr: 53800K .......... .......... .......... .......... .......... 31% 493K 4m7s 2023-11-18T19:10:10.516 INFO:tasks.workunit.client.1.smithi135.stderr: 53850K .......... .......... .......... .......... .......... 31% 544K 4m7s 2023-11-18T19:10:10.647 INFO:tasks.workunit.client.1.smithi135.stderr: 53900K .......... .......... .......... .......... .......... 32% 480K 4m7s 2023-11-18T19:10:10.744 INFO:tasks.workunit.client.1.smithi135.stderr: 53950K .......... .......... .......... .......... .......... 32% 404K 4m7s 2023-11-18T19:10:10.847 INFO:tasks.workunit.client.1.smithi135.stderr: 54000K .......... .......... .......... .......... .......... 32% 604K 4m6s 2023-11-18T19:10:10.925 INFO:tasks.workunit.client.1.smithi135.stderr: 54050K .......... .......... .......... .......... .......... 32% 508K 4m6s 2023-11-18T19:10:11.031 INFO:tasks.workunit.client.1.smithi135.stderr: 54100K .......... .......... .......... .......... .......... 32% 495K 4m6s 2023-11-18T19:10:11.140 INFO:tasks.workunit.client.1.smithi135.stderr: 54150K .......... .......... .......... .......... .......... 32% 442K 4m6s 2023-11-18T19:10:11.251 INFO:tasks.workunit.client.1.smithi135.stderr: 54200K .......... .......... .......... .......... .......... 32% 449K 4m6s 2023-11-18T19:10:11.373 INFO:tasks.workunit.client.1.smithi135.stderr: 54250K .......... .......... .......... .......... .......... 32% 411K 4m6s 2023-11-18T19:10:11.488 INFO:tasks.workunit.client.1.smithi135.stderr: 54300K .......... .......... .......... .......... .......... 32% 435K 4m6s 2023-11-18T19:10:11.609 INFO:tasks.workunit.client.1.smithi135.stderr: 54350K .......... .......... .......... .......... .......... 32% 413K 4m6s 2023-11-18T19:10:11.686 INFO:tasks.workunit.client.1.smithi135.stderr: 54400K .......... .......... .......... .......... .......... 32% 647K 4m6s 2023-11-18T19:10:11.911 INFO:tasks.workunit.client.1.smithi135.stderr: 54450K .......... .......... .......... .......... .......... 32% 223K 4m6s 2023-11-18T19:10:11.972 INFO:tasks.workunit.client.1.smithi135.stderr: 54500K .......... .......... .......... .......... .......... 32% 841K 4m6s 2023-11-18T19:10:12.101 INFO:tasks.workunit.client.1.smithi135.stderr: 54550K .......... .......... .......... .......... .......... 32% 387K 4m5s 2023-11-18T19:10:12.270 INFO:tasks.workunit.client.1.smithi135.stderr: 54600K .......... .......... .......... .......... .......... 32% 293K 4m6s 2023-11-18T19:10:12.392 INFO:tasks.workunit.client.1.smithi135.stderr: 54650K .......... .......... .......... .......... .......... 32% 409K 4m5s 2023-11-18T19:10:12.515 INFO:tasks.workunit.client.1.smithi135.stderr: 54700K .......... .......... .......... .......... .......... 32% 405K 4m5s 2023-11-18T19:10:12.628 INFO:tasks.workunit.client.1.smithi135.stderr: 54750K .......... .......... .......... .......... .......... 32% 442K 4m5s 2023-11-18T19:10:12.741 INFO:tasks.workunit.client.1.smithi135.stderr: 54800K .......... .......... .......... .......... .......... 32% 441K 4m5s 2023-11-18T19:10:12.864 INFO:tasks.workunit.client.1.smithi135.stderr: 54850K .......... .......... .......... .......... .......... 32% 409K 4m5s 2023-11-18T19:10:12.976 INFO:tasks.workunit.client.1.smithi135.stderr: 54900K .......... .......... .......... .......... .......... 32% 446K 4m5s 2023-11-18T19:10:13.086 INFO:tasks.workunit.client.1.smithi135.stderr: 54950K .......... .......... .......... .......... .......... 32% 454K 4m5s 2023-11-18T19:10:13.194 INFO:tasks.workunit.client.1.smithi135.stderr: 55000K .......... .......... .......... .......... .......... 32% 462K 4m5s 2023-11-18T19:10:13.303 INFO:tasks.workunit.client.1.smithi135.stderr: 55050K .......... .......... .......... .......... .......... 32% 461K 4m5s 2023-11-18T19:10:13.396 INFO:tasks.workunit.client.1.smithi135.stderr: 55100K .......... .......... .......... .......... .......... 32% 537K 4m5s 2023-11-18T19:10:13.590 INFO:tasks.workunit.client.1.smithi135.stderr: 55150K .......... .......... .......... .......... .......... 32% 258K 4m5s 2023-11-18T19:10:13.602 INFO:tasks.workunit.client.1.smithi135.stderr: 55200K .......... .......... .......... .......... .......... 32% 3.76M 4m4s 2023-11-18T19:10:13.721 INFO:tasks.workunit.client.1.smithi135.stderr: 55250K .......... .......... .......... .......... .......... 32% 439K 4m4s 2023-11-18T19:10:13.840 INFO:tasks.workunit.client.1.smithi135.stderr: 55300K .......... .......... .......... .......... .......... 32% 407K 4m4s 2023-11-18T19:10:13.953 INFO:tasks.workunit.client.1.smithi135.stderr: 55350K .......... .......... .......... .......... .......... 32% 439K 4m4s 2023-11-18T19:10:14.106 INFO:tasks.workunit.client.1.smithi135.stderr: 55400K .......... .......... .......... .......... .......... 32% 328K 4m4s 2023-11-18T19:10:14.218 INFO:tasks.workunit.client.1.smithi135.stderr: 55450K .......... .......... .......... .......... .......... 32% 453K 4m4s 2023-11-18T19:10:14.333 INFO:tasks.workunit.client.1.smithi135.stderr: 55500K .......... .......... .......... .......... .......... 32% 428K 4m4s 2023-11-18T19:10:14.463 INFO:tasks.workunit.client.1.smithi135.stderr: 55550K .......... .......... .......... .......... .......... 32% 384K 4m4s 2023-11-18T19:10:14.612 INFO:tasks.workunit.client.1.smithi135.stderr: 55600K .......... .......... .......... .......... .......... 33% 336K 4m4s 2023-11-18T19:10:14.738 INFO:tasks.workunit.client.1.smithi135.stderr: 55650K .......... .......... .......... .......... .......... 33% 397K 4m4s 2023-11-18T19:10:14.817 INFO:tasks.workunit.client.1.smithi135.stderr: 55700K .......... .......... .......... .......... .......... 33% 634K 4m4s 2023-11-18T19:10:14.922 INFO:tasks.workunit.client.1.smithi135.stderr: 55750K .......... .......... .......... .......... .......... 33% 473K 4m3s 2023-11-18T19:10:15.056 INFO:tasks.workunit.client.1.smithi135.stderr: 55800K .......... .......... .......... .......... .......... 33% 505K 4m3s 2023-11-18T19:10:15.082 INFO:tasks.workunit.client.0.smithi045.stdout: 21 10065 14 6019 89 3807 111 2023-11-18T19:10:15.183 INFO:tasks.workunit.client.1.smithi135.stderr: 55850K .......... .......... .......... .......... .......... 33% 310K 4m3s 2023-11-18T19:10:15.295 INFO:tasks.workunit.client.1.smithi135.stderr: 55900K .......... .......... .......... .......... .......... 33% 452K 4m3s 2023-11-18T19:10:15.410 INFO:tasks.workunit.client.1.smithi135.stderr: 55950K .......... .......... .......... .......... .......... 33% 429K 4m3s 2023-11-18T19:10:15.520 INFO:tasks.workunit.client.1.smithi135.stderr: 56000K .......... .......... .......... .......... .......... 33% 451K 4m3s 2023-11-18T19:10:15.623 INFO:tasks.workunit.client.1.smithi135.stderr: 56050K .......... .......... .......... .......... .......... 33% 489K 4m3s 2023-11-18T19:10:15.729 INFO:tasks.workunit.client.1.smithi135.stderr: 56100K .......... .......... .......... .......... .......... 33% 470K 4m3s 2023-11-18T19:10:15.836 INFO:tasks.workunit.client.1.smithi135.stderr: 56150K .......... .......... .......... .......... .......... 33% 469K 4m3s 2023-11-18T19:10:15.933 INFO:tasks.workunit.client.1.smithi135.stderr: 56200K .......... .......... .......... .......... .......... 33% 515K 4m3s 2023-11-18T19:10:16.016 INFO:tasks.workunit.client.1.smithi135.stderr: 56250K .......... .......... .......... .......... .......... 33% 601K 4m2s 2023-11-18T19:10:16.090 INFO:tasks.workunit.client.1.smithi135.stderr: 56300K .......... .......... .......... .......... .......... 33% 675K 4m2s 2023-11-18T19:10:16.159 INFO:tasks.workunit.client.1.smithi135.stderr: 56350K .......... .......... .......... .......... .......... 33% 728K 4m2s 2023-11-18T19:10:16.243 INFO:tasks.workunit.client.1.smithi135.stderr: 56400K .......... .......... .......... .......... .......... 33% 592K 4m2s 2023-11-18T19:10:16.292 INFO:tasks.workunit.client.1.smithi135.stderr: 56450K .......... .......... .......... .......... .......... 33% 1023K 4m2s 2023-11-18T19:10:16.373 INFO:tasks.workunit.client.1.smithi135.stderr: 56500K .......... .......... .......... .......... .......... 33% 620K 4m1s 2023-11-18T19:10:16.437 INFO:tasks.workunit.client.1.smithi135.stderr: 56550K .......... .......... .......... .......... .......... 33% 777K 4m1s 2023-11-18T19:10:16.507 INFO:tasks.workunit.client.1.smithi135.stderr: 56600K .......... .......... .......... .......... .......... 33% 765K 4m1s 2023-11-18T19:10:16.577 INFO:tasks.workunit.client.1.smithi135.stderr: 56650K .......... .......... .......... .......... .......... 33% 671K 4m1s 2023-11-18T19:10:16.654 INFO:tasks.workunit.client.1.smithi135.stderr: 56700K .......... .......... .......... .......... .......... 33% 682K 4m1s 2023-11-18T19:10:16.730 INFO:tasks.workunit.client.1.smithi135.stderr: 56750K .......... .......... .......... .......... .......... 33% 632K 4m1s 2023-11-18T19:10:16.798 INFO:tasks.workunit.client.1.smithi135.stderr: 56800K .......... .......... .......... .......... .......... 33% 1.13M 4m0s 2023-11-18T19:10:16.863 INFO:tasks.workunit.client.1.smithi135.stderr: 56850K .......... .......... .......... .......... .......... 33% 553K 4m0s 2023-11-18T19:10:16.931 INFO:tasks.workunit.client.1.smithi135.stderr: 56900K .......... .......... .......... .......... .......... 33% 726K 4m0s 2023-11-18T19:10:17.001 INFO:tasks.workunit.client.1.smithi135.stderr: 56950K .......... .......... .......... .......... .......... 33% 726K 4m0s 2023-11-18T19:10:17.081 INFO:tasks.workunit.client.1.smithi135.stderr: 57000K .......... .......... .......... .......... .......... 33% 618K 4m0s 2023-11-18T19:10:17.155 INFO:tasks.workunit.client.1.smithi135.stderr: 57050K .......... .......... .......... .......... .......... 33% 683K 3m59s 2023-11-18T19:10:17.215 INFO:tasks.workunit.client.1.smithi135.stderr: 57100K .......... .......... .......... .......... .......... 33% 835K 3m59s 2023-11-18T19:10:17.279 INFO:tasks.workunit.client.1.smithi135.stderr: 57150K .......... .......... .......... .......... .......... 33% 786K 3m59s 2023-11-18T19:10:17.351 INFO:tasks.workunit.client.1.smithi135.stderr: 57200K .......... .......... .......... .......... .......... 33% 688K 3m59s 2023-11-18T19:10:17.541 INFO:tasks.workunit.client.1.smithi135.stderr: 57250K .......... .......... .......... .......... .......... 33% 263K 3m59s 2023-11-18T19:10:17.544 INFO:tasks.workunit.client.1.smithi135.stderr: 57300K .......... .......... .......... .......... .......... 34% 20.5M 3m59s 2023-11-18T19:10:17.615 INFO:tasks.workunit.client.1.smithi135.stderr: 57350K .......... .......... .......... .......... .......... 34% 695K 3m58s 2023-11-18T19:10:17.690 INFO:tasks.workunit.client.1.smithi135.stderr: 57400K .......... .......... .......... .......... .......... 34% 673K 3m58s 2023-11-18T19:10:17.780 INFO:tasks.workunit.client.1.smithi135.stderr: 57450K .......... .......... .......... .......... .......... 34% 556K 3m58s 2023-11-18T19:10:17.856 INFO:tasks.workunit.client.1.smithi135.stderr: 57500K .......... .......... .......... .......... .......... 34% 658K 3m58s 2023-11-18T19:10:17.928 INFO:tasks.workunit.client.1.smithi135.stderr: 57550K .......... .......... .......... .......... .......... 34% 691K 3m58s 2023-11-18T19:10:18.024 INFO:tasks.workunit.client.1.smithi135.stderr: 57600K .......... .......... .......... .......... .......... 34% 524K 3m58s 2023-11-18T19:10:18.107 INFO:tasks.workunit.client.1.smithi135.stderr: 57650K .......... .......... .......... .......... .......... 34% 601K 3m58s 2023-11-18T19:10:18.169 INFO:tasks.workunit.client.1.smithi135.stderr: 57700K .......... .......... .......... .......... .......... 34% 806K 3m57s 2023-11-18T19:10:18.248 INFO:tasks.workunit.client.1.smithi135.stderr: 57750K .......... .......... .......... .......... .......... 34% 632K 3m57s 2023-11-18T19:10:18.328 INFO:tasks.workunit.client.1.smithi135.stderr: 57800K .......... .......... .......... .......... .......... 34% 628K 3m57s 2023-11-18T19:10:18.400 INFO:tasks.workunit.client.1.smithi135.stderr: 57850K .......... .......... .......... .......... .......... 34% 689K 3m57s 2023-11-18T19:10:18.483 INFO:tasks.workunit.client.1.smithi135.stderr: 57900K .......... .......... .......... .......... .......... 34% 599K 3m57s 2023-11-18T19:10:18.564 INFO:tasks.workunit.client.1.smithi135.stderr: 57950K .......... .......... .......... .......... .......... 34% 758K 3m57s 2023-11-18T19:10:18.678 INFO:tasks.workunit.client.1.smithi135.stderr: 58000K .......... .......... .......... .......... .......... 34% 392K 3m56s 2023-11-18T19:10:18.734 INFO:tasks.workunit.client.1.smithi135.stderr: 58050K .......... .......... .......... .......... .......... 34% 1000K 3m56s 2023-11-18T19:10:18.803 INFO:tasks.workunit.client.1.smithi135.stderr: 58100K .......... .......... .......... .......... .......... 34% 660K 3m56s 2023-11-18T19:10:18.898 INFO:tasks.workunit.client.1.smithi135.stderr: 58150K .......... .......... .......... .......... .......... 34% 527K 3m56s 2023-11-18T19:10:18.969 INFO:tasks.workunit.client.1.smithi135.stderr: 58200K .......... .......... .......... .......... .......... 34% 700K 3m56s 2023-11-18T19:10:19.072 INFO:tasks.workunit.client.1.smithi135.stderr: 58250K .......... .......... .......... .......... .......... 34% 485K 3m56s 2023-11-18T19:10:19.164 INFO:tasks.workunit.client.1.smithi135.stderr: 58300K .......... .......... .......... .......... .......... 34% 547K 3m56s 2023-11-18T19:10:19.255 INFO:tasks.workunit.client.1.smithi135.stderr: 58350K .......... .......... .......... .......... .......... 34% 550K 3m55s 2023-11-18T19:10:19.350 INFO:tasks.workunit.client.1.smithi135.stderr: 58400K .......... .......... .......... .......... .......... 34% 578K 3m55s 2023-11-18T19:10:19.432 INFO:tasks.workunit.client.1.smithi135.stderr: 58450K .......... .......... .......... .......... .......... 34% 553K 3m55s 2023-11-18T19:10:19.518 INFO:tasks.workunit.client.1.smithi135.stderr: 58500K .......... .......... .......... .......... .......... 34% 617K 3m55s 2023-11-18T19:10:19.605 INFO:tasks.workunit.client.1.smithi135.stderr: 58550K .......... .......... .......... .......... .......... 34% 542K 3m55s 2023-11-18T19:10:19.699 INFO:tasks.workunit.client.1.smithi135.stderr: 58600K .......... .......... .......... .......... .......... 34% 532K 3m55s 2023-11-18T19:10:19.788 INFO:tasks.workunit.client.1.smithi135.stderr: 58650K .......... .......... .......... .......... .......... 34% 560K 3m55s 2023-11-18T19:10:19.878 INFO:tasks.workunit.client.1.smithi135.stderr: 58700K .......... .......... .......... .......... .......... 34% 556K 3m54s 2023-11-18T19:10:19.991 INFO:tasks.workunit.client.1.smithi135.stderr: 58750K .......... .......... .......... .......... .......... 34% 444K 3m54s 2023-11-18T19:10:20.052 INFO:tasks.workunit.client.1.smithi135.stderr: 58800K .......... .......... .......... .......... .......... 34% 811K 3m54s 2023-11-18T19:10:20.146 INFO:tasks.workunit.client.1.smithi135.stderr: 58850K .......... .......... .......... .......... .......... 34% 538K 3m54s 2023-11-18T19:10:20.361 INFO:tasks.workunit.client.1.smithi135.stderr: 58900K .......... .......... .......... .......... .......... 34% 233K 3m54s 2023-11-18T19:10:20.367 INFO:tasks.workunit.client.1.smithi135.stderr: 58950K .......... .......... .......... .......... .......... 35% 54.6M 3m54s 2023-11-18T19:10:20.466 INFO:tasks.workunit.client.1.smithi135.stderr: 59000K .......... .......... .......... .......... .......... 35% 479K 3m54s 2023-11-18T19:10:20.562 INFO:tasks.workunit.client.1.smithi135.stderr: 59050K .......... .......... .......... .......... .......... 35% 518K 3m54s 2023-11-18T19:10:20.667 INFO:tasks.workunit.client.1.smithi135.stderr: 59100K .......... .......... .......... .......... .......... 35% 477K 3m53s 2023-11-18T19:10:20.779 INFO:tasks.workunit.client.1.smithi135.stderr: 59150K .......... .......... .......... .......... .......... 35% 447K 3m53s 2023-11-18T19:10:20.871 INFO:tasks.workunit.client.1.smithi135.stderr: 59200K .......... .......... .......... .......... .......... 35% 546K 3m53s 2023-11-18T19:10:20.962 INFO:tasks.workunit.client.1.smithi135.stderr: 59250K .......... .......... .......... .......... .......... 35% 545K 3m53s 2023-11-18T19:10:21.068 INFO:tasks.workunit.client.1.smithi135.stderr: 59300K .......... .......... .......... .......... .......... 35% 473K 3m53s 2023-11-18T19:10:21.159 INFO:tasks.workunit.client.1.smithi135.stderr: 59350K .......... .......... .......... .......... .......... 35% 546K 3m53s 2023-11-18T19:10:21.247 INFO:tasks.workunit.client.1.smithi135.stderr: 59400K .......... .......... .......... .......... .......... 35% 570K 3m53s 2023-11-18T19:10:21.452 INFO:tasks.workunit.client.1.smithi135.stderr: 59450K .......... .......... .......... .......... .......... 35% 245K 3m53s 2023-11-18T19:10:21.495 INFO:tasks.workunit.client.1.smithi135.stderr: 59500K .......... .......... .......... .......... .......... 35% 1.12M 3m53s 2023-11-18T19:10:21.588 INFO:tasks.workunit.client.1.smithi135.stderr: 59550K .......... .......... .......... .......... .......... 35% 535K 3m52s 2023-11-18T19:10:21.732 INFO:tasks.workunit.client.1.smithi135.stderr: 59600K .......... .......... .......... .......... .......... 35% 348K 3m52s 2023-11-18T19:10:21.823 INFO:tasks.workunit.client.1.smithi135.stderr: 59650K .......... .......... .......... .......... .......... 35% 553K 3m52s 2023-11-18T19:10:21.941 INFO:tasks.workunit.client.1.smithi135.stderr: 59700K .......... .......... .......... .......... .......... 35% 489K 3m52s 2023-11-18T19:10:22.079 INFO:tasks.workunit.client.1.smithi135.stderr: 59750K .......... .......... .......... .......... .......... 35% 324K 3m52s 2023-11-18T19:10:22.175 INFO:tasks.workunit.client.1.smithi135.stderr: 59800K .......... .......... .......... .......... .......... 35% 520K 3m52s 2023-11-18T19:10:22.298 INFO:tasks.workunit.client.1.smithi135.stderr: 59850K .......... .......... .......... .......... .......... 35% 454K 3m52s 2023-11-18T19:10:22.393 INFO:tasks.workunit.client.1.smithi135.stderr: 59900K .......... .......... .......... .......... .......... 35% 465K 3m52s 2023-11-18T19:10:22.542 INFO:tasks.workunit.client.1.smithi135.stderr: 59950K .......... .......... .......... .......... .......... 35% 349K 3m52s 2023-11-18T19:10:22.650 INFO:tasks.workunit.client.1.smithi135.stderr: 60000K .......... .......... .......... .......... .......... 35% 440K 3m52s 2023-11-18T19:10:22.747 INFO:tasks.workunit.client.1.smithi135.stderr: 60050K .......... .......... .......... .......... .......... 35% 514K 3m51s 2023-11-18T19:10:22.841 INFO:tasks.workunit.client.1.smithi135.stderr: 60100K .......... .......... .......... .......... .......... 35% 592K 3m51s 2023-11-18T19:10:22.933 INFO:tasks.workunit.client.1.smithi135.stderr: 60150K .......... .......... .......... .......... .......... 35% 494K 3m51s 2023-11-18T19:10:23.086 INFO:tasks.workunit.client.1.smithi135.stderr: 60200K .......... .......... .......... .......... .......... 35% 384K 3m51s 2023-11-18T19:10:23.181 INFO:tasks.workunit.client.1.smithi135.stderr: 60250K .......... .......... .......... .......... .......... 35% 427K 3m51s 2023-11-18T19:10:23.281 INFO:tasks.workunit.client.1.smithi135.stderr: 60300K .......... .......... .......... .......... .......... 35% 512K 3m51s 2023-11-18T19:10:23.377 INFO:tasks.workunit.client.1.smithi135.stderr: 60350K .......... .......... .......... .......... .......... 35% 504K 3m51s 2023-11-18T19:10:23.465 INFO:tasks.workunit.client.1.smithi135.stderr: 60400K .......... .......... .......... .......... .......... 35% 572K 3m51s 2023-11-18T19:10:23.555 INFO:tasks.workunit.client.1.smithi135.stderr: 60450K .......... .......... .......... .......... .......... 35% 552K 3m51s 2023-11-18T19:10:23.645 INFO:tasks.workunit.client.1.smithi135.stderr: 60500K .......... .......... .......... .......... .......... 35% 553K 3m50s 2023-11-18T19:10:23.753 INFO:tasks.workunit.client.1.smithi135.stderr: 60550K .......... .......... .......... .......... .......... 35% 484K 3m50s 2023-11-18T19:10:23.917 INFO:tasks.workunit.client.1.smithi135.stderr: 60600K .......... .......... .......... .......... .......... 35% 299K 3m50s 2023-11-18T19:10:23.951 INFO:tasks.workunit.client.1.smithi135.stderr: 60650K .......... .......... .......... .......... .......... 36% 1.38M 3m50s 2023-11-18T19:10:24.107 INFO:tasks.workunit.client.1.smithi135.stderr: 60700K .......... .......... .......... .......... .......... 36% 322K 3m50s 2023-11-18T19:10:24.213 INFO:tasks.workunit.client.1.smithi135.stderr: 60750K .......... .......... .......... .......... .......... 36% 469K 3m50s 2023-11-18T19:10:24.443 INFO:tasks.workunit.client.1.smithi135.stderr: 60800K .......... .......... .......... .......... .......... 36% 219K 3m50s 2023-11-18T19:10:24.521 INFO:tasks.workunit.client.1.smithi135.stderr: 60850K .......... .......... .......... .......... .......... 36% 628K 3m50s 2023-11-18T19:10:24.706 INFO:tasks.workunit.client.1.smithi135.stderr: 60900K .......... .......... .......... .......... .......... 36% 270K 3m50s 2023-11-18T19:10:24.852 INFO:tasks.workunit.client.1.smithi135.stderr: 60950K .......... .......... .......... .......... .......... 36% 343K 3m50s 2023-11-18T19:10:25.063 INFO:tasks.workunit.client.1.smithi135.stderr: 61000K .......... .......... .......... .......... .......... 36% 240K 3m50s 2023-11-18T19:10:25.082 INFO:tasks.workunit.client.0.smithi045.stdout: 22 10682 33 5864 40 3638 77 2023-11-18T19:10:25.200 INFO:tasks.workunit.client.1.smithi135.stderr: 61050K .......... .......... .......... .......... .......... 36% 360K 3m50s 2023-11-18T19:10:25.376 INFO:tasks.workunit.client.1.smithi135.stderr: 61100K .......... .......... .......... .......... .......... 36% 284K 3m50s 2023-11-18T19:10:25.536 INFO:tasks.workunit.client.1.smithi135.stderr: 61150K .......... .......... .......... .......... .......... 36% 313K 3m50s 2023-11-18T19:10:25.649 INFO:tasks.workunit.client.1.smithi135.stderr: 61200K .......... .......... .......... .......... .......... 36% 446K 3m50s 2023-11-18T19:10:25.743 INFO:tasks.workunit.client.1.smithi135.stderr: 61250K .......... .......... .......... .......... .......... 36% 522K 3m50s 2023-11-18T19:10:25.876 INFO:tasks.workunit.client.1.smithi135.stderr: 61300K .......... .......... .......... .......... .......... 36% 378K 3m50s 2023-11-18T19:10:25.990 INFO:tasks.workunit.client.1.smithi135.stderr: 61350K .......... .......... .......... .......... .......... 36% 438K 3m50s 2023-11-18T19:10:26.154 INFO:tasks.workunit.client.1.smithi135.stderr: 61400K .......... .......... .......... .......... .......... 36% 306K 3m50s 2023-11-18T19:10:26.278 INFO:tasks.workunit.client.1.smithi135.stderr: 61450K .......... .......... .......... .......... .......... 36% 432K 3m49s 2023-11-18T19:10:26.381 INFO:tasks.workunit.client.1.smithi135.stderr: 61500K .......... .......... .......... .......... .......... 36% 453K 3m49s 2023-11-18T19:10:26.515 INFO:tasks.workunit.client.1.smithi135.stderr: 61550K .......... .......... .......... .......... .......... 36% 369K 3m49s 2023-11-18T19:10:26.641 INFO:tasks.workunit.client.1.smithi135.stderr: 61600K .......... .......... .......... .......... .......... 36% 397K 3m49s 2023-11-18T19:10:26.769 INFO:tasks.workunit.client.1.smithi135.stderr: 61650K .......... .......... .......... .......... .......... 36% 429K 3m49s 2023-11-18T19:10:26.875 INFO:tasks.workunit.client.1.smithi135.stderr: 61700K .......... .......... .......... .......... .......... 36% 426K 3m49s 2023-11-18T19:10:27.005 INFO:tasks.workunit.client.1.smithi135.stderr: 61750K .......... .......... .......... .......... .......... 36% 384K 3m49s 2023-11-18T19:10:27.109 INFO:tasks.workunit.client.1.smithi135.stderr: 61800K .......... .......... .......... .......... .......... 36% 481K 3m49s 2023-11-18T19:10:27.242 INFO:tasks.workunit.client.1.smithi135.stderr: 61850K .......... .......... .......... .......... .......... 36% 377K 3m49s 2023-11-18T19:10:27.366 INFO:tasks.workunit.client.1.smithi135.stderr: 61900K .......... .......... .......... .......... .......... 36% 431K 3m49s 2023-11-18T19:10:27.445 INFO:tasks.workunit.client.1.smithi135.stderr: 61950K .......... .......... .......... .......... .......... 36% 572K 3m49s 2023-11-18T19:10:27.568 INFO:tasks.workunit.client.1.smithi135.stderr: 62000K .......... .......... .......... .......... .......... 36% 441K 3m48s 2023-11-18T19:10:27.701 INFO:tasks.workunit.client.1.smithi135.stderr: 62050K .......... .......... .......... .......... .......... 36% 351K 3m48s 2023-11-18T19:10:27.807 INFO:tasks.workunit.client.1.smithi135.stderr: 62100K .......... .......... .......... .......... .......... 36% 471K 3m48s 2023-11-18T19:10:27.914 INFO:tasks.workunit.client.1.smithi135.stderr: 62150K .......... .......... .......... .......... .......... 36% 467K 3m48s 2023-11-18T19:10:28.015 INFO:tasks.workunit.client.1.smithi135.stderr: 62200K .......... .......... .......... .......... .......... 36% 499K 3m48s 2023-11-18T19:10:28.134 INFO:tasks.workunit.client.1.smithi135.stderr: 62250K .......... .......... .......... .......... .......... 36% 418K 3m48s 2023-11-18T19:10:28.237 INFO:tasks.workunit.client.1.smithi135.stderr: 62300K .......... .......... .......... .......... .......... 36% 484K 3m48s 2023-11-18T19:10:28.334 INFO:tasks.workunit.client.1.smithi135.stderr: 62350K .......... .......... .......... .......... .......... 37% 513K 3m48s 2023-11-18T19:10:28.444 INFO:tasks.workunit.client.1.smithi135.stderr: 62400K .......... .......... .......... .......... .......... 37% 457K 3m48s 2023-11-18T19:10:28.518 INFO:tasks.workunit.client.1.smithi135.stderr: 62450K .......... .......... .......... .......... .......... 37% 694K 3m47s 2023-11-18T19:10:28.592 INFO:tasks.workunit.client.1.smithi135.stderr: 62500K .......... .......... .......... .......... .......... 37% 658K 3m47s 2023-11-18T19:10:28.675 INFO:tasks.workunit.client.1.smithi135.stderr: 62550K .......... .......... .......... .......... .......... 37% 695K 3m47s 2023-11-18T19:10:28.744 INFO:tasks.workunit.client.1.smithi135.stderr: 62600K .......... .......... .......... .......... .......... 37% 620K 3m47s 2023-11-18T19:10:28.830 INFO:tasks.workunit.client.1.smithi135.stderr: 62650K .......... .......... .......... .......... .......... 37% 585K 3m47s 2023-11-18T19:10:28.941 INFO:tasks.workunit.client.1.smithi135.stderr: 62700K .......... .......... .......... .......... .......... 37% 450K 3m47s 2023-11-18T19:10:29.021 INFO:tasks.workunit.client.1.smithi135.stderr: 62750K .......... .......... .......... .......... .......... 37% 626K 3m47s 2023-11-18T19:10:29.098 INFO:tasks.workunit.client.1.smithi135.stderr: 62800K .......... .......... .......... .......... .......... 37% 648K 3m46s 2023-11-18T19:10:29.184 INFO:tasks.workunit.client.1.smithi135.stderr: 62850K .......... .......... .......... .......... .......... 37% 582K 3m46s 2023-11-18T19:10:29.267 INFO:tasks.workunit.client.1.smithi135.stderr: 62900K .......... .......... .......... .......... .......... 37% 745K 3m46s 2023-11-18T19:10:29.334 INFO:tasks.workunit.client.1.smithi135.stderr: 62950K .......... .......... .......... .......... .......... 37% 599K 3m46s 2023-11-18T19:10:29.535 INFO:tasks.workunit.client.1.smithi135.stderr: 63000K .......... .......... .......... .......... .......... 37% 250K 3m46s 2023-11-18T19:10:29.571 INFO:tasks.workunit.client.1.smithi135.stderr: 63050K .......... .......... .......... .......... .......... 37% 1.35M 3m46s 2023-11-18T19:10:29.637 INFO:tasks.workunit.client.1.smithi135.stderr: 63100K .......... .......... .......... .......... .......... 37% 749K 3m46s 2023-11-18T19:10:29.749 INFO:tasks.workunit.client.1.smithi135.stderr: 63150K .......... .......... .......... .......... .......... 37% 449K 3m46s 2023-11-18T19:10:29.830 INFO:tasks.workunit.client.1.smithi135.stderr: 63200K .......... .......... .......... .......... .......... 37% 619K 3m45s 2023-11-18T19:10:29.912 INFO:tasks.workunit.client.1.smithi135.stderr: 63250K .......... .......... .......... .......... .......... 37% 606K 3m45s 2023-11-18T19:10:30.008 INFO:tasks.workunit.client.1.smithi135.stderr: 63300K .......... .......... .......... .......... .......... 37% 522K 3m45s 2023-11-18T19:10:30.139 INFO:tasks.workunit.client.1.smithi135.stderr: 63350K .......... .......... .......... .......... .......... 37% 381K 3m45s 2023-11-18T19:10:30.231 INFO:tasks.workunit.client.1.smithi135.stderr: 63400K .......... .......... .......... .......... .......... 37% 541K 3m45s 2023-11-18T19:10:30.317 INFO:tasks.workunit.client.1.smithi135.stderr: 63450K .......... .......... .......... .......... .......... 37% 580K 3m45s 2023-11-18T19:10:30.397 INFO:tasks.workunit.client.1.smithi135.stderr: 63500K .......... .......... .......... .......... .......... 37% 632K 3m45s 2023-11-18T19:10:30.484 INFO:tasks.workunit.client.1.smithi135.stderr: 63550K .......... .......... .......... .......... .......... 37% 571K 3m44s 2023-11-18T19:10:30.572 INFO:tasks.workunit.client.1.smithi135.stderr: 63600K .......... .......... .......... .......... .......... 37% 570K 3m44s 2023-11-18T19:10:30.660 INFO:tasks.workunit.client.1.smithi135.stderr: 63650K .......... .......... .......... .......... .......... 37% 569K 3m44s 2023-11-18T19:10:30.745 INFO:tasks.workunit.client.1.smithi135.stderr: 63700K .......... .......... .......... .......... .......... 37% 585K 3m44s 2023-11-18T19:10:30.835 INFO:tasks.workunit.client.1.smithi135.stderr: 63750K .......... .......... .......... .......... .......... 37% 560K 3m44s 2023-11-18T19:10:30.924 INFO:tasks.workunit.client.1.smithi135.stderr: 63800K .......... .......... .......... .......... .......... 37% 555K 3m44s 2023-11-18T19:10:31.009 INFO:tasks.workunit.client.1.smithi135.stderr: 63850K .......... .......... .......... .......... .......... 37% 589K 3m44s 2023-11-18T19:10:31.103 INFO:tasks.workunit.client.1.smithi135.stderr: 63900K .......... .......... .......... .......... .......... 37% 532K 3m44s 2023-11-18T19:10:31.196 INFO:tasks.workunit.client.1.smithi135.stderr: 63950K .......... .......... .......... .......... .......... 37% 542K 3m43s 2023-11-18T19:10:31.270 INFO:tasks.workunit.client.1.smithi135.stderr: 64000K .......... .......... .......... .......... .......... 37% 671K 3m43s 2023-11-18T19:10:31.359 INFO:tasks.workunit.client.1.smithi135.stderr: 64050K .......... .......... .......... .......... .......... 38% 566K 3m43s 2023-11-18T19:10:31.450 INFO:tasks.workunit.client.1.smithi135.stderr: 64100K .......... .......... .......... .......... .......... 38% 547K 3m43s 2023-11-18T19:10:31.537 INFO:tasks.workunit.client.1.smithi135.stderr: 64150K .......... .......... .......... .......... .......... 38% 826K 3m43s 2023-11-18T19:10:31.605 INFO:tasks.workunit.client.1.smithi135.stderr: 64200K .......... .......... .......... .......... .......... 38% 529K 3m43s 2023-11-18T19:10:31.692 INFO:tasks.workunit.client.1.smithi135.stderr: 64250K .......... .......... .......... .......... .......... 38% 600K 3m42s 2023-11-18T19:10:31.779 INFO:tasks.workunit.client.1.smithi135.stderr: 64300K .......... .......... .......... .......... .......... 38% 550K 3m42s 2023-11-18T19:10:31.864 INFO:tasks.workunit.client.1.smithi135.stderr: 64350K .......... .......... .......... .......... .......... 38% 606K 3m42s 2023-11-18T19:10:31.946 INFO:tasks.workunit.client.1.smithi135.stderr: 64400K .......... .......... .......... .......... .......... 38% 597K 3m42s 2023-11-18T19:10:32.017 INFO:tasks.workunit.client.1.smithi135.stderr: 64450K .......... .......... .......... .......... .......... 38% 700K 3m42s 2023-11-18T19:10:32.068 INFO:tasks.workunit.client.1.smithi135.stderr: 64500K .......... .......... .......... .......... .......... 38% 974K 3m42s 2023-11-18T19:10:32.132 INFO:tasks.workunit.client.1.smithi135.stderr: 64550K .......... .......... .......... .......... .......... 38% 787K 3m42s 2023-11-18T19:10:32.238 INFO:tasks.workunit.client.1.smithi135.stderr: 64600K .......... .......... .......... .......... .......... 38% 470K 3m41s 2023-11-18T19:10:32.313 INFO:tasks.workunit.client.1.smithi135.stderr: 64650K .......... .......... .......... .......... .......... 38% 670K 3m41s 2023-11-18T19:10:32.463 INFO:tasks.workunit.client.1.smithi135.stderr: 64700K .......... .......... .......... .......... .......... 38% 334K 3m41s 2023-11-18T19:10:32.487 INFO:tasks.workunit.client.1.smithi135.stderr: 64750K .......... .......... .......... .......... .......... 38% 2.05M 3m41s 2023-11-18T19:10:32.618 INFO:tasks.workunit.client.1.smithi135.stderr: 64800K .......... .......... .......... .......... .......... 38% 382K 3m41s 2023-11-18T19:10:32.721 INFO:tasks.workunit.client.1.smithi135.stderr: 64850K .......... .......... .......... .......... .......... 38% 481K 3m41s 2023-11-18T19:10:32.818 INFO:tasks.workunit.client.1.smithi135.stderr: 64900K .......... .......... .......... .......... .......... 38% 516K 3m41s 2023-11-18T19:10:32.928 INFO:tasks.workunit.client.1.smithi135.stderr: 64950K .......... .......... .......... .......... .......... 38% 457K 3m41s 2023-11-18T19:10:33.014 INFO:tasks.workunit.client.1.smithi135.stderr: 65000K .......... .......... .......... .......... .......... 38% 583K 3m40s 2023-11-18T19:10:33.093 INFO:tasks.workunit.client.1.smithi135.stderr: 65050K .......... .......... .......... .......... .......... 38% 631K 3m40s 2023-11-18T19:10:33.188 INFO:tasks.workunit.client.1.smithi135.stderr: 65100K .......... .......... .......... .......... .......... 38% 524K 3m40s 2023-11-18T19:10:33.272 INFO:tasks.workunit.client.1.smithi135.stderr: 65150K .......... .......... .......... .......... .......... 38% 596K 3m40s 2023-11-18T19:10:33.358 INFO:tasks.workunit.client.1.smithi135.stderr: 65200K .......... .......... .......... .......... .......... 38% 579K 3m40s 2023-11-18T19:10:33.445 INFO:tasks.workunit.client.1.smithi135.stderr: 65250K .......... .......... .......... .......... .......... 38% 576K 3m40s 2023-11-18T19:10:33.535 INFO:tasks.workunit.client.1.smithi135.stderr: 65300K .......... .......... .......... .......... .......... 38% 554K 3m40s 2023-11-18T19:10:33.602 INFO:tasks.workunit.client.1.smithi135.stderr: 65350K .......... .......... .......... .......... .......... 38% 753K 3m39s 2023-11-18T19:10:33.677 INFO:tasks.workunit.client.1.smithi135.stderr: 65400K .......... .......... .......... .......... .......... 38% 669K 3m39s 2023-11-18T19:10:33.736 INFO:tasks.workunit.client.1.smithi135.stderr: 65450K .......... .......... .......... .......... .......... 38% 849K 3m39s 2023-11-18T19:10:33.795 INFO:tasks.workunit.client.1.smithi135.stderr: 65500K .......... .......... .......... .......... .......... 38% 833K 3m39s 2023-11-18T19:10:33.874 INFO:tasks.workunit.client.1.smithi135.stderr: 65550K .......... .......... .......... .......... .......... 38% 633K 3m39s 2023-11-18T19:10:33.951 INFO:tasks.workunit.client.1.smithi135.stderr: 65600K .......... .......... .......... .......... .......... 38% 673K 3m39s 2023-11-18T19:10:34.041 INFO:tasks.workunit.client.1.smithi135.stderr: 65650K .......... .......... .......... .......... .......... 38% 542K 3m39s 2023-11-18T19:10:34.129 INFO:tasks.workunit.client.1.smithi135.stderr: 65700K .......... .......... .......... .......... .......... 39% 569K 3m38s 2023-11-18T19:10:34.214 INFO:tasks.workunit.client.1.smithi135.stderr: 65750K .......... .......... .......... .......... .......... 39% 588K 3m38s 2023-11-18T19:10:34.284 INFO:tasks.workunit.client.1.smithi135.stderr: 65800K .......... .......... .......... .......... .......... 39% 713K 3m38s 2023-11-18T19:10:34.366 INFO:tasks.workunit.client.1.smithi135.stderr: 65850K .......... .......... .......... .......... .......... 39% 607K 3m38s 2023-11-18T19:10:34.410 INFO:tasks.workunit.client.1.smithi135.stderr: 65900K .......... .......... .......... .......... .......... 39% 1.11M 3m38s 2023-11-18T19:10:34.573 INFO:tasks.workunit.client.1.smithi135.stderr: 65950K .......... .......... .......... .......... .......... 39% 310K 3m38s 2023-11-18T19:10:34.627 INFO:tasks.workunit.client.1.smithi135.stderr: 66000K .......... .......... .......... .......... .......... 39% 911K 3m38s 2023-11-18T19:10:34.729 INFO:tasks.workunit.client.1.smithi135.stderr: 66050K .......... .......... .......... .......... .......... 39% 517K 3m37s 2023-11-18T19:10:34.814 INFO:tasks.workunit.client.1.smithi135.stderr: 66100K .......... .......... .......... .......... .......... 39% 553K 3m37s 2023-11-18T19:10:34.894 INFO:tasks.workunit.client.1.smithi135.stderr: 66150K .......... .......... .......... .......... .......... 39% 644K 3m37s 2023-11-18T19:10:34.978 INFO:tasks.workunit.client.1.smithi135.stderr: 66200K .......... .......... .......... .......... .......... 39% 580K 3m37s 2023-11-18T19:10:35.070 INFO:tasks.workunit.client.1.smithi135.stderr: 66250K .......... .......... .......... .......... .......... 39% 539K 3m37s 2023-11-18T19:10:35.082 INFO:tasks.workunit.client.0.smithi045.stdout: 23 9422 34 5909 33 3949 67 2023-11-18T19:10:35.160 INFO:tasks.workunit.client.1.smithi135.stderr: 66300K .......... .......... .......... .......... .......... 39% 554K 3m37s 2023-11-18T19:10:35.251 INFO:tasks.workunit.client.1.smithi135.stderr: 66350K .......... .......... .......... .......... .......... 39% 550K 3m37s 2023-11-18T19:10:35.337 INFO:tasks.workunit.client.1.smithi135.stderr: 66400K .......... .......... .......... .......... .......... 39% 587K 3m36s 2023-11-18T19:10:35.423 INFO:tasks.workunit.client.1.smithi135.stderr: 66450K .......... .......... .......... .......... .......... 39% 577K 3m36s 2023-11-18T19:10:35.509 INFO:tasks.workunit.client.1.smithi135.stderr: 66500K .......... .......... .......... .......... .......... 39% 594K 3m36s 2023-11-18T19:10:35.598 INFO:tasks.workunit.client.1.smithi135.stderr: 66550K .......... .......... .......... .......... .......... 39% 549K 3m36s 2023-11-18T19:10:35.691 INFO:tasks.workunit.client.1.smithi135.stderr: 66600K .......... .......... .......... .......... .......... 39% 548K 3m36s 2023-11-18T19:10:35.784 INFO:tasks.workunit.client.1.smithi135.stderr: 66650K .......... .......... .......... .......... .......... 39% 533K 3m36s 2023-11-18T19:10:35.868 INFO:tasks.workunit.client.1.smithi135.stderr: 66700K .......... .......... .......... .......... .......... 39% 589K 3m36s 2023-11-18T19:10:35.956 INFO:tasks.workunit.client.1.smithi135.stderr: 66750K .......... .......... .......... .......... .......... 39% 572K 3m36s 2023-11-18T19:10:35.997 INFO:tasks.workunit.client.1.smithi135.stderr: 66800K .......... .......... .......... .......... .......... 39% 1.18M 3m35s 2023-11-18T19:10:36.078 INFO:tasks.workunit.client.1.smithi135.stderr: 66850K .......... .......... .......... .......... .......... 39% 622K 3m35s 2023-11-18T19:10:36.154 INFO:tasks.workunit.client.1.smithi135.stderr: 66900K .......... .......... .......... .......... .......... 39% 655K 3m35s 2023-11-18T19:10:36.261 INFO:tasks.workunit.client.1.smithi135.stderr: 66950K .......... .......... .......... .......... .......... 39% 467K 3m35s 2023-11-18T19:10:36.361 INFO:tasks.workunit.client.1.smithi135.stderr: 67000K .......... .......... .......... .......... .......... 39% 511K 3m35s 2023-11-18T19:10:36.415 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:10:36.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:10:36.526 INFO:tasks.workunit.client.1.smithi135.stderr: 67050K .......... .......... .......... .......... .......... 39% 301K 3m35s 2023-11-18T19:10:36.531 INFO:tasks.workunit.client.1.smithi135.stderr: 67100K .......... .......... .......... .......... .......... 39% 7.50M 3m35s 2023-11-18T19:10:36.630 INFO:tasks.workunit.client.1.smithi135.stderr: 67150K .......... .......... .......... .......... .......... 39% 507K 3m34s 2023-11-18T19:10:36.718 INFO:tasks.workunit.client.1.smithi135.stderr: 67200K .......... .......... .......... .......... .......... 39% 568K 3m34s 2023-11-18T19:10:36.848 INFO:tasks.workunit.client.1.smithi135.stderr: 67250K .......... .......... .......... .......... .......... 39% 554K 3m34s 2023-11-18T19:10:36.974 INFO:tasks.workunit.client.1.smithi135.stderr: 67300K .......... .......... .......... .......... .......... 39% 305K 3m34s 2023-11-18T19:10:37.059 INFO:tasks.workunit.client.1.smithi135.stderr: 67350K .......... .......... .......... .......... .......... 39% 582K 3m34s 2023-11-18T19:10:37.138 INFO:tasks.workunit.client.1.smithi135.stderr: 67400K .......... .......... .......... .......... .......... 40% 649K 3m34s 2023-11-18T19:10:37.224 INFO:tasks.workunit.client.1.smithi135.stderr: 67450K .......... .......... .......... .......... .......... 40% 569K 3m34s 2023-11-18T19:10:37.306 INFO:tasks.workunit.client.1.smithi135.stderr: 67500K .......... .......... .......... .......... .......... 40% 634K 3m34s 2023-11-18T19:10:37.399 INFO:tasks.workunit.client.1.smithi135.stderr: 67550K .......... .......... .......... .......... .......... 40% 521K 3m33s 2023-11-18T19:10:37.490 INFO:tasks.workunit.client.1.smithi135.stderr: 67600K .......... .......... .......... .......... .......... 40% 546K 3m33s 2023-11-18T19:10:37.587 INFO:tasks.workunit.client.1.smithi135.stderr: 67650K .......... .......... .......... .......... .......... 40% 519K 3m33s 2023-11-18T19:10:37.665 INFO:tasks.workunit.client.1.smithi135.stderr: 67700K .......... .......... .......... .......... .......... 40% 636K 3m33s 2023-11-18T19:10:37.746 INFO:tasks.workunit.client.1.smithi135.stderr: 67750K .......... .......... .......... .......... .......... 40% 615K 3m33s 2023-11-18T19:10:37.826 INFO:tasks.workunit.client.1.smithi135.stderr: 67800K .......... .......... .......... .......... .......... 40% 629K 3m33s 2023-11-18T19:10:37.917 INFO:tasks.workunit.client.1.smithi135.stderr: 67850K .......... .......... .......... .......... .......... 40% 558K 3m33s 2023-11-18T19:10:38.003 INFO:tasks.workunit.client.1.smithi135.stderr: 67900K .......... .......... .......... .......... .......... 40% 572K 3m33s 2023-11-18T19:10:38.092 INFO:tasks.workunit.client.1.smithi135.stderr: 67950K .......... .......... .......... .......... .......... 40% 570K 3m32s 2023-11-18T19:10:38.179 INFO:tasks.workunit.client.1.smithi135.stderr: 68000K .......... .......... .......... .......... .......... 40% 561K 3m32s 2023-11-18T19:10:38.266 INFO:tasks.workunit.client.1.smithi135.stderr: 68050K .......... .......... .......... .......... .......... 40% 580K 3m32s 2023-11-18T19:10:38.353 INFO:tasks.workunit.client.1.smithi135.stderr: 68100K .......... .......... .......... .......... .......... 40% 571K 3m32s 2023-11-18T19:10:38.436 INFO:tasks.workunit.client.1.smithi135.stderr: 68150K .......... .......... .......... .......... .......... 40% 607K 3m32s 2023-11-18T19:10:38.523 INFO:tasks.workunit.client.1.smithi135.stderr: 68200K .......... .......... .......... .......... .......... 40% 590K 3m32s 2023-11-18T19:10:38.601 INFO:tasks.workunit.client.1.smithi135.stderr: 68250K .......... .......... .......... .......... .......... 40% 617K 3m32s 2023-11-18T19:10:38.692 INFO:tasks.workunit.client.1.smithi135.stderr: 68300K .......... .......... .......... .......... .......... 40% 626K 3m31s 2023-11-18T19:10:38.749 INFO:tasks.workunit.client.1.smithi135.stderr: 68350K .......... .......... .......... .......... .......... 40% 739K 3m31s 2023-11-18T19:10:38.829 INFO:tasks.workunit.client.1.smithi135.stderr: 68400K .......... .......... .......... .......... .......... 40% 1.03M 3m31s 2023-11-18T19:10:38.880 INFO:tasks.workunit.client.1.smithi135.stderr: 68450K .......... .......... .......... .......... .......... 40% 595K 3m31s 2023-11-18T19:10:38.961 INFO:tasks.workunit.client.1.smithi135.stderr: 68500K .......... .......... .......... .......... .......... 40% 620K 3m31s 2023-11-18T19:10:39.042 INFO:tasks.workunit.client.1.smithi135.stderr: 68550K .......... .......... .......... .......... .......... 40% 673K 3m31s 2023-11-18T19:10:39.180 INFO:tasks.workunit.client.1.smithi135.stderr: 68600K .......... .......... .......... .......... .......... 40% 347K 3m31s 2023-11-18T19:10:39.221 INFO:tasks.workunit.client.1.smithi135.stderr: 68650K .......... .......... .......... .......... .......... 40% 1.23M 3m30s 2023-11-18T19:10:39.329 INFO:tasks.workunit.client.1.smithi135.stderr: 68700K .......... .......... .......... .......... .......... 40% 456K 3m30s 2023-11-18T19:10:39.418 INFO:tasks.workunit.client.1.smithi135.stderr: 68750K .......... .......... .......... .......... .......... 40% 562K 3m30s 2023-11-18T19:10:39.502 INFO:tasks.workunit.client.1.smithi135.stderr: 68800K .......... .......... .......... .......... .......... 40% 591K 3m30s 2023-11-18T19:10:39.603 INFO:tasks.workunit.client.1.smithi135.stderr: 68850K .......... .......... .......... .......... .......... 40% 607K 3m30s 2023-11-18T19:10:39.696 INFO:tasks.workunit.client.1.smithi135.stderr: 68900K .......... .......... .......... .......... .......... 40% 451K 3m30s 2023-11-18T19:10:39.781 INFO:tasks.workunit.client.1.smithi135.stderr: 68950K .......... .......... .......... .......... .......... 40% 583K 3m30s 2023-11-18T19:10:39.869 INFO:tasks.workunit.client.1.smithi135.stderr: 69000K .......... .......... .......... .......... .......... 40% 714K 3m30s 2023-11-18T19:10:39.931 INFO:tasks.workunit.client.1.smithi135.stderr: 69050K .......... .......... .......... .......... .......... 40% 625K 3m29s 2023-11-18T19:10:40.016 INFO:tasks.workunit.client.1.smithi135.stderr: 69100K .......... .......... .......... .......... .......... 41% 593K 3m29s 2023-11-18T19:10:40.097 INFO:tasks.workunit.client.1.smithi135.stderr: 69150K .......... .......... .......... .......... .......... 41% 617K 3m29s 2023-11-18T19:10:40.186 INFO:tasks.workunit.client.1.smithi135.stderr: 69200K .......... .......... .......... .......... .......... 41% 562K 3m29s 2023-11-18T19:10:40.276 INFO:tasks.workunit.client.1.smithi135.stderr: 69250K .......... .......... .......... .......... .......... 41% 556K 3m29s 2023-11-18T19:10:40.347 INFO:tasks.workunit.client.1.smithi135.stderr: 69300K .......... .......... .......... .......... .......... 41% 704K 3m29s 2023-11-18T19:10:40.397 INFO:tasks.workunit.client.1.smithi135.stderr: 69350K .......... .......... .......... .......... .......... 41% 983K 3m29s 2023-11-18T19:10:40.481 INFO:tasks.workunit.client.1.smithi135.stderr: 69400K .......... .......... .......... .......... .......... 41% 598K 3m28s 2023-11-18T19:10:40.564 INFO:tasks.workunit.client.1.smithi135.stderr: 69450K .......... .......... .......... .......... .......... 41% 602K 3m28s 2023-11-18T19:10:40.645 INFO:tasks.workunit.client.1.smithi135.stderr: 69500K .......... .......... .......... .......... .......... 41% 622K 3m28s 2023-11-18T19:10:40.720 INFO:tasks.workunit.client.1.smithi135.stderr: 69550K .......... .......... .......... .......... .......... 41% 670K 3m28s 2023-11-18T19:10:40.875 INFO:tasks.workunit.client.1.smithi135.stderr: 69600K .......... .......... .......... .......... .......... 41% 321K 3m28s 2023-11-18T19:10:40.924 INFO:tasks.workunit.client.1.smithi135.stderr: 69650K .......... .......... .......... .......... .......... 41% 1.01M 3m28s 2023-11-18T19:10:41.013 INFO:tasks.workunit.client.1.smithi135.stderr: 69700K .......... .......... .......... .......... .......... 41% 556K 3m28s 2023-11-18T19:10:41.096 INFO:tasks.workunit.client.1.smithi135.stderr: 69750K .......... .......... .......... .......... .......... 41% 608K 3m27s 2023-11-18T19:10:41.205 INFO:tasks.workunit.client.1.smithi135.stderr: 69800K .......... .......... .......... .......... .......... 41% 457K 3m27s 2023-11-18T19:10:41.296 INFO:tasks.workunit.client.1.smithi135.stderr: 69850K .......... .......... .......... .......... .......... 41% 547K 3m27s 2023-11-18T19:10:41.407 INFO:tasks.workunit.client.1.smithi135.stderr: 69900K .......... .......... .......... .......... .......... 41% 462K 3m27s 2023-11-18T19:10:41.523 INFO:tasks.workunit.client.1.smithi135.stderr: 69950K .......... .......... .......... .......... .......... 41% 420K 3m27s 2023-11-18T19:10:41.610 INFO:tasks.workunit.client.1.smithi135.stderr: 70000K .......... .......... .......... .......... .......... 41% 594K 3m27s 2023-11-18T19:10:41.677 INFO:tasks.workunit.client.1.smithi135.stderr: 70050K .......... .......... .......... .......... .......... 41% 717K 3m27s 2023-11-18T19:10:41.749 INFO:tasks.workunit.client.1.smithi135.stderr: 70100K .......... .......... .......... .......... .......... 41% 716K 3m27s 2023-11-18T19:10:41.818 INFO:tasks.workunit.client.1.smithi135.stderr: 70150K .......... .......... .......... .......... .......... 41% 701K 3m26s 2023-11-18T19:10:41.898 INFO:tasks.workunit.client.1.smithi135.stderr: 70200K .......... .......... .......... .......... .......... 41% 632K 3m26s 2023-11-18T19:10:41.977 INFO:tasks.workunit.client.1.smithi135.stderr: 70250K .......... .......... .......... .......... .......... 41% 630K 3m26s 2023-11-18T19:10:42.053 INFO:tasks.workunit.client.1.smithi135.stderr: 70300K .......... .......... .......... .......... .......... 41% 653K 3m26s 2023-11-18T19:10:42.139 INFO:tasks.workunit.client.1.smithi135.stderr: 70350K .......... .......... .......... .......... .......... 41% 588K 3m26s 2023-11-18T19:10:42.217 INFO:tasks.workunit.client.1.smithi135.stderr: 70400K .......... .......... .......... .......... .......... 41% 641K 3m26s 2023-11-18T19:10:42.299 INFO:tasks.workunit.client.1.smithi135.stderr: 70450K .......... .......... .......... .......... .......... 41% 605K 3m26s 2023-11-18T19:10:42.380 INFO:tasks.workunit.client.1.smithi135.stderr: 70500K .......... .......... .......... .......... .......... 41% 616K 3m25s 2023-11-18T19:10:42.467 INFO:tasks.workunit.client.1.smithi135.stderr: 70550K .......... .......... .......... .......... .......... 41% 579K 3m25s 2023-11-18T19:10:42.551 INFO:tasks.workunit.client.1.smithi135.stderr: 70600K .......... .......... .......... .......... .......... 41% 590K 3m25s 2023-11-18T19:10:42.636 INFO:tasks.workunit.client.1.smithi135.stderr: 70650K .......... .......... .......... .......... .......... 41% 626K 3m25s 2023-11-18T19:10:42.721 INFO:tasks.workunit.client.1.smithi135.stderr: 70700K .......... .......... .......... .......... .......... 41% 563K 3m25s 2023-11-18T19:10:42.805 INFO:tasks.workunit.client.1.smithi135.stderr: 70750K .......... .......... .......... .......... .......... 42% 591K 3m25s 2023-11-18T19:10:42.897 INFO:tasks.workunit.client.1.smithi135.stderr: 70800K .......... .......... .......... .......... .......... 42% 644K 3m25s 2023-11-18T19:10:42.943 INFO:tasks.workunit.client.1.smithi135.stderr: 70850K .......... .......... .......... .......... .......... 42% 822K 3m25s 2023-11-18T19:10:43.031 INFO:tasks.workunit.client.1.smithi135.stderr: 70900K .......... .......... .......... .......... .......... 42% 648K 3m24s 2023-11-18T19:10:43.112 INFO:tasks.workunit.client.1.smithi135.stderr: 70950K .......... .......... .......... .......... .......... 42% 549K 3m24s 2023-11-18T19:10:43.186 INFO:tasks.workunit.client.1.smithi135.stderr: 71000K .......... .......... .......... .......... .......... 42% 680K 3m24s 2023-11-18T19:10:43.275 INFO:tasks.workunit.client.1.smithi135.stderr: 71050K .......... .......... .......... .......... .......... 42% 556K 3m24s 2023-11-18T19:10:43.359 INFO:tasks.workunit.client.1.smithi135.stderr: 71100K .......... .......... .......... .......... .......... 42% 596K 3m24s 2023-11-18T19:10:43.446 INFO:tasks.workunit.client.1.smithi135.stderr: 71150K .......... .......... .......... .......... .......... 42% 574K 3m24s 2023-11-18T19:10:43.488 INFO:tasks.workunit.client.1.smithi135.stderr: 71200K .......... .......... .......... .......... .......... 42% 1.15M 3m24s 2023-11-18T19:10:43.554 INFO:tasks.workunit.client.1.smithi135.stderr: 71250K .......... .......... .......... .......... .......... 42% 782K 3m23s 2023-11-18T19:10:43.629 INFO:tasks.workunit.client.1.smithi135.stderr: 71300K .......... .......... .......... .......... .......... 42% 656K 3m23s 2023-11-18T19:10:43.717 INFO:tasks.workunit.client.1.smithi135.stderr: 71350K .......... .......... .......... .......... .......... 42% 567K 3m23s 2023-11-18T19:10:43.802 INFO:tasks.workunit.client.1.smithi135.stderr: 71400K .......... .......... .......... .......... .......... 42% 587K 3m23s 2023-11-18T19:10:43.866 INFO:tasks.workunit.client.1.smithi135.stderr: 71450K .......... .......... .......... .......... .......... 42% 786K 3m23s 2023-11-18T19:10:43.917 INFO:tasks.workunit.client.1.smithi135.stderr: 71500K .......... .......... .......... .......... .......... 42% 975K 3m23s 2023-11-18T19:10:43.997 INFO:tasks.workunit.client.1.smithi135.stderr: 71550K .......... .......... .......... .......... .......... 42% 623K 3m22s 2023-11-18T19:10:44.077 INFO:tasks.workunit.client.1.smithi135.stderr: 71600K .......... .......... .......... .......... .......... 42% 629K 3m22s 2023-11-18T19:10:44.132 INFO:tasks.workunit.client.1.smithi135.stderr: 71650K .......... .......... .......... .......... .......... 42% 899K 3m22s 2023-11-18T19:10:44.203 INFO:tasks.workunit.client.1.smithi135.stderr: 71700K .......... .......... .......... .......... .......... 42% 844K 3m22s 2023-11-18T19:10:44.273 INFO:tasks.workunit.client.1.smithi135.stderr: 71750K .......... .......... .......... .......... .......... 42% 616K 3m22s 2023-11-18T19:10:44.351 INFO:tasks.workunit.client.1.smithi135.stderr: 71800K .......... .......... .......... .......... .......... 42% 658K 3m22s 2023-11-18T19:10:44.484 INFO:tasks.workunit.client.1.smithi135.stderr: 71850K .......... .......... .......... .......... .......... 42% 372K 3m22s 2023-11-18T19:10:44.488 INFO:tasks.workunit.client.1.smithi135.stderr: 71900K .......... .......... .......... .......... .......... 42% 37.2M 3m21s 2023-11-18T19:10:44.592 INFO:tasks.workunit.client.1.smithi135.stderr: 71950K .......... .......... .......... .......... .......... 42% 565K 3m21s 2023-11-18T19:10:44.676 INFO:tasks.workunit.client.1.smithi135.stderr: 72000K .......... .......... .......... .......... .......... 42% 483K 3m21s 2023-11-18T19:10:44.750 INFO:tasks.workunit.client.1.smithi135.stderr: 72050K .......... .......... .......... .......... .......... 42% 680K 3m21s 2023-11-18T19:10:44.837 INFO:tasks.workunit.client.1.smithi135.stderr: 72100K .......... .......... .......... .......... .......... 42% 576K 3m21s 2023-11-18T19:10:44.925 INFO:tasks.workunit.client.1.smithi135.stderr: 72150K .......... .......... .......... .......... .......... 42% 569K 3m21s 2023-11-18T19:10:45.016 INFO:tasks.workunit.client.1.smithi135.stderr: 72200K .......... .......... .......... .......... .......... 42% 617K 3m21s 2023-11-18T19:10:45.082 INFO:tasks.workunit.client.0.smithi045.stdout: 23 10296 37 5965 28 3898 72 2023-11-18T19:10:45.095 INFO:tasks.workunit.client.1.smithi135.stderr: 72250K .......... .......... .......... .......... .......... 42% 563K 3m21s 2023-11-18T19:10:45.180 INFO:tasks.workunit.client.1.smithi135.stderr: 72300K .......... .......... .......... .......... .......... 42% 588K 3m20s 2023-11-18T19:10:45.248 INFO:tasks.workunit.client.1.smithi135.stderr: 72350K .......... .......... .......... .......... .......... 42% 732K 3m20s 2023-11-18T19:10:45.333 INFO:tasks.workunit.client.1.smithi135.stderr: 72400K .......... .......... .......... .......... .......... 42% 610K 3m20s 2023-11-18T19:10:45.413 INFO:tasks.workunit.client.1.smithi135.stderr: 72450K .......... .......... .......... .......... .......... 43% 597K 3m20s 2023-11-18T19:10:45.470 INFO:tasks.workunit.client.1.smithi135.stderr: 72500K .......... .......... .......... .......... .......... 43% 884K 3m20s 2023-11-18T19:10:45.704 INFO:tasks.workunit.client.1.smithi135.stderr: 72550K .......... .......... .......... .......... .......... 43% 214K 3m20s 2023-11-18T19:10:45.794 INFO:tasks.workunit.client.1.smithi135.stderr: 72600K .......... .......... .......... .......... .......... 43% 556K 3m20s 2023-11-18T19:10:45.886 INFO:tasks.workunit.client.1.smithi135.stderr: 72650K .......... .......... .......... .......... .......... 43% 541K 3m20s 2023-11-18T19:10:46.073 INFO:tasks.workunit.client.1.smithi135.stderr: 72700K .......... .......... .......... .......... .......... 43% 268K 3m20s 2023-11-18T19:10:46.074 INFO:tasks.workunit.client.1.smithi135.stderr: 72750K .......... .......... .......... .......... .......... 43% 42.8M 3m19s 2023-11-18T19:10:46.167 INFO:tasks.workunit.client.1.smithi135.stderr: 72800K .......... .......... .......... .......... .......... 43% 547K 3m19s 2023-11-18T19:10:46.254 INFO:tasks.workunit.client.1.smithi135.stderr: 72850K .......... .......... .......... .......... .......... 43% 562K 3m19s 2023-11-18T19:10:46.345 INFO:tasks.workunit.client.1.smithi135.stderr: 72900K .......... .......... .......... .......... .......... 43% 549K 3m19s 2023-11-18T19:10:46.435 INFO:tasks.workunit.client.1.smithi135.stderr: 72950K .......... .......... .......... .......... .......... 43% 555K 3m19s 2023-11-18T19:10:46.527 INFO:tasks.workunit.client.1.smithi135.stderr: 73000K .......... .......... .......... .......... .......... 43% 547K 3m19s 2023-11-18T19:10:46.620 INFO:tasks.workunit.client.1.smithi135.stderr: 73050K .......... .......... .......... .......... .......... 43% 535K 3m19s 2023-11-18T19:10:46.720 INFO:tasks.workunit.client.1.smithi135.stderr: 73100K .......... .......... .......... .......... .......... 43% 500K 3m19s 2023-11-18T19:10:46.811 INFO:tasks.workunit.client.1.smithi135.stderr: 73150K .......... .......... .......... .......... .......... 43% 547K 3m18s 2023-11-18T19:10:46.901 INFO:tasks.workunit.client.1.smithi135.stderr: 73200K .......... .......... .......... .......... .......... 43% 560K 3m18s 2023-11-18T19:10:46.987 INFO:tasks.workunit.client.1.smithi135.stderr: 73250K .......... .......... .......... .......... .......... 43% 575K 3m18s 2023-11-18T19:10:47.076 INFO:tasks.workunit.client.1.smithi135.stderr: 73300K .......... .......... .......... .......... .......... 43% 569K 3m18s 2023-11-18T19:10:47.166 INFO:tasks.workunit.client.1.smithi135.stderr: 73350K .......... .......... .......... .......... .......... 43% 549K 3m18s 2023-11-18T19:10:47.260 INFO:tasks.workunit.client.1.smithi135.stderr: 73400K .......... .......... .......... .......... .......... 43% 535K 3m18s 2023-11-18T19:10:47.352 INFO:tasks.workunit.client.1.smithi135.stderr: 73450K .......... .......... .......... .......... .......... 43% 547K 3m18s 2023-11-18T19:10:47.445 INFO:tasks.workunit.client.1.smithi135.stderr: 73500K .......... .......... .......... .......... .......... 43% 535K 3m18s 2023-11-18T19:10:47.670 INFO:tasks.workunit.client.1.smithi135.stderr: 73550K .......... .......... .......... .......... .......... 43% 223K 3m18s 2023-11-18T19:10:47.670 INFO:tasks.workunit.client.1.smithi135.stderr: 73600K .......... .......... .......... .......... .......... 43% 79.4M 3m17s 2023-11-18T19:10:47.757 INFO:tasks.workunit.client.1.smithi135.stderr: 73650K .......... .......... .......... .......... .......... 43% 575K 3m17s 2023-11-18T19:10:47.902 INFO:tasks.workunit.client.1.smithi135.stderr: 73700K .......... .......... .......... .......... .......... 43% 382K 3m17s 2023-11-18T19:10:47.997 INFO:tasks.workunit.client.1.smithi135.stderr: 73750K .......... .......... .......... .......... .......... 43% 458K 3m17s 2023-11-18T19:10:48.089 INFO:tasks.workunit.client.1.smithi135.stderr: 73800K .......... .......... .......... .......... .......... 43% 541K 3m17s 2023-11-18T19:10:48.188 INFO:tasks.workunit.client.1.smithi135.stderr: 73850K .......... .......... .......... .......... .......... 43% 510K 3m17s 2023-11-18T19:10:48.303 INFO:tasks.workunit.client.1.smithi135.stderr: 73900K .......... .......... .......... .......... .......... 43% 532K 3m17s 2023-11-18T19:10:48.436 INFO:tasks.workunit.client.1.smithi135.stderr: 73950K .......... .......... .......... .......... .......... 43% 325K 3m17s 2023-11-18T19:10:48.527 INFO:tasks.workunit.client.1.smithi135.stderr: 74000K .......... .......... .......... .......... .......... 43% 547K 3m17s 2023-11-18T19:10:48.614 INFO:tasks.workunit.client.1.smithi135.stderr: 74050K .......... .......... .......... .......... .......... 43% 572K 3m16s 2023-11-18T19:10:48.708 INFO:tasks.workunit.client.1.smithi135.stderr: 74100K .......... .......... .......... .......... .......... 43% 547K 3m16s 2023-11-18T19:10:48.803 INFO:tasks.workunit.client.1.smithi135.stderr: 74150K .......... .......... .......... .......... .......... 44% 519K 3m16s 2023-11-18T19:10:48.895 INFO:tasks.workunit.client.1.smithi135.stderr: 74200K .......... .......... .......... .......... .......... 44% 550K 3m16s 2023-11-18T19:10:49.075 INFO:tasks.workunit.client.1.smithi135.stderr: 74250K .......... .......... .......... .......... .......... 44% 276K 3m16s 2023-11-18T19:10:49.080 INFO:tasks.workunit.client.1.smithi135.stderr: 74300K .......... .......... .......... .......... .......... 44% 9.81M 3m16s 2023-11-18T19:10:49.192 INFO:tasks.workunit.client.1.smithi135.stderr: 74350K .......... .......... .......... .......... .......... 44% 445K 3m16s 2023-11-18T19:10:49.329 INFO:tasks.workunit.client.1.smithi135.stderr: 74400K .......... .......... .......... .......... .......... 44% 369K 3m16s 2023-11-18T19:10:49.428 INFO:tasks.workunit.client.1.smithi135.stderr: 74450K .......... .......... .......... .......... .......... 44% 524K 3m16s 2023-11-18T19:10:49.553 INFO:tasks.workunit.client.1.smithi135.stderr: 74500K .......... .......... .......... .......... .......... 44% 386K 3m16s 2023-11-18T19:10:49.695 INFO:tasks.workunit.client.1.smithi135.stderr: 74550K .......... .......... .......... .......... .......... 44% 492K 3m15s 2023-11-18T19:10:49.801 INFO:tasks.workunit.client.1.smithi135.stderr: 74600K .......... .......... .......... .......... .......... 44% 340K 3m15s 2023-11-18T19:10:49.912 INFO:tasks.workunit.client.1.smithi135.stderr: 74650K .......... .......... .......... .......... .......... 44% 495K 3m15s 2023-11-18T19:10:50.009 INFO:tasks.workunit.client.1.smithi135.stderr: 74700K .......... .......... .......... .......... .......... 44% 466K 3m15s 2023-11-18T19:10:50.118 INFO:tasks.workunit.client.1.smithi135.stderr: 74750K .......... .......... .......... .......... .......... 44% 461K 3m15s 2023-11-18T19:10:50.272 INFO:tasks.workunit.client.1.smithi135.stderr: 74800K .......... .......... .......... .......... .......... 44% 337K 3m15s 2023-11-18T19:10:50.376 INFO:tasks.workunit.client.1.smithi135.stderr: 74850K .......... .......... .......... .......... .......... 44% 457K 3m15s 2023-11-18T19:10:50.484 INFO:tasks.workunit.client.1.smithi135.stderr: 74900K .......... .......... .......... .......... .......... 44% 520K 3m15s 2023-11-18T19:10:50.596 INFO:tasks.workunit.client.1.smithi135.stderr: 74950K .......... .......... .......... .......... .......... 44% 401K 3m15s 2023-11-18T19:10:50.718 INFO:tasks.workunit.client.1.smithi135.stderr: 75000K .......... .......... .......... .......... .......... 44% 412K 3m15s 2023-11-18T19:10:50.839 INFO:tasks.workunit.client.1.smithi135.stderr: 75050K .......... .......... .......... .......... .......... 44% 411K 3m15s 2023-11-18T19:10:50.957 INFO:tasks.workunit.client.1.smithi135.stderr: 75100K .......... .......... .......... .......... .......... 44% 424K 3m15s 2023-11-18T19:10:51.073 INFO:tasks.workunit.client.1.smithi135.stderr: 75150K .......... .......... .......... .......... .......... 44% 432K 3m14s 2023-11-18T19:10:51.178 INFO:tasks.workunit.client.1.smithi135.stderr: 75200K .......... .......... .......... .......... .......... 44% 478K 3m14s 2023-11-18T19:10:51.277 INFO:tasks.workunit.client.1.smithi135.stderr: 75250K .......... .......... .......... .......... .......... 44% 504K 3m14s 2023-11-18T19:10:51.372 INFO:tasks.workunit.client.1.smithi135.stderr: 75300K .......... .......... .......... .......... .......... 44% 522K 3m14s 2023-11-18T19:10:51.454 INFO:tasks.workunit.client.1.smithi135.stderr: 75350K .......... .......... .......... .......... .......... 44% 610K 3m14s 2023-11-18T19:10:51.544 INFO:tasks.workunit.client.1.smithi135.stderr: 75400K .......... .......... .......... .......... .......... 44% 557K 3m14s 2023-11-18T19:10:51.627 INFO:tasks.workunit.client.1.smithi135.stderr: 75450K .......... .......... .......... .......... .......... 44% 612K 3m14s 2023-11-18T19:10:51.713 INFO:tasks.workunit.client.1.smithi135.stderr: 75500K .......... .......... .......... .......... .......... 44% 573K 3m14s 2023-11-18T19:10:51.828 INFO:tasks.workunit.client.1.smithi135.stderr: 75550K .......... .......... .......... .......... .......... 44% 435K 3m13s 2023-11-18T19:10:51.944 INFO:tasks.workunit.client.1.smithi135.stderr: 75600K .......... .......... .......... .......... .......... 44% 431K 3m13s 2023-11-18T19:10:52.045 INFO:tasks.workunit.client.1.smithi135.stderr: 75650K .......... .......... .......... .......... .......... 44% 495K 3m13s 2023-11-18T19:10:52.141 INFO:tasks.workunit.client.1.smithi135.stderr: 75700K .......... .......... .......... .......... .......... 44% 584K 3m13s 2023-11-18T19:10:52.195 INFO:tasks.workunit.client.1.smithi135.stderr: 75750K .......... .......... .......... .......... .......... 44% 775K 3m13s 2023-11-18T19:10:52.387 INFO:tasks.workunit.client.1.smithi135.stderr: 75800K .......... .......... .......... .......... .......... 44% 262K 3m13s 2023-11-18T19:10:52.524 INFO:tasks.workunit.client.1.smithi135.stderr: 75850K .......... .......... .......... .......... .......... 45% 363K 3m13s 2023-11-18T19:10:52.540 INFO:tasks.workunit.client.1.smithi135.stderr: 75900K .......... .......... .......... .......... .......... 45% 2.97M 3m13s 2023-11-18T19:10:52.714 INFO:tasks.workunit.client.1.smithi135.stderr: 75950K .......... .......... .......... .......... .......... 45% 289K 3m13s 2023-11-18T19:10:52.860 INFO:tasks.workunit.client.1.smithi135.stderr: 76000K .......... .......... .......... .......... .......... 45% 341K 3m13s 2023-11-18T19:10:53.005 INFO:tasks.workunit.client.1.smithi135.stderr: 76050K .......... .......... .......... .......... .......... 45% 345K 3m13s 2023-11-18T19:10:53.153 INFO:tasks.workunit.client.1.smithi135.stderr: 76100K .......... .......... .......... .......... .......... 45% 336K 3m13s 2023-11-18T19:10:53.310 INFO:tasks.workunit.client.1.smithi135.stderr: 76150K .......... .......... .......... .......... .......... 45% 321K 3m13s 2023-11-18T19:10:53.461 INFO:tasks.workunit.client.1.smithi135.stderr: 76200K .......... .......... .......... .......... .......... 45% 331K 3m12s 2023-11-18T19:10:53.610 INFO:tasks.workunit.client.1.smithi135.stderr: 76250K .......... .......... .......... .......... .......... 45% 334K 3m12s 2023-11-18T19:10:53.725 INFO:tasks.workunit.client.1.smithi135.stderr: 76300K .......... .......... .......... .......... .......... 45% 437K 3m12s 2023-11-18T19:10:53.830 INFO:tasks.workunit.client.1.smithi135.stderr: 76350K .......... .......... .......... .......... .......... 45% 473K 3m12s 2023-11-18T19:10:53.935 INFO:tasks.workunit.client.1.smithi135.stderr: 76400K .......... .......... .......... .......... .......... 45% 479K 3m12s 2023-11-18T19:10:54.049 INFO:tasks.workunit.client.1.smithi135.stderr: 76450K .......... .......... .......... .......... .......... 45% 438K 3m12s 2023-11-18T19:10:54.169 INFO:tasks.workunit.client.1.smithi135.stderr: 76500K .......... .......... .......... .......... .......... 45% 417K 3m12s 2023-11-18T19:10:54.271 INFO:tasks.workunit.client.1.smithi135.stderr: 76550K .......... .......... .......... .......... .......... 45% 487K 3m12s 2023-11-18T19:10:54.404 INFO:tasks.workunit.client.1.smithi135.stderr: 76600K .......... .......... .......... .......... .......... 45% 376K 3m12s 2023-11-18T19:10:54.508 INFO:tasks.workunit.client.1.smithi135.stderr: 76650K .......... .......... .......... .......... .......... 45% 483K 3m12s 2023-11-18T19:10:54.639 INFO:tasks.workunit.client.1.smithi135.stderr: 76700K .......... .......... .......... .......... .......... 45% 386K 3m12s 2023-11-18T19:10:54.829 INFO:tasks.workunit.client.1.smithi135.stderr: 76750K .......... .......... .......... .......... .......... 45% 261K 3m12s 2023-11-18T19:10:54.905 INFO:tasks.workunit.client.1.smithi135.stderr: 76800K .......... .......... .......... .......... .......... 45% 680K 3m11s 2023-11-18T19:10:55.070 INFO:tasks.workunit.client.1.smithi135.stderr: 76850K .......... .......... .......... .......... .......... 45% 430K 3m11s 2023-11-18T19:10:55.082 INFO:tasks.workunit.client.0.smithi045.stdout: 24 9584 71 5160 45 4510 111 2023-11-18T19:10:55.163 INFO:tasks.workunit.client.1.smithi135.stderr: 76900K .......... .......... .......... .......... .......... 45% 347K 3m11s 2023-11-18T19:10:55.266 INFO:tasks.workunit.client.1.smithi135.stderr: 76950K .......... .......... .......... .......... .......... 45% 482K 3m11s 2023-11-18T19:10:55.413 INFO:tasks.workunit.client.1.smithi135.stderr: 77000K .......... .......... .......... .......... .......... 45% 342K 3m11s 2023-11-18T19:10:55.542 INFO:tasks.workunit.client.1.smithi135.stderr: 77050K .......... .......... .......... .......... .......... 45% 388K 3m11s 2023-11-18T19:10:55.651 INFO:tasks.workunit.client.1.smithi135.stderr: 77100K .......... .......... .......... .......... .......... 45% 458K 3m11s 2023-11-18T19:10:55.817 INFO:tasks.workunit.client.1.smithi135.stderr: 77150K .......... .......... .......... .......... .......... 45% 301K 3m11s 2023-11-18T19:10:55.971 INFO:tasks.workunit.client.1.smithi135.stderr: 77200K .......... .......... .......... .......... .......... 45% 323K 3m11s 2023-11-18T19:10:56.094 INFO:tasks.workunit.client.1.smithi135.stderr: 77250K .......... .......... .......... .......... .......... 45% 413K 3m11s 2023-11-18T19:10:56.199 INFO:tasks.workunit.client.1.smithi135.stderr: 77300K .......... .......... .......... .......... .......... 45% 468K 3m11s 2023-11-18T19:10:56.373 INFO:tasks.workunit.client.1.smithi135.stderr: 77350K .......... .......... .......... .......... .......... 45% 288K 3m11s 2023-11-18T19:10:56.500 INFO:tasks.workunit.client.1.smithi135.stderr: 77400K .......... .......... .......... .......... .......... 45% 393K 3m11s 2023-11-18T19:10:56.641 INFO:tasks.workunit.client.1.smithi135.stderr: 77450K .......... .......... .......... .......... .......... 45% 356K 3m11s 2023-11-18T19:10:56.744 INFO:tasks.workunit.client.1.smithi135.stderr: 77500K .......... .......... .......... .......... .......... 46% 485K 3m10s 2023-11-18T19:10:56.832 INFO:tasks.workunit.client.1.smithi135.stderr: 77550K .......... .......... .......... .......... .......... 46% 564K 3m10s 2023-11-18T19:10:56.932 INFO:tasks.workunit.client.1.smithi135.stderr: 77600K .......... .......... .......... .......... .......... 46% 503K 3m10s 2023-11-18T19:10:57.083 INFO:tasks.workunit.client.1.smithi135.stderr: 77650K .......... .......... .......... .......... .......... 46% 331K 3m10s 2023-11-18T19:10:57.242 INFO:tasks.workunit.client.1.smithi135.stderr: 77700K .......... .......... .......... .......... .......... 46% 316K 3m10s 2023-11-18T19:10:57.344 INFO:tasks.workunit.client.1.smithi135.stderr: 77750K .......... .......... .......... .......... .......... 46% 486K 3m10s 2023-11-18T19:10:57.462 INFO:tasks.workunit.client.1.smithi135.stderr: 77800K .......... .......... .......... .......... .......... 46% 422K 3m10s 2023-11-18T19:10:57.619 INFO:tasks.workunit.client.1.smithi135.stderr: 77850K .......... .......... .......... .......... .......... 46% 318K 3m10s 2023-11-18T19:10:57.713 INFO:tasks.workunit.client.1.smithi135.stderr: 77900K .......... .......... .......... .......... .......... 46% 537K 3m10s 2023-11-18T19:10:57.936 INFO:tasks.workunit.client.1.smithi135.stderr: 77950K .......... .......... .......... .......... .......... 46% 224K 3m10s 2023-11-18T19:10:58.068 INFO:tasks.workunit.client.1.smithi135.stderr: 78000K .......... .......... .......... .......... .......... 46% 377K 3m10s 2023-11-18T19:10:58.258 INFO:tasks.workunit.client.1.smithi135.stderr: 78050K .......... .......... .......... .......... .......... 46% 330K 3m10s 2023-11-18T19:10:58.418 INFO:tasks.workunit.client.1.smithi135.stderr: 78100K .......... .......... .......... .......... .......... 46% 253K 3m10s 2023-11-18T19:10:58.537 INFO:tasks.workunit.client.1.smithi135.stderr: 78150K .......... .......... .......... .......... .......... 46% 423K 3m10s 2023-11-18T19:10:58.630 INFO:tasks.workunit.client.1.smithi135.stderr: 78200K .......... .......... .......... .......... .......... 46% 534K 3m9s 2023-11-18T19:10:58.795 INFO:tasks.workunit.client.1.smithi135.stderr: 78250K .......... .......... .......... .......... .......... 46% 303K 3m9s 2023-11-18T19:10:58.895 INFO:tasks.workunit.client.1.smithi135.stderr: 78300K .......... .......... .......... .......... .......... 46% 499K 3m9s 2023-11-18T19:10:58.999 INFO:tasks.workunit.client.1.smithi135.stderr: 78350K .......... .......... .......... .......... .......... 46% 482K 3m9s 2023-11-18T19:10:59.132 INFO:tasks.workunit.client.1.smithi135.stderr: 78400K .......... .......... .......... .......... .......... 46% 378K 3m9s 2023-11-18T19:10:59.243 INFO:tasks.workunit.client.1.smithi135.stderr: 78450K .......... .......... .......... .......... .......... 46% 445K 3m9s 2023-11-18T19:10:59.391 INFO:tasks.workunit.client.1.smithi135.stderr: 78500K .......... .......... .......... .......... .......... 46% 359K 3m9s 2023-11-18T19:10:59.504 INFO:tasks.workunit.client.1.smithi135.stderr: 78550K .......... .......... .......... .......... .......... 46% 415K 3m9s 2023-11-18T19:10:59.635 INFO:tasks.workunit.client.1.smithi135.stderr: 78600K .......... .......... .......... .......... .......... 46% 388K 3m9s 2023-11-18T19:10:59.739 INFO:tasks.workunit.client.1.smithi135.stderr: 78650K .......... .......... .......... .......... .......... 46% 468K 3m9s 2023-11-18T19:10:59.958 INFO:tasks.workunit.client.1.smithi135.stderr: 78700K .......... .......... .......... .......... .......... 46% 229K 3m9s 2023-11-18T19:11:00.028 INFO:tasks.workunit.client.1.smithi135.stderr: 78750K .......... .......... .......... .......... .......... 46% 710K 3m9s 2023-11-18T19:11:00.163 INFO:tasks.workunit.client.1.smithi135.stderr: 78800K .......... .......... .......... .......... .......... 46% 369K 3m9s 2023-11-18T19:11:00.298 INFO:tasks.workunit.client.1.smithi135.stderr: 78850K .......... .......... .......... .......... .......... 46% 372K 3m8s 2023-11-18T19:11:00.451 INFO:tasks.workunit.client.1.smithi135.stderr: 78900K .......... .......... .......... .......... .......... 46% 327K 3m8s 2023-11-18T19:11:00.567 INFO:tasks.workunit.client.1.smithi135.stderr: 78950K .......... .......... .......... .......... .......... 46% 466K 3m8s 2023-11-18T19:11:00.720 INFO:tasks.workunit.client.1.smithi135.stderr: 79000K .......... .......... .......... .......... .......... 46% 308K 3m8s 2023-11-18T19:11:00.829 INFO:tasks.workunit.client.1.smithi135.stderr: 79050K .......... .......... .......... .......... .......... 46% 463K 3m8s 2023-11-18T19:11:00.962 INFO:tasks.workunit.client.1.smithi135.stderr: 79100K .......... .......... .......... .......... .......... 46% 376K 3m8s 2023-11-18T19:11:01.153 INFO:tasks.workunit.client.1.smithi135.stderr: 79150K .......... .......... .......... .......... .......... 46% 261K 3m8s 2023-11-18T19:11:01.327 INFO:tasks.workunit.client.1.smithi135.stderr: 79200K .......... .......... .......... .......... .......... 47% 288K 3m8s 2023-11-18T19:11:01.458 INFO:tasks.workunit.client.1.smithi135.stderr: 79250K .......... .......... .......... .......... .......... 47% 379K 3m8s 2023-11-18T19:11:01.633 INFO:tasks.workunit.client.1.smithi135.stderr: 79300K .......... .......... .......... .......... .......... 47% 287K 3m8s 2023-11-18T19:11:01.771 INFO:tasks.workunit.client.1.smithi135.stderr: 79350K .......... .......... .......... .......... .......... 47% 360K 3m8s 2023-11-18T19:11:01.920 INFO:tasks.workunit.client.1.smithi135.stderr: 79400K .......... .......... .......... .......... .......... 47% 350K 3m8s 2023-11-18T19:11:02.056 INFO:tasks.workunit.client.1.smithi135.stderr: 79450K .......... .......... .......... .......... .......... 47% 353K 3m8s 2023-11-18T19:11:02.190 INFO:tasks.workunit.client.1.smithi135.stderr: 79500K .......... .......... .......... .......... .......... 47% 374K 3m8s 2023-11-18T19:11:02.309 INFO:tasks.workunit.client.1.smithi135.stderr: 79550K .......... .......... .......... .......... .......... 47% 420K 3m8s 2023-11-18T19:11:02.406 INFO:tasks.workunit.client.1.smithi135.stderr: 79600K .......... .......... .......... .......... .......... 47% 514K 3m7s 2023-11-18T19:11:02.527 INFO:tasks.workunit.client.1.smithi135.stderr: 79650K .......... .......... .......... .......... .......... 47% 414K 3m7s 2023-11-18T19:11:02.622 INFO:tasks.workunit.client.1.smithi135.stderr: 79700K .......... .......... .......... .......... .......... 47% 528K 3m7s 2023-11-18T19:11:02.751 INFO:tasks.workunit.client.1.smithi135.stderr: 79750K .......... .......... .......... .......... .......... 47% 414K 3m7s 2023-11-18T19:11:02.858 INFO:tasks.workunit.client.1.smithi135.stderr: 79800K .......... .......... .......... .......... .......... 47% 433K 3m7s 2023-11-18T19:11:02.961 INFO:tasks.workunit.client.1.smithi135.stderr: 79850K .......... .......... .......... .......... .......... 47% 484K 3m7s 2023-11-18T19:11:03.048 INFO:tasks.workunit.client.1.smithi135.stderr: 79900K .......... .......... .......... .......... .......... 47% 577K 3m7s 2023-11-18T19:11:03.163 INFO:tasks.workunit.client.1.smithi135.stderr: 79950K .......... .......... .......... .......... .......... 47% 441K 3m7s 2023-11-18T19:11:03.280 INFO:tasks.workunit.client.1.smithi135.stderr: 80000K .......... .......... .......... .......... .......... 47% 423K 3m7s 2023-11-18T19:11:03.389 INFO:tasks.workunit.client.1.smithi135.stderr: 80050K .......... .......... .......... .......... .......... 47% 459K 3m7s 2023-11-18T19:11:03.470 INFO:tasks.workunit.client.1.smithi135.stderr: 80100K .......... .......... .......... .......... .......... 47% 613K 3m6s 2023-11-18T19:11:03.556 INFO:tasks.workunit.client.1.smithi135.stderr: 80150K .......... .......... .......... .......... .......... 47% 582K 3m6s 2023-11-18T19:11:03.652 INFO:tasks.workunit.client.1.smithi135.stderr: 80200K .......... .......... .......... .......... .......... 47% 519K 3m6s 2023-11-18T19:11:03.750 INFO:tasks.workunit.client.1.smithi135.stderr: 80250K .......... .......... .......... .......... .......... 47% 513K 3m6s 2023-11-18T19:11:03.835 INFO:tasks.workunit.client.1.smithi135.stderr: 80300K .......... .......... .......... .......... .......... 47% 592K 3m6s 2023-11-18T19:11:04.003 INFO:tasks.workunit.client.1.smithi135.stderr: 80350K .......... .......... .......... .......... .......... 47% 298K 3m6s 2023-11-18T19:11:04.066 INFO:tasks.workunit.client.1.smithi135.stderr: 80400K .......... .......... .......... .......... .......... 47% 779K 3m6s 2023-11-18T19:11:04.203 INFO:tasks.workunit.client.1.smithi135.stderr: 80450K .......... .......... .......... .......... .......... 47% 368K 3m6s 2023-11-18T19:11:04.322 INFO:tasks.workunit.client.1.smithi135.stderr: 80500K .......... .......... .......... .......... .......... 47% 417K 3m6s 2023-11-18T19:11:04.426 INFO:tasks.workunit.client.1.smithi135.stderr: 80550K .......... .......... .......... .......... .......... 47% 480K 3m5s 2023-11-18T19:11:04.537 INFO:tasks.workunit.client.1.smithi135.stderr: 80600K .......... .......... .......... .......... .......... 47% 451K 3m5s 2023-11-18T19:11:04.664 INFO:tasks.workunit.client.1.smithi135.stderr: 80650K .......... .......... .......... .......... .......... 47% 397K 3m5s 2023-11-18T19:11:04.761 INFO:tasks.workunit.client.1.smithi135.stderr: 80700K .......... .......... .......... .......... .......... 47% 512K 3m5s 2023-11-18T19:11:04.846 INFO:tasks.workunit.client.1.smithi135.stderr: 80750K .......... .......... .......... .......... .......... 47% 589K 3m5s 2023-11-18T19:11:04.935 INFO:tasks.workunit.client.1.smithi135.stderr: 80800K .......... .......... .......... .......... .......... 47% 558K 3m5s 2023-11-18T19:11:05.041 INFO:tasks.workunit.client.1.smithi135.stderr: 80850K .......... .......... .......... .......... .......... 47% 477K 3m5s 2023-11-18T19:11:05.082 INFO:tasks.workunit.client.0.smithi045.stdout: 25 9949 55 5723 41 3740 111 2023-11-18T19:11:05.141 INFO:tasks.workunit.client.1.smithi135.stderr: 80900K .......... .......... .......... .......... .......... 48% 495K 3m5s 2023-11-18T19:11:05.233 INFO:tasks.workunit.client.1.smithi135.stderr: 80950K .......... .......... .......... .......... .......... 48% 541K 3m5s 2023-11-18T19:11:05.363 INFO:tasks.workunit.client.1.smithi135.stderr: 81000K .......... .......... .......... .......... .......... 48% 386K 3m5s 2023-11-18T19:11:05.458 INFO:tasks.workunit.client.1.smithi135.stderr: 81050K .......... .......... .......... .......... .......... 48% 527K 3m4s 2023-11-18T19:11:05.565 INFO:tasks.workunit.client.1.smithi135.stderr: 81100K .......... .......... .......... .......... .......... 48% 525K 3m4s 2023-11-18T19:11:05.735 INFO:tasks.workunit.client.1.smithi135.stderr: 81150K .......... .......... .......... .......... .......... 48% 276K 3m4s 2023-11-18T19:11:05.774 INFO:tasks.workunit.client.1.smithi135.stderr: 81200K .......... .......... .......... .......... .......... 48% 1.23M 3m4s 2023-11-18T19:11:05.902 INFO:tasks.workunit.client.1.smithi135.stderr: 81250K .......... .......... .......... .......... .......... 48% 391K 3m4s 2023-11-18T19:11:06.023 INFO:tasks.workunit.client.1.smithi135.stderr: 81300K .......... .......... .......... .......... .......... 48% 413K 3m4s 2023-11-18T19:11:06.152 INFO:tasks.workunit.client.1.smithi135.stderr: 81350K .......... .......... .......... .......... .......... 48% 389K 3m4s 2023-11-18T19:11:06.269 INFO:tasks.workunit.client.1.smithi135.stderr: 81400K .......... .......... .......... .......... .......... 48% 424K 3m4s 2023-11-18T19:11:06.386 INFO:tasks.workunit.client.1.smithi135.stderr: 81450K .......... .......... .......... .......... .......... 48% 431K 3m4s 2023-11-18T19:11:06.511 INFO:tasks.workunit.client.1.smithi135.stderr: 81500K .......... .......... .......... .......... .......... 48% 397K 3m4s 2023-11-18T19:11:06.646 INFO:tasks.workunit.client.1.smithi135.stderr: 81550K .......... .......... .......... .......... .......... 48% 397K 3m3s 2023-11-18T19:11:06.757 INFO:tasks.workunit.client.1.smithi135.stderr: 81600K .......... .......... .......... .......... .......... 48% 419K 3m3s 2023-11-18T19:11:06.875 INFO:tasks.workunit.client.1.smithi135.stderr: 81650K .......... .......... .......... .......... .......... 48% 422K 3m3s 2023-11-18T19:11:06.976 INFO:tasks.workunit.client.1.smithi135.stderr: 81700K .......... .......... .......... .......... .......... 48% 496K 3m3s 2023-11-18T19:11:07.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:11:07.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:11:07.094 INFO:tasks.workunit.client.1.smithi135.stderr: 81750K .......... .......... .......... .......... .......... 48% 461K 3m3s 2023-11-18T19:11:07.181 INFO:tasks.workunit.client.1.smithi135.stderr: 81800K .......... .......... .......... .......... .......... 48% 514K 3m3s 2023-11-18T19:11:07.271 INFO:tasks.workunit.client.1.smithi135.stderr: 81850K .......... .......... .......... .......... .......... 48% 559K 3m3s 2023-11-18T19:11:07.403 INFO:tasks.workunit.client.1.smithi135.stderr: 81900K .......... .......... .......... .......... .......... 48% 379K 3m3s 2023-11-18T19:11:07.492 INFO:tasks.workunit.client.1.smithi135.stderr: 81950K .......... .......... .......... .......... .......... 48% 564K 3m3s 2023-11-18T19:11:07.589 INFO:tasks.workunit.client.1.smithi135.stderr: 82000K .......... .......... .......... .......... .......... 48% 566K 3m3s 2023-11-18T19:11:07.683 INFO:tasks.workunit.client.1.smithi135.stderr: 82050K .......... .......... .......... .......... .......... 48% 484K 3m2s 2023-11-18T19:11:07.783 INFO:tasks.workunit.client.1.smithi135.stderr: 82100K .......... .......... .......... .......... .......... 48% 500K 3m2s 2023-11-18T19:11:07.877 INFO:tasks.workunit.client.1.smithi135.stderr: 82150K .......... .......... .......... .......... .......... 48% 532K 3m2s 2023-11-18T19:11:08.030 INFO:tasks.workunit.client.1.smithi135.stderr: 82200K .......... .......... .......... .......... .......... 48% 327K 3m2s 2023-11-18T19:11:08.134 INFO:tasks.workunit.client.1.smithi135.stderr: 82250K .......... .......... .......... .......... .......... 48% 482K 3m2s 2023-11-18T19:11:08.235 INFO:tasks.workunit.client.1.smithi135.stderr: 82300K .......... .......... .......... .......... .......... 48% 494K 3m2s 2023-11-18T19:11:08.373 INFO:tasks.workunit.client.1.smithi135.stderr: 82350K .......... .......... .......... .......... .......... 48% 369K 3m2s 2023-11-18T19:11:08.494 INFO:tasks.workunit.client.1.smithi135.stderr: 82400K .......... .......... .......... .......... .......... 48% 406K 3m2s 2023-11-18T19:11:08.598 INFO:tasks.workunit.client.1.smithi135.stderr: 82450K .......... .......... .......... .......... .......... 48% 522K 3m2s 2023-11-18T19:11:08.691 INFO:tasks.workunit.client.1.smithi135.stderr: 82500K .......... .......... .......... .......... .......... 48% 493K 3m2s 2023-11-18T19:11:08.817 INFO:tasks.workunit.client.1.smithi135.stderr: 82550K .......... .......... .......... .......... .......... 49% 557K 3m1s 2023-11-18T19:11:08.926 INFO:tasks.workunit.client.1.smithi135.stderr: 82600K .......... .......... .......... .......... .......... 49% 344K 3m1s 2023-11-18T19:11:09.037 INFO:tasks.workunit.client.1.smithi135.stderr: 82650K .......... .......... .......... .......... .......... 49% 526K 3m1s 2023-11-18T19:11:09.197 INFO:tasks.workunit.client.1.smithi135.stderr: 82700K .......... .......... .......... .......... .......... 49% 285K 3m1s 2023-11-18T19:11:09.280 INFO:tasks.workunit.client.1.smithi135.stderr: 82750K .......... .......... .......... .......... .......... 49% 597K 3m1s 2023-11-18T19:11:09.385 INFO:tasks.workunit.client.1.smithi135.stderr: 82800K .......... .......... .......... .......... .......... 49% 477K 3m1s 2023-11-18T19:11:09.539 INFO:tasks.workunit.client.1.smithi135.stderr: 82850K .......... .......... .......... .......... .......... 49% 326K 3m1s 2023-11-18T19:11:09.639 INFO:tasks.workunit.client.1.smithi135.stderr: 82900K .......... .......... .......... .......... .......... 49% 496K 3m1s 2023-11-18T19:11:09.784 INFO:tasks.workunit.client.1.smithi135.stderr: 82950K .......... .......... .......... .......... .......... 49% 345K 3m1s 2023-11-18T19:11:09.909 INFO:tasks.workunit.client.1.smithi135.stderr: 83000K .......... .......... .......... .......... .......... 49% 403K 3m1s 2023-11-18T19:11:10.053 INFO:tasks.workunit.client.1.smithi135.stderr: 83050K .......... .......... .......... .......... .......... 49% 345K 3m1s 2023-11-18T19:11:10.184 INFO:tasks.workunit.client.1.smithi135.stderr: 83100K .......... .......... .......... .......... .......... 49% 384K 3m0s 2023-11-18T19:11:10.304 INFO:tasks.workunit.client.1.smithi135.stderr: 83150K .......... .......... .......... .......... .......... 49% 417K 3m0s 2023-11-18T19:11:10.457 INFO:tasks.workunit.client.1.smithi135.stderr: 83200K .......... .......... .......... .......... .......... 49% 325K 3m0s 2023-11-18T19:11:10.598 INFO:tasks.workunit.client.1.smithi135.stderr: 83250K .......... .......... .......... .......... .......... 49% 355K 3m0s 2023-11-18T19:11:10.728 INFO:tasks.workunit.client.1.smithi135.stderr: 83300K .......... .......... .......... .......... .......... 49% 386K 3m0s 2023-11-18T19:11:10.861 INFO:tasks.workunit.client.1.smithi135.stderr: 83350K .......... .......... .......... .......... .......... 49% 376K 3m0s 2023-11-18T19:11:11.006 INFO:tasks.workunit.client.1.smithi135.stderr: 83400K .......... .......... .......... .......... .......... 49% 344K 3m0s 2023-11-18T19:11:11.111 INFO:tasks.workunit.client.1.smithi135.stderr: 83450K .......... .......... .......... .......... .......... 49% 475K 3m0s 2023-11-18T19:11:11.269 INFO:tasks.workunit.client.1.smithi135.stderr: 83500K .......... .......... .......... .......... .......... 49% 317K 3m0s 2023-11-18T19:11:11.382 INFO:tasks.workunit.client.1.smithi135.stderr: 83550K .......... .......... .......... .......... .......... 49% 444K 3m0s 2023-11-18T19:11:11.513 INFO:tasks.workunit.client.1.smithi135.stderr: 83600K .......... .......... .......... .......... .......... 49% 379K 3m0s 2023-11-18T19:11:11.607 INFO:tasks.workunit.client.1.smithi135.stderr: 83650K .......... .......... .......... .......... .......... 49% 535K 3m0s 2023-11-18T19:11:11.718 INFO:tasks.workunit.client.1.smithi135.stderr: 83700K .......... .......... .......... .......... .......... 49% 547K 2m59s 2023-11-18T19:11:11.837 INFO:tasks.workunit.client.1.smithi135.stderr: 83750K .......... .......... .......... .......... .......... 49% 361K 2m59s 2023-11-18T19:11:11.945 INFO:tasks.workunit.client.1.smithi135.stderr: 83800K .......... .......... .......... .......... .......... 49% 463K 2m59s 2023-11-18T19:11:12.049 INFO:tasks.workunit.client.1.smithi135.stderr: 83850K .......... .......... .......... .......... .......... 49% 480K 2m59s 2023-11-18T19:11:12.179 INFO:tasks.workunit.client.1.smithi135.stderr: 83900K .......... .......... .......... .......... .......... 49% 384K 2m59s 2023-11-18T19:11:12.266 INFO:tasks.workunit.client.1.smithi135.stderr: 83950K .......... .......... .......... .......... .......... 49% 573K 2m59s 2023-11-18T19:11:12.370 INFO:tasks.workunit.client.1.smithi135.stderr: 84000K .......... .......... .......... .......... .......... 49% 502K 2m59s 2023-11-18T19:11:12.586 INFO:tasks.workunit.client.1.smithi135.stderr: 84050K .......... .......... .......... .......... .......... 49% 228K 2m59s 2023-11-18T19:11:12.615 INFO:tasks.workunit.client.1.smithi135.stderr: 84100K .......... .......... .......... .......... .......... 49% 1.62M 2m59s 2023-11-18T19:11:12.716 INFO:tasks.workunit.client.1.smithi135.stderr: 84150K .......... .......... .......... .......... .......... 49% 499K 2m59s 2023-11-18T19:11:12.849 INFO:tasks.workunit.client.1.smithi135.stderr: 84200K .......... .......... .......... .......... .......... 49% 374K 2m59s 2023-11-18T19:11:12.950 INFO:tasks.workunit.client.1.smithi135.stderr: 84250K .......... .......... .......... .......... .......... 50% 516K 2m58s 2023-11-18T19:11:13.099 INFO:tasks.workunit.client.1.smithi135.stderr: 84300K .......... .......... .......... .......... .......... 50% 327K 2m58s 2023-11-18T19:11:13.188 INFO:tasks.workunit.client.1.smithi135.stderr: 84350K .......... .......... .......... .......... .......... 50% 565K 2m58s 2023-11-18T19:11:13.288 INFO:tasks.workunit.client.1.smithi135.stderr: 84400K .......... .......... .......... .......... .......... 50% 498K 2m58s 2023-11-18T19:11:13.419 INFO:tasks.workunit.client.1.smithi135.stderr: 84450K .......... .......... .......... .......... .......... 50% 383K 2m58s 2023-11-18T19:11:13.509 INFO:tasks.workunit.client.1.smithi135.stderr: 84500K .......... .......... .......... .......... .......... 50% 556K 2m58s 2023-11-18T19:11:13.617 INFO:tasks.workunit.client.1.smithi135.stderr: 84550K .......... .......... .......... .......... .......... 50% 461K 2m58s 2023-11-18T19:11:13.743 INFO:tasks.workunit.client.1.smithi135.stderr: 84600K .......... .......... .......... .......... .......... 50% 463K 2m58s 2023-11-18T19:11:13.828 INFO:tasks.workunit.client.1.smithi135.stderr: 84650K .......... .......... .......... .......... .......... 50% 488K 2m58s 2023-11-18T19:11:13.910 INFO:tasks.workunit.client.1.smithi135.stderr: 84700K .......... .......... .......... .......... .......... 50% 679K 2m57s 2023-11-18T19:11:13.997 INFO:tasks.workunit.client.1.smithi135.stderr: 84750K .......... .......... .......... .......... .......... 50% 523K 2m57s 2023-11-18T19:11:14.090 INFO:tasks.workunit.client.1.smithi135.stderr: 84800K .......... .......... .......... .......... .......... 50% 610K 2m57s 2023-11-18T19:11:14.197 INFO:tasks.workunit.client.1.smithi135.stderr: 84850K .......... .......... .......... .......... .......... 50% 424K 2m57s 2023-11-18T19:11:14.285 INFO:tasks.workunit.client.1.smithi135.stderr: 84900K .......... .......... .......... .......... .......... 50% 564K 2m57s 2023-11-18T19:11:14.368 INFO:tasks.workunit.client.1.smithi135.stderr: 84950K .......... .......... .......... .......... .......... 50% 603K 2m57s 2023-11-18T19:11:14.454 INFO:tasks.workunit.client.1.smithi135.stderr: 85000K .......... .......... .......... .......... .......... 50% 582K 2m57s 2023-11-18T19:11:14.559 INFO:tasks.workunit.client.1.smithi135.stderr: 85050K .......... .......... .......... .......... .......... 50% 476K 2m57s 2023-11-18T19:11:14.649 INFO:tasks.workunit.client.1.smithi135.stderr: 85100K .......... .......... .......... .......... .......... 50% 559K 2m57s 2023-11-18T19:11:14.833 INFO:tasks.workunit.client.1.smithi135.stderr: 85150K .......... .......... .......... .......... .......... 50% 272K 2m56s 2023-11-18T19:11:14.877 INFO:tasks.workunit.client.1.smithi135.stderr: 85200K .......... .......... .......... .......... .......... 50% 1.08M 2m56s 2023-11-18T19:11:14.986 INFO:tasks.workunit.client.1.smithi135.stderr: 85250K .......... .......... .......... .......... .......... 50% 487K 2m56s 2023-11-18T19:11:15.082 INFO:tasks.workunit.client.0.smithi045.stdout: 26 8546 35 5151 44 4574 96 2023-11-18T19:11:15.091 INFO:tasks.workunit.client.1.smithi135.stderr: 85300K .......... .......... .......... .......... .......... 50% 452K 2m56s 2023-11-18T19:11:15.180 INFO:tasks.workunit.client.1.smithi135.stderr: 85350K .......... .......... .......... .......... .......... 50% 563K 2m56s 2023-11-18T19:11:15.312 INFO:tasks.workunit.client.1.smithi135.stderr: 85400K .......... .......... .......... .......... .......... 50% 379K 2m56s 2023-11-18T19:11:15.423 INFO:tasks.workunit.client.1.smithi135.stderr: 85450K .......... .......... .......... .......... .......... 50% 450K 2m56s 2023-11-18T19:11:15.513 INFO:tasks.workunit.client.1.smithi135.stderr: 85500K .......... .......... .......... .......... .......... 50% 556K 2m56s 2023-11-18T19:11:15.594 INFO:tasks.workunit.client.1.smithi135.stderr: 85550K .......... .......... .......... .......... .......... 50% 610K 2m56s 2023-11-18T19:11:15.706 INFO:tasks.workunit.client.1.smithi135.stderr: 85600K .......... .......... .......... .......... .......... 50% 472K 2m55s 2023-11-18T19:11:15.834 INFO:tasks.workunit.client.1.smithi135.stderr: 85650K .......... .......... .......... .......... .......... 50% 375K 2m55s 2023-11-18T19:11:15.928 INFO:tasks.workunit.client.1.smithi135.stderr: 85700K .......... .......... .......... .......... .......... 50% 531K 2m55s 2023-11-18T19:11:16.016 INFO:tasks.workunit.client.1.smithi135.stderr: 85750K .......... .......... .......... .......... .......... 50% 566K 2m55s 2023-11-18T19:11:16.093 INFO:tasks.workunit.client.1.smithi135.stderr: 85800K .......... .......... .......... .......... .......... 50% 650K 2m55s 2023-11-18T19:11:16.176 INFO:tasks.workunit.client.1.smithi135.stderr: 85850K .......... .......... .......... .......... .......... 50% 605K 2m55s 2023-11-18T19:11:16.254 INFO:tasks.workunit.client.1.smithi135.stderr: 85900K .......... .......... .......... .......... .......... 50% 641K 2m55s 2023-11-18T19:11:16.358 INFO:tasks.workunit.client.1.smithi135.stderr: 85950K .......... .......... .......... .......... .......... 51% 521K 2m55s 2023-11-18T19:11:16.447 INFO:tasks.workunit.client.1.smithi135.stderr: 86000K .......... .......... .......... .......... .......... 51% 512K 2m54s 2023-11-18T19:11:16.589 INFO:tasks.workunit.client.1.smithi135.stderr: 86050K .......... .......... .......... .......... .......... 51% 498K 2m54s 2023-11-18T19:11:16.658 INFO:tasks.workunit.client.1.smithi135.stderr: 86100K .......... .......... .......... .......... .......... 51% 457K 2m54s 2023-11-18T19:11:16.723 INFO:tasks.workunit.client.1.smithi135.stderr: 86150K .......... .......... .......... .......... .......... 51% 760K 2m54s 2023-11-18T19:11:16.789 INFO:tasks.workunit.client.1.smithi135.stderr: 86200K .......... .......... .......... .......... .......... 51% 762K 2m54s 2023-11-18T19:11:16.859 INFO:tasks.workunit.client.1.smithi135.stderr: 86250K .......... .......... .......... .......... .......... 51% 710K 2m54s 2023-11-18T19:11:16.932 INFO:tasks.workunit.client.1.smithi135.stderr: 86300K .......... .......... .......... .......... .......... 51% 688K 2m54s 2023-11-18T19:11:17.000 INFO:tasks.workunit.client.1.smithi135.stderr: 86350K .......... .......... .......... .......... .......... 51% 730K 2m54s 2023-11-18T19:11:17.075 INFO:tasks.workunit.client.1.smithi135.stderr: 86400K .......... .......... .......... .......... .......... 51% 668K 2m53s 2023-11-18T19:11:17.155 INFO:tasks.workunit.client.1.smithi135.stderr: 86450K .......... .......... .......... .......... .......... 51% 623K 2m53s 2023-11-18T19:11:17.227 INFO:tasks.workunit.client.1.smithi135.stderr: 86500K .......... .......... .......... .......... .......... 51% 694K 2m53s 2023-11-18T19:11:17.302 INFO:tasks.workunit.client.1.smithi135.stderr: 86550K .......... .......... .......... .......... .......... 51% 673K 2m53s 2023-11-18T19:11:17.378 INFO:tasks.workunit.client.1.smithi135.stderr: 86600K .......... .......... .......... .......... .......... 51% 656K 2m53s 2023-11-18T19:11:17.462 INFO:tasks.workunit.client.1.smithi135.stderr: 86650K .......... .......... .......... .......... .......... 51% 596K 2m53s 2023-11-18T19:11:17.503 INFO:tasks.workunit.client.1.smithi135.stderr: 86700K .......... .......... .......... .......... .......... 51% 1.17M 2m53s 2023-11-18T19:11:17.595 INFO:tasks.workunit.client.1.smithi135.stderr: 86750K .......... .......... .......... .......... .......... 51% 545K 2m52s 2023-11-18T19:11:17.859 INFO:tasks.workunit.client.1.smithi135.stderr: 86800K .......... .......... .......... .......... .......... 51% 229K 2m52s 2023-11-18T19:11:17.859 INFO:tasks.workunit.client.1.smithi135.stderr: 86850K .......... .......... .......... .......... .......... 51% 1.08M 2m52s 2023-11-18T19:11:17.881 INFO:tasks.workunit.client.1.smithi135.stderr: 86900K .......... .......... .......... .......... .......... 51% 2.20M 2m52s 2023-11-18T19:11:18.038 INFO:tasks.workunit.client.1.smithi135.stderr: 86950K .......... .......... .......... .......... .......... 51% 325K 2m52s 2023-11-18T19:11:18.117 INFO:tasks.workunit.client.1.smithi135.stderr: 87000K .......... .......... .......... .......... .......... 51% 606K 2m52s 2023-11-18T19:11:18.211 INFO:tasks.workunit.client.1.smithi135.stderr: 87050K .......... .......... .......... .......... .......... 51% 535K 2m52s 2023-11-18T19:11:18.301 INFO:tasks.workunit.client.1.smithi135.stderr: 87100K .......... .......... .......... .......... .......... 51% 551K 2m52s 2023-11-18T19:11:18.381 INFO:tasks.workunit.client.1.smithi135.stderr: 87150K .......... .......... .......... .......... .......... 51% 631K 2m52s 2023-11-18T19:11:18.455 INFO:tasks.workunit.client.1.smithi135.stderr: 87200K .......... .......... .......... .......... .......... 51% 670K 2m51s 2023-11-18T19:11:18.526 INFO:tasks.workunit.client.1.smithi135.stderr: 87250K .......... .......... .......... .......... .......... 51% 704K 2m51s 2023-11-18T19:11:18.608 INFO:tasks.workunit.client.1.smithi135.stderr: 87300K .......... .......... .......... .......... .......... 51% 655K 2m51s 2023-11-18T19:11:18.687 INFO:tasks.workunit.client.1.smithi135.stderr: 87350K .......... .......... .......... .......... .......... 51% 637K 2m51s 2023-11-18T19:11:18.767 INFO:tasks.workunit.client.1.smithi135.stderr: 87400K .......... .......... .......... .......... .......... 51% 625K 2m51s 2023-11-18T19:11:18.932 INFO:tasks.workunit.client.1.smithi135.stderr: 87450K .......... .......... .......... .......... .......... 51% 295K 2m51s 2023-11-18T19:11:18.984 INFO:tasks.workunit.client.1.smithi135.stderr: 87500K .......... .......... .......... .......... .......... 51% 1.02M 2m51s 2023-11-18T19:11:19.069 INFO:tasks.workunit.client.1.smithi135.stderr: 87550K .......... .......... .......... .......... .......... 51% 552K 2m51s 2023-11-18T19:11:19.165 INFO:tasks.workunit.client.1.smithi135.stderr: 87600K .......... .......... .......... .......... .......... 51% 519K 2m50s 2023-11-18T19:11:19.305 INFO:tasks.workunit.client.1.smithi135.stderr: 87650K .......... .......... .......... .......... .......... 52% 357K 2m50s 2023-11-18T19:11:19.407 INFO:tasks.workunit.client.1.smithi135.stderr: 87700K .......... .......... .......... .......... .......... 52% 493K 2m50s 2023-11-18T19:11:19.495 INFO:tasks.workunit.client.1.smithi135.stderr: 87750K .......... .......... .......... .......... .......... 52% 564K 2m50s 2023-11-18T19:11:19.591 INFO:tasks.workunit.client.1.smithi135.stderr: 87800K .......... .......... .......... .......... .......... 52% 519K 2m50s 2023-11-18T19:11:19.723 INFO:tasks.workunit.client.1.smithi135.stderr: 87850K .......... .......... .......... .......... .......... 52% 380K 2m50s 2023-11-18T19:11:19.823 INFO:tasks.workunit.client.1.smithi135.stderr: 87900K .......... .......... .......... .......... .......... 52% 499K 2m50s 2023-11-18T19:11:19.913 INFO:tasks.workunit.client.1.smithi135.stderr: 87950K .......... .......... .......... .......... .......... 52% 563K 2m50s 2023-11-18T19:11:20.011 INFO:tasks.workunit.client.1.smithi135.stderr: 88000K .......... .......... .......... .......... .......... 52% 503K 2m50s 2023-11-18T19:11:20.112 INFO:tasks.workunit.client.1.smithi135.stderr: 88050K .......... .......... .......... .......... .......... 52% 498K 2m50s 2023-11-18T19:11:20.253 INFO:tasks.workunit.client.1.smithi135.stderr: 88100K .......... .......... .......... .......... .......... 52% 353K 2m49s 2023-11-18T19:11:20.352 INFO:tasks.workunit.client.1.smithi135.stderr: 88150K .......... .......... .......... .......... .......... 52% 507K 2m49s 2023-11-18T19:11:20.451 INFO:tasks.workunit.client.1.smithi135.stderr: 88200K .......... .......... .......... .......... .......... 52% 528K 2m49s 2023-11-18T19:11:20.542 INFO:tasks.workunit.client.1.smithi135.stderr: 88250K .......... .......... .......... .......... .......... 52% 527K 2m49s 2023-11-18T19:11:20.633 INFO:tasks.workunit.client.1.smithi135.stderr: 88300K .......... .......... .......... .......... .......... 52% 549K 2m49s 2023-11-18T19:11:20.722 INFO:tasks.workunit.client.1.smithi135.stderr: 88350K .......... .......... .......... .......... .......... 52% 561K 2m49s 2023-11-18T19:11:20.813 INFO:tasks.workunit.client.1.smithi135.stderr: 88400K .......... .......... .......... .......... .......... 52% 570K 2m49s 2023-11-18T19:11:20.903 INFO:tasks.workunit.client.1.smithi135.stderr: 88450K .......... .......... .......... .......... .......... 52% 536K 2m49s 2023-11-18T19:11:20.997 INFO:tasks.workunit.client.1.smithi135.stderr: 88500K .......... .......... .......... .......... .......... 52% 531K 2m49s 2023-11-18T19:11:21.086 INFO:tasks.workunit.client.1.smithi135.stderr: 88550K .......... .......... .......... .......... .......... 52% 561K 2m48s 2023-11-18T19:11:21.174 INFO:tasks.workunit.client.1.smithi135.stderr: 88600K .......... .......... .......... .......... .......... 52% 571K 2m48s 2023-11-18T19:11:21.263 INFO:tasks.workunit.client.1.smithi135.stderr: 88650K .......... .......... .......... .......... .......... 52% 576K 2m48s 2023-11-18T19:11:21.341 INFO:tasks.workunit.client.1.smithi135.stderr: 88700K .......... .......... .......... .......... .......... 52% 622K 2m48s 2023-11-18T19:11:21.421 INFO:tasks.workunit.client.1.smithi135.stderr: 88750K .......... .......... .......... .......... .......... 52% 625K 2m48s 2023-11-18T19:11:21.505 INFO:tasks.workunit.client.1.smithi135.stderr: 88800K .......... .......... .......... .......... .......... 52% 592K 2m48s 2023-11-18T19:11:21.591 INFO:tasks.workunit.client.1.smithi135.stderr: 88850K .......... .......... .......... .......... .......... 52% 617K 2m48s 2023-11-18T19:11:21.670 INFO:tasks.workunit.client.1.smithi135.stderr: 88900K .......... .......... .......... .......... .......... 52% 599K 2m48s 2023-11-18T19:11:21.731 INFO:tasks.workunit.client.1.smithi135.stderr: 88950K .......... .......... .......... .......... .......... 52% 818K 2m47s 2023-11-18T19:11:21.819 INFO:tasks.workunit.client.1.smithi135.stderr: 89000K .......... .......... .......... .......... .......... 52% 569K 2m47s 2023-11-18T19:11:21.889 INFO:tasks.workunit.client.1.smithi135.stderr: 89050K .......... .......... .......... .......... .......... 52% 718K 2m47s 2023-11-18T19:11:21.960 INFO:tasks.workunit.client.1.smithi135.stderr: 89100K .......... .......... .......... .......... .......... 52% 720K 2m47s 2023-11-18T19:11:22.047 INFO:tasks.workunit.client.1.smithi135.stderr: 89150K .......... .......... .......... .......... .......... 52% 565K 2m47s 2023-11-18T19:11:22.135 INFO:tasks.workunit.client.1.smithi135.stderr: 89200K .......... .......... .......... .......... .......... 52% 569K 2m47s 2023-11-18T19:11:22.221 INFO:tasks.workunit.client.1.smithi135.stderr: 89250K .......... .......... .......... .......... .......... 52% 578K 2m47s 2023-11-18T19:11:22.400 INFO:tasks.workunit.client.1.smithi135.stderr: 89300K .......... .......... .......... .......... .......... 53% 280K 2m47s 2023-11-18T19:11:22.434 INFO:tasks.workunit.client.1.smithi135.stderr: 89350K .......... .......... .......... .......... .......... 53% 1.46M 2m46s 2023-11-18T19:11:22.489 INFO:tasks.workunit.client.1.smithi135.stderr: 89400K .......... .......... .......... .......... .......... 53% 886K 2m46s 2023-11-18T19:11:22.574 INFO:tasks.workunit.client.1.smithi135.stderr: 89450K .......... .......... .......... .......... .......... 53% 589K 2m46s 2023-11-18T19:11:22.664 INFO:tasks.workunit.client.1.smithi135.stderr: 89500K .......... .......... .......... .......... .......... 53% 560K 2m46s 2023-11-18T19:11:22.756 INFO:tasks.workunit.client.1.smithi135.stderr: 89550K .......... .......... .......... .......... .......... 53% 540K 2m46s 2023-11-18T19:11:22.841 INFO:tasks.workunit.client.1.smithi135.stderr: 89600K .......... .......... .......... .......... .......... 53% 591K 2m46s 2023-11-18T19:11:22.934 INFO:tasks.workunit.client.1.smithi135.stderr: 89650K .......... .......... .......... .......... .......... 53% 547K 2m46s 2023-11-18T19:11:23.023 INFO:tasks.workunit.client.1.smithi135.stderr: 89700K .......... .......... .......... .......... .......... 53% 550K 2m46s 2023-11-18T19:11:23.112 INFO:tasks.workunit.client.1.smithi135.stderr: 89750K .......... .......... .......... .......... .......... 53% 579K 2m45s 2023-11-18T19:11:23.204 INFO:tasks.workunit.client.1.smithi135.stderr: 89800K .......... .......... .......... .......... .......... 53% 532K 2m45s 2023-11-18T19:11:23.291 INFO:tasks.workunit.client.1.smithi135.stderr: 89850K .......... .......... .......... .......... .......... 53% 571K 2m45s 2023-11-18T19:11:23.385 INFO:tasks.workunit.client.1.smithi135.stderr: 89900K .......... .......... .......... .......... .......... 53% 531K 2m45s 2023-11-18T19:11:23.558 INFO:tasks.workunit.client.1.smithi135.stderr: 89950K .......... .......... .......... .......... .......... 53% 291K 2m45s 2023-11-18T19:11:23.597 INFO:tasks.workunit.client.1.smithi135.stderr: 90000K .......... .......... .......... .......... .......... 53% 1.75M 2m45s 2023-11-18T19:11:23.706 INFO:tasks.workunit.client.1.smithi135.stderr: 90050K .......... .......... .......... .......... .......... 53% 415K 2m45s 2023-11-18T19:11:23.801 INFO:tasks.workunit.client.1.smithi135.stderr: 90100K .......... .......... .......... .......... .......... 53% 542K 2m45s 2023-11-18T19:11:23.883 INFO:tasks.workunit.client.1.smithi135.stderr: 90150K .......... .......... .......... .......... .......... 53% 586K 2m45s 2023-11-18T19:11:24.041 INFO:tasks.workunit.client.1.smithi135.stderr: 90200K .......... .......... .......... .......... .......... 53% 363K 2m44s 2023-11-18T19:11:24.167 INFO:tasks.workunit.client.1.smithi135.stderr: 90250K .......... .......... .......... .......... .......... 53% 343K 2m44s 2023-11-18T19:11:24.311 INFO:tasks.workunit.client.1.smithi135.stderr: 90300K .......... .......... .......... .......... .......... 53% 347K 2m44s 2023-11-18T19:11:24.448 INFO:tasks.workunit.client.1.smithi135.stderr: 90350K .......... .......... .......... .......... .......... 53% 366K 2m44s 2023-11-18T19:11:24.573 INFO:tasks.workunit.client.1.smithi135.stderr: 90400K .......... .......... .......... .......... .......... 53% 398K 2m44s 2023-11-18T19:11:24.718 INFO:tasks.workunit.client.1.smithi135.stderr: 90450K .......... .......... .......... .......... .......... 53% 353K 2m44s 2023-11-18T19:11:24.955 INFO:tasks.workunit.client.1.smithi135.stderr: 90500K .......... .......... .......... .......... .......... 53% 208K 2m44s 2023-11-18T19:11:24.968 INFO:tasks.workunit.client.1.smithi135.stderr: 90550K .......... .......... .......... .......... .......... 53% 3.71M 2m44s 2023-11-18T19:11:25.080 INFO:tasks.workunit.client.1.smithi135.stderr: 90600K .......... .......... .......... .......... .......... 53% 445K 2m44s 2023-11-18T19:11:25.083 INFO:tasks.workunit.client.0.smithi045.stdout: 27 9645 9 5938 58 3673 89 2023-11-18T19:11:25.228 INFO:tasks.workunit.client.1.smithi135.stderr: 90650K .......... .......... .......... .......... .......... 53% 349K 2m44s 2023-11-18T19:11:25.340 INFO:tasks.workunit.client.1.smithi135.stderr: 90700K .......... .......... .......... .......... .......... 53% 430K 2m44s 2023-11-18T19:11:25.457 INFO:tasks.workunit.client.1.smithi135.stderr: 90750K .......... .......... .......... .......... .......... 53% 426K 2m44s 2023-11-18T19:11:25.568 INFO:tasks.workunit.client.1.smithi135.stderr: 90800K .......... .......... .......... .......... .......... 53% 450K 2m43s 2023-11-18T19:11:25.695 INFO:tasks.workunit.client.1.smithi135.stderr: 90850K .......... .......... .......... .......... .......... 53% 392K 2m43s 2023-11-18T19:11:25.873 INFO:tasks.workunit.client.1.smithi135.stderr: 90900K .......... .......... .......... .......... .......... 53% 282K 2m43s 2023-11-18T19:11:25.942 INFO:tasks.workunit.client.1.smithi135.stderr: 90950K .......... .......... .......... .......... .......... 53% 726K 2m43s 2023-11-18T19:11:26.065 INFO:tasks.workunit.client.1.smithi135.stderr: 91000K .......... .......... .......... .......... .......... 54% 413K 2m43s 2023-11-18T19:11:26.204 INFO:tasks.workunit.client.1.smithi135.stderr: 91050K .......... .......... .......... .......... .......... 54% 355K 2m43s 2023-11-18T19:11:26.332 INFO:tasks.workunit.client.1.smithi135.stderr: 91100K .......... .......... .......... .......... .......... 54% 391K 2m43s 2023-11-18T19:11:26.461 INFO:tasks.workunit.client.1.smithi135.stderr: 91150K .......... .......... .......... .......... .......... 54% 386K 2m43s 2023-11-18T19:11:26.573 INFO:tasks.workunit.client.1.smithi135.stderr: 91200K .......... .......... .......... .......... .......... 54% 448K 2m43s 2023-11-18T19:11:26.703 INFO:tasks.workunit.client.1.smithi135.stderr: 91250K .......... .......... .......... .......... .......... 54% 390K 2m43s 2023-11-18T19:11:26.826 INFO:tasks.workunit.client.1.smithi135.stderr: 91300K .......... .......... .......... .......... .......... 54% 402K 2m43s 2023-11-18T19:11:26.966 INFO:tasks.workunit.client.1.smithi135.stderr: 91350K .......... .......... .......... .......... .......... 54% 367K 2m43s 2023-11-18T19:11:27.054 INFO:tasks.workunit.client.1.smithi135.stderr: 91400K .......... .......... .......... .......... .......... 54% 544K 2m42s 2023-11-18T19:11:27.182 INFO:tasks.workunit.client.1.smithi135.stderr: 91450K .......... .......... .......... .......... .......... 54% 392K 2m42s 2023-11-18T19:11:27.278 INFO:tasks.workunit.client.1.smithi135.stderr: 91500K .......... .......... .......... .......... .......... 54% 516K 2m42s 2023-11-18T19:11:27.371 INFO:tasks.workunit.client.1.smithi135.stderr: 91550K .......... .......... .......... .......... .......... 54% 540K 2m42s 2023-11-18T19:11:27.497 INFO:tasks.workunit.client.1.smithi135.stderr: 91600K .......... .......... .......... .......... .......... 54% 399K 2m42s 2023-11-18T19:11:27.603 INFO:tasks.workunit.client.1.smithi135.stderr: 91650K .......... .......... .......... .......... .......... 54% 469K 2m42s 2023-11-18T19:11:27.716 INFO:tasks.workunit.client.1.smithi135.stderr: 91700K .......... .......... .......... .......... .......... 54% 486K 2m42s 2023-11-18T19:11:27.808 INFO:tasks.workunit.client.1.smithi135.stderr: 91750K .......... .......... .......... .......... .......... 54% 490K 2m42s 2023-11-18T19:11:27.902 INFO:tasks.workunit.client.1.smithi135.stderr: 91800K .......... .......... .......... .......... .......... 54% 538K 2m42s 2023-11-18T19:11:28.024 INFO:tasks.workunit.client.1.smithi135.stderr: 91850K .......... .......... .......... .......... .......... 54% 404K 2m41s 2023-11-18T19:11:28.125 INFO:tasks.workunit.client.1.smithi135.stderr: 91900K .......... .......... .......... .......... .......... 54% 520K 2m41s 2023-11-18T19:11:28.222 INFO:tasks.workunit.client.1.smithi135.stderr: 91950K .......... .......... .......... .......... .......... 54% 491K 2m41s 2023-11-18T19:11:28.339 INFO:tasks.workunit.client.1.smithi135.stderr: 92000K .......... .......... .......... .......... .......... 54% 430K 2m41s 2023-11-18T19:11:28.436 INFO:tasks.workunit.client.1.smithi135.stderr: 92050K .......... .......... .......... .......... .......... 54% 516K 2m41s 2023-11-18T19:11:28.528 INFO:tasks.workunit.client.1.smithi135.stderr: 92100K .......... .......... .......... .......... .......... 54% 539K 2m41s 2023-11-18T19:11:28.620 INFO:tasks.workunit.client.1.smithi135.stderr: 92150K .......... .......... .......... .......... .......... 54% 545K 2m41s 2023-11-18T19:11:28.714 INFO:tasks.workunit.client.1.smithi135.stderr: 92200K .......... .......... .......... .......... .......... 54% 532K 2m41s 2023-11-18T19:11:28.901 INFO:tasks.workunit.client.1.smithi135.stderr: 92250K .......... .......... .......... .......... .......... 54% 269K 2m41s 2023-11-18T19:11:28.906 INFO:tasks.workunit.client.1.smithi135.stderr: 92300K .......... .......... .......... .......... .......... 54% 7.91M 2m40s 2023-11-18T19:11:29.046 INFO:tasks.workunit.client.1.smithi135.stderr: 92350K .......... .......... .......... .......... .......... 54% 358K 2m40s 2023-11-18T19:11:29.151 INFO:tasks.workunit.client.1.smithi135.stderr: 92400K .......... .......... .......... .......... .......... 54% 476K 2m40s 2023-11-18T19:11:29.278 INFO:tasks.workunit.client.1.smithi135.stderr: 92450K .......... .......... .......... .......... .......... 54% 394K 2m40s 2023-11-18T19:11:29.371 INFO:tasks.workunit.client.1.smithi135.stderr: 92500K .......... .......... .......... .......... .......... 54% 537K 2m40s 2023-11-18T19:11:29.486 INFO:tasks.workunit.client.1.smithi135.stderr: 92550K .......... .......... .......... .......... .......... 54% 434K 2m40s 2023-11-18T19:11:29.585 INFO:tasks.workunit.client.1.smithi135.stderr: 92600K .......... .......... .......... .......... .......... 54% 506K 2m40s 2023-11-18T19:11:29.696 INFO:tasks.workunit.client.1.smithi135.stderr: 92650K .......... .......... .......... .......... .......... 54% 451K 2m40s 2023-11-18T19:11:29.798 INFO:tasks.workunit.client.1.smithi135.stderr: 92700K .......... .......... .......... .......... .......... 55% 490K 2m40s 2023-11-18T19:11:29.887 INFO:tasks.workunit.client.1.smithi135.stderr: 92750K .......... .......... .......... .......... .......... 55% 566K 2m40s 2023-11-18T19:11:29.995 INFO:tasks.workunit.client.1.smithi135.stderr: 92800K .......... .......... .......... .......... .......... 55% 462K 2m39s 2023-11-18T19:11:30.077 INFO:tasks.workunit.client.1.smithi135.stderr: 92850K .......... .......... .......... .......... .......... 55% 609K 2m39s 2023-11-18T19:11:30.163 INFO:tasks.workunit.client.1.smithi135.stderr: 92900K .......... .......... .......... .......... .......... 55% 580K 2m39s 2023-11-18T19:11:30.252 INFO:tasks.workunit.client.1.smithi135.stderr: 92950K .......... .......... .......... .......... .......... 55% 562K 2m39s 2023-11-18T19:11:30.342 INFO:tasks.workunit.client.1.smithi135.stderr: 93000K .......... .......... .......... .......... .......... 55% 556K 2m39s 2023-11-18T19:11:30.434 INFO:tasks.workunit.client.1.smithi135.stderr: 93050K .......... .......... .......... .......... .......... 55% 542K 2m39s 2023-11-18T19:11:30.525 INFO:tasks.workunit.client.1.smithi135.stderr: 93100K .......... .......... .......... .......... .......... 55% 551K 2m39s 2023-11-18T19:11:30.621 INFO:tasks.workunit.client.1.smithi135.stderr: 93150K .......... .......... .......... .......... .......... 55% 540K 2m39s 2023-11-18T19:11:30.709 INFO:tasks.workunit.client.1.smithi135.stderr: 93200K .......... .......... .......... .......... .......... 55% 547K 2m38s 2023-11-18T19:11:30.803 INFO:tasks.workunit.client.1.smithi135.stderr: 93250K .......... .......... .......... .......... .......... 55% 533K 2m38s 2023-11-18T19:11:30.944 INFO:tasks.workunit.client.1.smithi135.stderr: 93300K .......... .......... .......... .......... .......... 55% 356K 2m38s 2023-11-18T19:11:31.013 INFO:tasks.workunit.client.1.smithi135.stderr: 93350K .......... .......... .......... .......... .......... 55% 714K 2m38s 2023-11-18T19:11:31.148 INFO:tasks.workunit.client.1.smithi135.stderr: 93400K .......... .......... .......... .......... .......... 55% 373K 2m38s 2023-11-18T19:11:31.231 INFO:tasks.workunit.client.1.smithi135.stderr: 93450K .......... .......... .......... .......... .......... 55% 597K 2m38s 2023-11-18T19:11:31.329 INFO:tasks.workunit.client.1.smithi135.stderr: 93500K .......... .......... .......... .......... .......... 55% 557K 2m38s 2023-11-18T19:11:31.436 INFO:tasks.workunit.client.1.smithi135.stderr: 93550K .......... .......... .......... .......... .......... 55% 437K 2m38s 2023-11-18T19:11:31.572 INFO:tasks.workunit.client.1.smithi135.stderr: 93600K .......... .......... .......... .......... .......... 55% 481K 2m38s 2023-11-18T19:11:31.662 INFO:tasks.workunit.client.1.smithi135.stderr: 93650K .......... .......... .......... .......... .......... 55% 410K 2m38s 2023-11-18T19:11:31.755 INFO:tasks.workunit.client.1.smithi135.stderr: 93700K .......... .......... .......... .......... .......... 55% 534K 2m37s 2023-11-18T19:11:31.847 INFO:tasks.workunit.client.1.smithi135.stderr: 93750K .......... .......... .......... .......... .......... 55% 544K 2m37s 2023-11-18T19:11:31.941 INFO:tasks.workunit.client.1.smithi135.stderr: 93800K .......... .......... .......... .......... .......... 55% 532K 2m37s 2023-11-18T19:11:32.147 INFO:tasks.workunit.client.1.smithi135.stderr: 93850K .......... .......... .......... .......... .......... 55% 244K 2m37s 2023-11-18T19:11:32.149 INFO:tasks.workunit.client.1.smithi135.stderr: 93900K .......... .......... .......... .......... .......... 55% 12.7M 2m37s 2023-11-18T19:11:32.296 INFO:tasks.workunit.client.1.smithi135.stderr: 93950K .......... .......... .......... .......... .......... 55% 342K 2m37s 2023-11-18T19:11:32.388 INFO:tasks.workunit.client.1.smithi135.stderr: 94000K .......... .......... .......... .......... .......... 55% 539K 2m37s 2023-11-18T19:11:32.539 INFO:tasks.workunit.client.1.smithi135.stderr: 94050K .......... .......... .......... .......... .......... 55% 333K 2m37s 2023-11-18T19:11:32.628 INFO:tasks.workunit.client.1.smithi135.stderr: 94100K .......... .......... .......... .......... .......... 55% 563K 2m37s 2023-11-18T19:11:32.725 INFO:tasks.workunit.client.1.smithi135.stderr: 94150K .......... .......... .......... .......... .......... 55% 524K 2m37s 2023-11-18T19:11:32.888 INFO:tasks.workunit.client.1.smithi135.stderr: 94200K .......... .......... .......... .......... .......... 55% 303K 2m36s 2023-11-18T19:11:32.979 INFO:tasks.workunit.client.1.smithi135.stderr: 94250K .......... .......... .......... .......... .......... 55% 551K 2m36s 2023-11-18T19:11:33.082 INFO:tasks.workunit.client.1.smithi135.stderr: 94300K .......... .......... .......... .......... .......... 55% 483K 2m36s 2023-11-18T19:11:33.199 INFO:tasks.workunit.client.1.smithi135.stderr: 94350K .......... .......... .......... .......... .......... 56% 428K 2m36s 2023-11-18T19:11:33.343 INFO:tasks.workunit.client.1.smithi135.stderr: 94400K .......... .......... .......... .......... .......... 56% 348K 2m36s 2023-11-18T19:11:33.423 INFO:tasks.workunit.client.1.smithi135.stderr: 94450K .......... .......... .......... .......... .......... 56% 623K 2m36s 2023-11-18T19:11:33.514 INFO:tasks.workunit.client.1.smithi135.stderr: 94500K .......... .......... .......... .......... .......... 56% 549K 2m36s 2023-11-18T19:11:33.593 INFO:tasks.workunit.client.1.smithi135.stderr: 94550K .......... .......... .......... .......... .......... 56% 633K 2m36s 2023-11-18T19:11:33.689 INFO:tasks.workunit.client.1.smithi135.stderr: 94600K .......... .......... .......... .......... .......... 56% 524K 2m36s 2023-11-18T19:11:33.774 INFO:tasks.workunit.client.1.smithi135.stderr: 94650K .......... .......... .......... .......... .......... 56% 585K 2m35s 2023-11-18T19:11:33.864 INFO:tasks.workunit.client.1.smithi135.stderr: 94700K .......... .......... .......... .......... .......... 56% 557K 2m35s 2023-11-18T19:11:33.995 INFO:tasks.workunit.client.1.smithi135.stderr: 94750K .......... .......... .......... .......... .......... 56% 379K 2m35s 2023-11-18T19:11:34.084 INFO:tasks.workunit.client.1.smithi135.stderr: 94800K .......... .......... .......... .......... .......... 56% 565K 2m35s 2023-11-18T19:11:34.176 INFO:tasks.workunit.client.1.smithi135.stderr: 94850K .......... .......... .......... .......... .......... 56% 545K 2m35s 2023-11-18T19:11:34.266 INFO:tasks.workunit.client.1.smithi135.stderr: 94900K .......... .......... .......... .......... .......... 56% 555K 2m35s 2023-11-18T19:11:34.361 INFO:tasks.workunit.client.1.smithi135.stderr: 94950K .......... .......... .......... .......... .......... 56% 523K 2m35s 2023-11-18T19:11:34.481 INFO:tasks.workunit.client.1.smithi135.stderr: 95000K .......... .......... .......... .......... .......... 56% 420K 2m35s 2023-11-18T19:11:34.541 INFO:tasks.workunit.client.1.smithi135.stderr: 95050K .......... .......... .......... .......... .......... 56% 826K 2m35s 2023-11-18T19:11:34.641 INFO:tasks.workunit.client.1.smithi135.stderr: 95100K .......... .......... .......... .......... .......... 56% 501K 2m34s 2023-11-18T19:11:34.775 INFO:tasks.workunit.client.1.smithi135.stderr: 95150K .......... .......... .......... .......... .......... 56% 373K 2m34s 2023-11-18T19:11:34.857 INFO:tasks.workunit.client.1.smithi135.stderr: 95200K .......... .......... .......... .......... .......... 56% 607K 2m34s 2023-11-18T19:11:34.964 INFO:tasks.workunit.client.1.smithi135.stderr: 95250K .......... .......... .......... .......... .......... 56% 468K 2m34s 2023-11-18T19:11:35.053 INFO:tasks.workunit.client.1.smithi135.stderr: 95300K .......... .......... .......... .......... .......... 56% 596K 2m34s 2023-11-18T19:11:35.083 INFO:tasks.workunit.client.0.smithi045.stdout: 27 9255 26 5479 38 4589 87 2023-11-18T19:11:35.187 INFO:tasks.workunit.client.1.smithi135.stderr: 95350K .......... .......... .......... .......... .......... 56% 360K 2m34s 2023-11-18T19:11:35.275 INFO:tasks.workunit.client.1.smithi135.stderr: 95400K .......... .......... .......... .......... .......... 56% 572K 2m34s 2023-11-18T19:11:35.373 INFO:tasks.workunit.client.1.smithi135.stderr: 95450K .......... .......... .......... .......... .......... 56% 506K 2m34s 2023-11-18T19:11:35.468 INFO:tasks.workunit.client.1.smithi135.stderr: 95500K .......... .......... .......... .......... .......... 56% 531K 2m34s 2023-11-18T19:11:35.565 INFO:tasks.workunit.client.1.smithi135.stderr: 95550K .......... .......... .......... .......... .......... 56% 516K 2m33s 2023-11-18T19:11:35.651 INFO:tasks.workunit.client.1.smithi135.stderr: 95600K .......... .......... .......... .......... .......... 56% 577K 2m33s 2023-11-18T19:11:35.737 INFO:tasks.workunit.client.1.smithi135.stderr: 95650K .......... .......... .......... .......... .......... 56% 582K 2m33s 2023-11-18T19:11:35.823 INFO:tasks.workunit.client.1.smithi135.stderr: 95700K .......... .......... .......... .......... .......... 56% 578K 2m33s 2023-11-18T19:11:35.914 INFO:tasks.workunit.client.1.smithi135.stderr: 95750K .......... .......... .......... .......... .......... 56% 571K 2m33s 2023-11-18T19:11:36.004 INFO:tasks.workunit.client.1.smithi135.stderr: 95800K .......... .......... .......... .......... .......... 56% 536K 2m33s 2023-11-18T19:11:36.112 INFO:tasks.workunit.client.1.smithi135.stderr: 95850K .......... .......... .......... .......... .......... 56% 538K 2m33s 2023-11-18T19:11:36.202 INFO:tasks.workunit.client.1.smithi135.stderr: 95900K .......... .......... .......... .......... .......... 56% 476K 2m33s 2023-11-18T19:11:36.308 INFO:tasks.workunit.client.1.smithi135.stderr: 95950K .......... .......... .......... .......... .......... 56% 541K 2m33s 2023-11-18T19:11:36.403 INFO:tasks.workunit.client.1.smithi135.stderr: 96000K .......... .......... .......... .......... .......... 56% 460K 2m32s 2023-11-18T19:11:36.506 INFO:tasks.workunit.client.1.smithi135.stderr: 96050K .......... .......... .......... .......... .......... 57% 487K 2m32s 2023-11-18T19:11:36.613 INFO:tasks.workunit.client.1.smithi135.stderr: 96100K .......... .......... .......... .......... .......... 57% 469K 2m32s 2023-11-18T19:11:36.699 INFO:tasks.workunit.client.1.smithi135.stderr: 96150K .......... .......... .......... .......... .......... 57% 575K 2m32s 2023-11-18T19:11:36.779 INFO:tasks.workunit.client.1.smithi135.stderr: 96200K .......... .......... .......... .......... .......... 57% 633K 2m32s 2023-11-18T19:11:36.858 INFO:tasks.workunit.client.1.smithi135.stderr: 96250K .......... .......... .......... .......... .......... 57% 629K 2m32s 2023-11-18T19:11:36.939 INFO:tasks.workunit.client.1.smithi135.stderr: 96300K .......... .......... .......... .......... .......... 57% 619K 2m32s 2023-11-18T19:11:37.017 INFO:tasks.workunit.client.1.smithi135.stderr: 96350K .......... .......... .......... .......... .......... 57% 638K 2m32s 2023-11-18T19:11:37.100 INFO:tasks.workunit.client.1.smithi135.stderr: 96400K .......... .......... .......... .......... .......... 57% 606K 2m32s 2023-11-18T19:11:37.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:11:37.172 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:11:37.174 INFO:tasks.workunit.client.1.smithi135.stderr: 96450K .......... .......... .......... .......... .......... 57% 670K 2m31s 2023-11-18T19:11:37.263 INFO:tasks.workunit.client.1.smithi135.stderr: 96500K .......... .......... .......... .......... .......... 57% 566K 2m31s 2023-11-18T19:11:37.321 INFO:tasks.workunit.client.1.smithi135.stderr: 96550K .......... .......... .......... .......... .......... 57% 850K 2m31s 2023-11-18T19:11:37.390 INFO:tasks.workunit.client.1.smithi135.stderr: 96600K .......... .......... .......... .......... .......... 57% 722K 2m31s 2023-11-18T19:11:37.483 INFO:tasks.workunit.client.1.smithi135.stderr: 96650K .......... .......... .......... .......... .......... 57% 545K 2m31s 2023-11-18T19:11:37.576 INFO:tasks.workunit.client.1.smithi135.stderr: 96700K .......... .......... .......... .......... .......... 57% 531K 2m31s 2023-11-18T19:11:37.661 INFO:tasks.workunit.client.1.smithi135.stderr: 96750K .......... .......... .......... .......... .......... 57% 607K 2m31s 2023-11-18T19:11:37.742 INFO:tasks.workunit.client.1.smithi135.stderr: 96800K .......... .......... .......... .......... .......... 57% 605K 2m31s 2023-11-18T19:11:37.940 INFO:tasks.workunit.client.1.smithi135.stderr: 96850K .......... .......... .......... .......... .......... 57% 253K 2m30s 2023-11-18T19:11:37.956 INFO:tasks.workunit.client.1.smithi135.stderr: 96900K .......... .......... .......... .......... .......... 57% 2.91M 2m30s 2023-11-18T19:11:38.056 INFO:tasks.workunit.client.1.smithi135.stderr: 96950K .......... .......... .......... .......... .......... 57% 502K 2m30s 2023-11-18T19:11:38.144 INFO:tasks.workunit.client.1.smithi135.stderr: 97000K .......... .......... .......... .......... .......... 57% 566K 2m30s 2023-11-18T19:11:38.248 INFO:tasks.workunit.client.1.smithi135.stderr: 97050K .......... .......... .......... .......... .......... 57% 480K 2m30s 2023-11-18T19:11:38.338 INFO:tasks.workunit.client.1.smithi135.stderr: 97100K .......... .......... .......... .......... .......... 57% 558K 2m30s 2023-11-18T19:11:38.429 INFO:tasks.workunit.client.1.smithi135.stderr: 97150K .......... .......... .......... .......... .......... 57% 548K 2m30s 2023-11-18T19:11:38.521 INFO:tasks.workunit.client.1.smithi135.stderr: 97200K .......... .......... .......... .......... .......... 57% 550K 2m30s 2023-11-18T19:11:38.606 INFO:tasks.workunit.client.1.smithi135.stderr: 97250K .......... .......... .......... .......... .......... 57% 582K 2m30s 2023-11-18T19:11:38.695 INFO:tasks.workunit.client.1.smithi135.stderr: 97300K .......... .......... .......... .......... .......... 57% 561K 2m29s 2023-11-18T19:11:38.783 INFO:tasks.workunit.client.1.smithi135.stderr: 97350K .......... .......... .......... .......... .......... 57% 569K 2m29s 2023-11-18T19:11:38.845 INFO:tasks.workunit.client.1.smithi135.stderr: 97400K .......... .......... .......... .......... .......... 57% 799K 2m29s 2023-11-18T19:11:38.940 INFO:tasks.workunit.client.1.smithi135.stderr: 97450K .......... .......... .......... .......... .......... 57% 529K 2m29s 2023-11-18T19:11:39.033 INFO:tasks.workunit.client.1.smithi135.stderr: 97500K .......... .......... .......... .......... .......... 57% 540K 2m29s 2023-11-18T19:11:39.120 INFO:tasks.workunit.client.1.smithi135.stderr: 97550K .......... .......... .......... .......... .......... 57% 579K 2m29s 2023-11-18T19:11:39.188 INFO:tasks.workunit.client.1.smithi135.stderr: 97600K .......... .......... .......... .......... .......... 57% 722K 2m29s 2023-11-18T19:11:39.267 INFO:tasks.workunit.client.1.smithi135.stderr: 97650K .......... .......... .......... .......... .......... 57% 642K 2m29s 2023-11-18T19:11:39.330 INFO:tasks.workunit.client.1.smithi135.stderr: 97700K .......... .......... .......... .......... .......... 57% 790K 2m28s 2023-11-18T19:11:39.409 INFO:tasks.workunit.client.1.smithi135.stderr: 97750K .......... .......... .......... .......... .......... 58% 691K 2m28s 2023-11-18T19:11:39.489 INFO:tasks.workunit.client.1.smithi135.stderr: 97800K .......... .......... .......... .......... .......... 58% 575K 2m28s 2023-11-18T19:11:39.540 INFO:tasks.workunit.client.1.smithi135.stderr: 97850K .......... .......... .......... .......... .......... 58% 984K 2m28s 2023-11-18T19:11:39.640 INFO:tasks.workunit.client.1.smithi135.stderr: 97900K .......... .......... .......... .......... .......... 58% 497K 2m28s 2023-11-18T19:11:39.714 INFO:tasks.workunit.client.1.smithi135.stderr: 97950K .......... .......... .......... .......... .......... 58% 681K 2m28s 2023-11-18T19:11:39.788 INFO:tasks.workunit.client.1.smithi135.stderr: 98000K .......... .......... .......... .......... .......... 58% 679K 2m28s 2023-11-18T19:11:39.843 INFO:tasks.workunit.client.1.smithi135.stderr: 98050K .......... .......... .......... .......... .......... 58% 906K 2m28s 2023-11-18T19:11:39.926 INFO:tasks.workunit.client.1.smithi135.stderr: 98100K .......... .......... .......... .......... .......... 58% 613K 2m27s 2023-11-18T19:11:40.008 INFO:tasks.workunit.client.1.smithi135.stderr: 98150K .......... .......... .......... .......... .......... 58% 601K 2m27s 2023-11-18T19:11:40.083 INFO:tasks.workunit.client.1.smithi135.stderr: 98200K .......... .......... .......... .......... .......... 58% 673K 2m27s 2023-11-18T19:11:40.180 INFO:tasks.workunit.client.1.smithi135.stderr: 98250K .......... .......... .......... .......... .......... 58% 509K 2m27s 2023-11-18T19:11:40.249 INFO:tasks.workunit.client.1.smithi135.stderr: 98300K .......... .......... .......... .......... .......... 58% 722K 2m27s 2023-11-18T19:11:40.308 INFO:tasks.workunit.client.1.smithi135.stderr: 98350K .......... .......... .......... .......... .......... 58% 854K 2m27s 2023-11-18T19:11:40.373 INFO:tasks.workunit.client.1.smithi135.stderr: 98400K .......... .......... .......... .......... .......... 58% 766K 2m27s 2023-11-18T19:11:40.449 INFO:tasks.workunit.client.1.smithi135.stderr: 98450K .......... .......... .......... .......... .......... 58% 658K 2m27s 2023-11-18T19:11:40.520 INFO:tasks.workunit.client.1.smithi135.stderr: 98500K .......... .......... .......... .......... .......... 58% 705K 2m26s 2023-11-18T19:11:40.601 INFO:tasks.workunit.client.1.smithi135.stderr: 98550K .......... .......... .......... .......... .......... 58% 737K 2m26s 2023-11-18T19:11:40.665 INFO:tasks.workunit.client.1.smithi135.stderr: 98600K .......... .......... .......... .......... .......... 58% 646K 2m26s 2023-11-18T19:11:40.721 INFO:tasks.workunit.client.1.smithi135.stderr: 98650K .......... .......... .......... .......... .......... 58% 889K 2m26s 2023-11-18T19:11:40.798 INFO:tasks.workunit.client.1.smithi135.stderr: 98700K .......... .......... .......... .......... .......... 58% 648K 2m26s 2023-11-18T19:11:40.876 INFO:tasks.workunit.client.1.smithi135.stderr: 98750K .......... .......... .......... .......... .......... 58% 641K 2m26s 2023-11-18T19:11:40.949 INFO:tasks.workunit.client.1.smithi135.stderr: 98800K .......... .......... .......... .......... .......... 58% 727K 2m26s 2023-11-18T19:11:41.033 INFO:tasks.workunit.client.1.smithi135.stderr: 98850K .......... .......... .......... .......... .......... 58% 565K 2m26s 2023-11-18T19:11:41.079 INFO:tasks.workunit.client.1.smithi135.stderr: 98900K .......... .......... .......... .......... .......... 58% 1.09M 2m25s 2023-11-18T19:11:41.262 INFO:tasks.workunit.client.1.smithi135.stderr: 98950K .......... .......... .......... .......... .......... 58% 274K 2m25s 2023-11-18T19:11:41.262 INFO:tasks.workunit.client.1.smithi135.stderr: 99000K .......... .......... .......... .......... .......... 58% 63.7M 2m25s 2023-11-18T19:11:41.332 INFO:tasks.workunit.client.1.smithi135.stderr: 99050K .......... .......... .......... .......... .......... 58% 740K 2m25s 2023-11-18T19:11:41.414 INFO:tasks.workunit.client.1.smithi135.stderr: 99100K .......... .......... .......... .......... .......... 58% 629K 2m25s 2023-11-18T19:11:41.494 INFO:tasks.workunit.client.1.smithi135.stderr: 99150K .......... .......... .......... .......... .......... 58% 583K 2m25s 2023-11-18T19:11:41.574 INFO:tasks.workunit.client.1.smithi135.stderr: 99200K .......... .......... .......... .......... .......... 58% 632K 2m25s 2023-11-18T19:11:41.655 INFO:tasks.workunit.client.1.smithi135.stderr: 99250K .......... .......... .......... .......... .......... 58% 656K 2m25s 2023-11-18T19:11:41.733 INFO:tasks.workunit.client.1.smithi135.stderr: 99300K .......... .......... .......... .......... .......... 58% 602K 2m24s 2023-11-18T19:11:41.817 INFO:tasks.workunit.client.1.smithi135.stderr: 99350K .......... .......... .......... .......... .......... 58% 641K 2m24s 2023-11-18T19:11:41.901 INFO:tasks.workunit.client.1.smithi135.stderr: 99400K .......... .......... .......... .......... .......... 58% 553K 2m24s 2023-11-18T19:11:41.974 INFO:tasks.workunit.client.1.smithi135.stderr: 99450K .......... .......... .......... .......... .......... 59% 741K 2m24s 2023-11-18T19:11:42.057 INFO:tasks.workunit.client.1.smithi135.stderr: 99500K .......... .......... .......... .......... .......... 59% 568K 2m24s 2023-11-18T19:11:42.151 INFO:tasks.workunit.client.1.smithi135.stderr: 99550K .......... .......... .......... .......... .......... 59% 530K 2m24s 2023-11-18T19:11:42.205 INFO:tasks.workunit.client.1.smithi135.stderr: 99600K .......... .......... .......... .......... .......... 59% 927K 2m24s 2023-11-18T19:11:42.282 INFO:tasks.workunit.client.1.smithi135.stderr: 99650K .......... .......... .......... .......... .......... 59% 650K 2m24s 2023-11-18T19:11:42.376 INFO:tasks.workunit.client.1.smithi135.stderr: 99700K .......... .......... .......... .......... .......... 59% 530K 2m23s 2023-11-18T19:11:42.474 INFO:tasks.workunit.client.1.smithi135.stderr: 99750K .......... .......... .......... .......... .......... 59% 512K 2m23s 2023-11-18T19:11:42.541 INFO:tasks.workunit.client.1.smithi135.stderr: 99800K .......... .......... .......... .......... .......... 59% 748K 2m23s 2023-11-18T19:11:42.617 INFO:tasks.workunit.client.1.smithi135.stderr: 99850K .......... .......... .......... .......... .......... 59% 654K 2m23s 2023-11-18T19:11:42.654 INFO:tasks.workunit.client.1.smithi135.stderr: 99900K .......... .......... .......... .......... .......... 59% 1.49M 2m23s 2023-11-18T19:11:42.733 INFO:tasks.workunit.client.1.smithi135.stderr: 99950K .......... .......... .......... .......... .......... 59% 603K 2m23s 2023-11-18T19:11:42.820 INFO:tasks.workunit.client.1.smithi135.stderr:100000K .......... .......... .......... .......... .......... 59% 577K 2m23s 2023-11-18T19:11:42.881 INFO:tasks.workunit.client.1.smithi135.stderr:100050K .......... .......... .......... .......... .......... 59% 805K 2m23s 2023-11-18T19:11:42.974 INFO:tasks.workunit.client.1.smithi135.stderr:100100K .......... .......... .......... .......... .......... 59% 546K 2m22s 2023-11-18T19:11:43.003 INFO:tasks.workunit.client.1.smithi135.stderr:100150K .......... .......... .......... .......... .......... 59% 1.61M 2m22s 2023-11-18T19:11:43.089 INFO:tasks.workunit.client.1.smithi135.stderr:100200K .......... .......... .......... .......... .......... 59% 581K 2m22s 2023-11-18T19:11:43.174 INFO:tasks.workunit.client.1.smithi135.stderr:100250K .......... .......... .......... .......... .......... 59% 740K 2m22s 2023-11-18T19:11:43.243 INFO:tasks.workunit.client.1.smithi135.stderr:100300K .......... .......... .......... .......... .......... 59% 581K 2m22s 2023-11-18T19:11:43.283 INFO:tasks.workunit.client.1.smithi135.stderr:100350K .......... .......... .......... .......... .......... 59% 1.25M 2m22s 2023-11-18T19:11:43.363 INFO:tasks.workunit.client.1.smithi135.stderr:100400K .......... .......... .......... .......... .......... 59% 614K 2m22s 2023-11-18T19:11:43.561 INFO:tasks.workunit.client.1.smithi135.stderr:100450K .......... .......... .......... .......... .......... 59% 254K 2m22s 2023-11-18T19:11:43.577 INFO:tasks.workunit.client.1.smithi135.stderr:100500K .......... .......... .......... .......... .......... 59% 3.19M 2m21s 2023-11-18T19:11:43.637 INFO:tasks.workunit.client.1.smithi135.stderr:100550K .......... .......... .......... .......... .......... 59% 813K 2m21s 2023-11-18T19:11:43.715 INFO:tasks.workunit.client.1.smithi135.stderr:100600K .......... .......... .......... .......... .......... 59% 642K 2m21s 2023-11-18T19:11:43.799 INFO:tasks.workunit.client.1.smithi135.stderr:100650K .......... .......... .......... .......... .......... 59% 620K 2m21s 2023-11-18T19:11:43.878 INFO:tasks.workunit.client.1.smithi135.stderr:100700K .......... .......... .......... .......... .......... 59% 609K 2m21s 2023-11-18T19:11:43.957 INFO:tasks.workunit.client.1.smithi135.stderr:100750K .......... .......... .......... .......... .......... 59% 661K 2m21s 2023-11-18T19:11:44.040 INFO:tasks.workunit.client.1.smithi135.stderr:100800K .......... .......... .......... .......... .......... 59% 580K 2m21s 2023-11-18T19:11:44.129 INFO:tasks.workunit.client.1.smithi135.stderr:100850K .......... .......... .......... .......... .......... 59% 563K 2m21s 2023-11-18T19:11:44.196 INFO:tasks.workunit.client.1.smithi135.stderr:100900K .......... .......... .......... .......... .......... 59% 737K 2m20s 2023-11-18T19:11:44.277 INFO:tasks.workunit.client.1.smithi135.stderr:100950K .......... .......... .......... .......... .......... 59% 624K 2m20s 2023-11-18T19:11:44.363 INFO:tasks.workunit.client.1.smithi135.stderr:101000K .......... .......... .......... .......... .......... 59% 576K 2m20s 2023-11-18T19:11:44.454 INFO:tasks.workunit.client.1.smithi135.stderr:101050K .......... .......... .......... .......... .......... 59% 555K 2m20s 2023-11-18T19:11:44.500 INFO:tasks.workunit.client.1.smithi135.stderr:101100K .......... .......... .......... .......... .......... 60% 1.08M 2m20s 2023-11-18T19:11:44.585 INFO:tasks.workunit.client.1.smithi135.stderr:101150K .......... .......... .......... .......... .......... 60% 576K 2m20s 2023-11-18T19:11:44.743 INFO:tasks.workunit.client.1.smithi135.stderr:101200K .......... .......... .......... .......... .......... 60% 318K 2m20s 2023-11-18T19:11:44.767 INFO:tasks.workunit.client.1.smithi135.stderr:101250K .......... .......... .......... .......... .......... 60% 2.04M 2m20s 2023-11-18T19:11:44.863 INFO:tasks.workunit.client.1.smithi135.stderr:101300K .......... .......... .......... .......... .......... 60% 538K 2m20s 2023-11-18T19:11:44.972 INFO:tasks.workunit.client.1.smithi135.stderr:101350K .......... .......... .......... .......... .......... 60% 448K 2m19s 2023-11-18T19:11:45.049 INFO:tasks.workunit.client.1.smithi135.stderr:101400K .......... .......... .......... .......... .......... 60% 647K 2m19s 2023-11-18T19:11:45.083 INFO:tasks.workunit.client.0.smithi045.stdout: 28 9578 23 5830 43 4061 73 2023-11-18T19:11:45.136 INFO:tasks.workunit.client.1.smithi135.stderr:101450K .......... .......... .......... .......... .......... 60% 575K 2m19s 2023-11-18T19:11:45.218 INFO:tasks.workunit.client.1.smithi135.stderr:101500K .......... .......... .......... .......... .......... 60% 611K 2m19s 2023-11-18T19:11:45.302 INFO:tasks.workunit.client.1.smithi135.stderr:101550K .......... .......... .......... .......... .......... 60% 598K 2m19s 2023-11-18T19:11:45.389 INFO:tasks.workunit.client.1.smithi135.stderr:101600K .......... .......... .......... .......... .......... 60% 569K 2m19s 2023-11-18T19:11:45.508 INFO:tasks.workunit.client.1.smithi135.stderr:101650K .......... .......... .......... .......... .......... 60% 592K 2m19s 2023-11-18T19:11:45.593 INFO:tasks.workunit.client.1.smithi135.stderr:101700K .......... .......... .......... .......... .......... 60% 418K 2m19s 2023-11-18T19:11:45.682 INFO:tasks.workunit.client.1.smithi135.stderr:101750K .......... .......... .......... .......... .......... 60% 561K 2m19s 2023-11-18T19:11:45.772 INFO:tasks.workunit.client.1.smithi135.stderr:101800K .......... .......... .......... .......... .......... 60% 555K 2m18s 2023-11-18T19:11:45.865 INFO:tasks.workunit.client.1.smithi135.stderr:101850K .......... .......... .......... .......... .......... 60% 537K 2m18s 2023-11-18T19:11:46.015 INFO:tasks.workunit.client.1.smithi135.stderr:101900K .......... .......... .......... .......... .......... 60% 335K 2m18s 2023-11-18T19:11:46.070 INFO:tasks.workunit.client.1.smithi135.stderr:101950K .......... .......... .......... .......... .......... 60% 908K 2m18s 2023-11-18T19:11:46.210 INFO:tasks.workunit.client.1.smithi135.stderr:102000K .......... .......... .......... .......... .......... 60% 356K 2m18s 2023-11-18T19:11:46.301 INFO:tasks.workunit.client.1.smithi135.stderr:102050K .......... .......... .......... .......... .......... 60% 552K 2m18s 2023-11-18T19:11:46.410 INFO:tasks.workunit.client.1.smithi135.stderr:102100K .......... .......... .......... .......... .......... 60% 460K 2m18s 2023-11-18T19:11:46.539 INFO:tasks.workunit.client.1.smithi135.stderr:102150K .......... .......... .......... .......... .......... 60% 385K 2m18s 2023-11-18T19:11:46.661 INFO:tasks.workunit.client.1.smithi135.stderr:102200K .......... .......... .......... .......... .......... 60% 411K 2m18s 2023-11-18T19:11:46.753 INFO:tasks.workunit.client.1.smithi135.stderr:102250K .......... .......... .......... .......... .......... 60% 541K 2m18s 2023-11-18T19:11:46.845 INFO:tasks.workunit.client.1.smithi135.stderr:102300K .......... .......... .......... .......... .......... 60% 545K 2m17s 2023-11-18T19:11:46.942 INFO:tasks.workunit.client.1.smithi135.stderr:102350K .......... .......... .......... .......... .......... 60% 518K 2m17s 2023-11-18T19:11:47.093 INFO:tasks.workunit.client.1.smithi135.stderr:102400K .......... .......... .......... .......... .......... 60% 331K 2m17s 2023-11-18T19:11:47.198 INFO:tasks.workunit.client.1.smithi135.stderr:102450K .......... .......... .......... .......... .......... 60% 472K 2m17s 2023-11-18T19:11:47.326 INFO:tasks.workunit.client.1.smithi135.stderr:102500K .......... .......... .......... .......... .......... 60% 392K 2m17s 2023-11-18T19:11:47.433 INFO:tasks.workunit.client.1.smithi135.stderr:102550K .......... .......... .......... .......... .......... 60% 469K 2m17s 2023-11-18T19:11:47.536 INFO:tasks.workunit.client.1.smithi135.stderr:102600K .......... .......... .......... .......... .......... 60% 482K 2m17s 2023-11-18T19:11:47.756 INFO:tasks.workunit.client.1.smithi135.stderr:102650K .......... .......... .......... .......... .......... 60% 228K 2m17s 2023-11-18T19:11:47.866 INFO:tasks.workunit.client.1.smithi135.stderr:102700K .......... .......... .......... .......... .......... 60% 455K 2m17s 2023-11-18T19:11:48.035 INFO:tasks.workunit.client.1.smithi135.stderr:102750K .......... .......... .......... .......... .......... 60% 296K 2m17s 2023-11-18T19:11:48.191 INFO:tasks.workunit.client.1.smithi135.stderr:102800K .......... .......... .......... .......... .......... 61% 321K 2m17s 2023-11-18T19:11:48.330 INFO:tasks.workunit.client.1.smithi135.stderr:102850K .......... .......... .......... .......... .......... 61% 361K 2m16s 2023-11-18T19:11:48.465 INFO:tasks.workunit.client.1.smithi135.stderr:102900K .......... .......... .......... .......... .......... 61% 370K 2m16s 2023-11-18T19:11:48.631 INFO:tasks.workunit.client.1.smithi135.stderr:102950K .......... .......... .......... .......... .......... 61% 300K 2m16s 2023-11-18T19:11:48.777 INFO:tasks.workunit.client.1.smithi135.stderr:103000K .......... .......... .......... .......... .......... 61% 344K 2m16s 2023-11-18T19:11:48.897 INFO:tasks.workunit.client.1.smithi135.stderr:103050K .......... .......... .......... .......... .......... 61% 416K 2m16s 2023-11-18T19:11:49.058 INFO:tasks.workunit.client.1.smithi135.stderr:103100K .......... .......... .......... .......... .......... 61% 387K 2m16s 2023-11-18T19:11:49.152 INFO:tasks.workunit.client.1.smithi135.stderr:103150K .......... .......... .......... .......... .......... 61% 396K 2m16s 2023-11-18T19:11:49.287 INFO:tasks.workunit.client.1.smithi135.stderr:103200K .......... .......... .......... .......... .......... 61% 370K 2m16s 2023-11-18T19:11:49.412 INFO:tasks.workunit.client.1.smithi135.stderr:103250K .......... .......... .......... .......... .......... 61% 401K 2m16s 2023-11-18T19:11:49.513 INFO:tasks.workunit.client.1.smithi135.stderr:103300K .......... .......... .......... .......... .......... 61% 495K 2m16s 2023-11-18T19:11:49.636 INFO:tasks.workunit.client.1.smithi135.stderr:103350K .......... .......... .......... .......... .......... 61% 487K 2m16s 2023-11-18T19:11:49.716 INFO:tasks.workunit.client.1.smithi135.stderr:103400K .......... .......... .......... .......... .......... 61% 498K 2m15s 2023-11-18T19:11:49.798 INFO:tasks.workunit.client.1.smithi135.stderr:103450K .......... .......... .......... .......... .......... 61% 625K 2m15s 2023-11-18T19:11:49.937 INFO:tasks.workunit.client.1.smithi135.stderr:103500K .......... .......... .......... .......... .......... 61% 354K 2m15s 2023-11-18T19:11:50.052 INFO:tasks.workunit.client.1.smithi135.stderr:103550K .......... .......... .......... .......... .......... 61% 436K 2m15s 2023-11-18T19:11:50.135 INFO:tasks.workunit.client.1.smithi135.stderr:103600K .......... .......... .......... .......... .......... 61% 602K 2m15s 2023-11-18T19:11:50.228 INFO:tasks.workunit.client.1.smithi135.stderr:103650K .......... .......... .......... .......... .......... 61% 536K 2m15s 2023-11-18T19:11:50.316 INFO:tasks.workunit.client.1.smithi135.stderr:103700K .......... .......... .......... .......... .......... 61% 568K 2m15s 2023-11-18T19:11:50.412 INFO:tasks.workunit.client.1.smithi135.stderr:103750K .......... .......... .......... .......... .......... 61% 520K 2m15s 2023-11-18T19:11:50.630 INFO:tasks.workunit.client.1.smithi135.stderr:103800K .......... .......... .......... .......... .......... 61% 230K 2m15s 2023-11-18T19:11:50.659 INFO:tasks.workunit.client.1.smithi135.stderr:103850K .......... .......... .......... .......... .......... 61% 1.70M 2m15s 2023-11-18T19:11:50.797 INFO:tasks.workunit.client.1.smithi135.stderr:103900K .......... .......... .......... .......... .......... 61% 364K 2m14s 2023-11-18T19:11:50.897 INFO:tasks.workunit.client.1.smithi135.stderr:103950K .......... .......... .......... .......... .......... 61% 496K 2m14s 2023-11-18T19:11:51.024 INFO:tasks.workunit.client.1.smithi135.stderr:104000K .......... .......... .......... .......... .......... 61% 443K 2m14s 2023-11-18T19:11:51.118 INFO:tasks.workunit.client.1.smithi135.stderr:104050K .......... .......... .......... .......... .......... 61% 463K 2m14s 2023-11-18T19:11:51.212 INFO:tasks.workunit.client.1.smithi135.stderr:104100K .......... .......... .......... .......... .......... 61% 531K 2m14s 2023-11-18T19:11:51.338 INFO:tasks.workunit.client.1.smithi135.stderr:104150K .......... .......... .......... .......... .......... 61% 397K 2m14s 2023-11-18T19:11:51.436 INFO:tasks.workunit.client.1.smithi135.stderr:104200K .......... .......... .......... .......... .......... 61% 507K 2m14s 2023-11-18T19:11:51.540 INFO:tasks.workunit.client.1.smithi135.stderr:104250K .......... .......... .......... .......... .......... 61% 498K 2m14s 2023-11-18T19:11:51.645 INFO:tasks.workunit.client.1.smithi135.stderr:104300K .......... .......... .......... .......... .......... 61% 459K 2m14s 2023-11-18T19:11:51.771 INFO:tasks.workunit.client.1.smithi135.stderr:104350K .......... .......... .......... .......... .......... 61% 399K 2m14s 2023-11-18T19:11:51.863 INFO:tasks.workunit.client.1.smithi135.stderr:104400K .......... .......... .......... .......... .......... 61% 543K 2m13s 2023-11-18T19:11:51.972 INFO:tasks.workunit.client.1.smithi135.stderr:104450K .......... .......... .......... .......... .......... 61% 461K 2m13s 2023-11-18T19:11:52.078 INFO:tasks.workunit.client.1.smithi135.stderr:104500K .......... .......... .......... .......... .......... 62% 471K 2m13s 2023-11-18T19:11:52.175 INFO:tasks.workunit.client.1.smithi135.stderr:104550K .......... .......... .......... .......... .......... 62% 512K 2m13s 2023-11-18T19:11:52.284 INFO:tasks.workunit.client.1.smithi135.stderr:104600K .......... .......... .......... .......... .......... 62% 462K 2m13s 2023-11-18T19:11:52.408 INFO:tasks.workunit.client.1.smithi135.stderr:104650K .......... .......... .......... .......... .......... 62% 402K 2m13s 2023-11-18T19:11:52.491 INFO:tasks.workunit.client.1.smithi135.stderr:104700K .......... .......... .......... .......... .......... 62% 608K 2m13s 2023-11-18T19:11:52.576 INFO:tasks.workunit.client.1.smithi135.stderr:104750K .......... .......... .......... .......... .......... 62% 581K 2m13s 2023-11-18T19:11:52.659 INFO:tasks.workunit.client.1.smithi135.stderr:104800K .......... .......... .......... .......... .......... 62% 607K 2m13s 2023-11-18T19:11:52.747 INFO:tasks.workunit.client.1.smithi135.stderr:104850K .......... .......... .......... .......... .......... 62% 560K 2m12s 2023-11-18T19:11:52.852 INFO:tasks.workunit.client.1.smithi135.stderr:104900K .......... .......... .......... .......... .......... 62% 481K 2m12s 2023-11-18T19:11:52.942 INFO:tasks.workunit.client.1.smithi135.stderr:104950K .......... .......... .......... .......... .......... 62% 552K 2m12s 2023-11-18T19:11:53.032 INFO:tasks.workunit.client.1.smithi135.stderr:105000K .......... .......... .......... .......... .......... 62% 555K 2m12s 2023-11-18T19:11:53.124 INFO:tasks.workunit.client.1.smithi135.stderr:105050K .......... .......... .......... .......... .......... 62% 544K 2m12s 2023-11-18T19:11:53.217 INFO:tasks.workunit.client.1.smithi135.stderr:105100K .......... .......... .......... .......... .......... 62% 541K 2m12s 2023-11-18T19:11:53.311 INFO:tasks.workunit.client.1.smithi135.stderr:105150K .......... .......... .......... .......... .......... 62% 540K 2m12s 2023-11-18T19:11:53.400 INFO:tasks.workunit.client.1.smithi135.stderr:105200K .......... .......... .......... .......... .......... 62% 547K 2m12s 2023-11-18T19:11:53.488 INFO:tasks.workunit.client.1.smithi135.stderr:105250K .......... .......... .......... .......... .......... 62% 629K 2m12s 2023-11-18T19:11:53.565 INFO:tasks.workunit.client.1.smithi135.stderr:105300K .......... .......... .......... .......... .......... 62% 586K 2m11s 2023-11-18T19:11:53.648 INFO:tasks.workunit.client.1.smithi135.stderr:105350K .......... .......... .......... .......... .......... 62% 600K 2m11s 2023-11-18T19:11:53.731 INFO:tasks.workunit.client.1.smithi135.stderr:105400K .......... .......... .......... .......... .......... 62% 605K 2m11s 2023-11-18T19:11:53.810 INFO:tasks.workunit.client.1.smithi135.stderr:105450K .......... .......... .......... .......... .......... 62% 635K 2m11s 2023-11-18T19:11:53.858 INFO:tasks.workunit.client.1.smithi135.stderr:105500K .......... .......... .......... .......... .......... 62% 1.00M 2m11s 2023-11-18T19:11:53.942 INFO:tasks.workunit.client.1.smithi135.stderr:105550K .......... .......... .......... .......... .......... 62% 599K 2m11s 2023-11-18T19:11:54.023 INFO:tasks.workunit.client.1.smithi135.stderr:105600K .......... .......... .......... .......... .......... 62% 617K 2m11s 2023-11-18T19:11:54.109 INFO:tasks.workunit.client.1.smithi135.stderr:105650K .......... .......... .......... .......... .......... 62% 579K 2m11s 2023-11-18T19:11:54.197 INFO:tasks.workunit.client.1.smithi135.stderr:105700K .......... .......... .......... .......... .......... 62% 571K 2m11s 2023-11-18T19:11:54.277 INFO:tasks.workunit.client.1.smithi135.stderr:105750K .......... .......... .......... .......... .......... 62% 625K 2m10s 2023-11-18T19:11:54.356 INFO:tasks.workunit.client.1.smithi135.stderr:105800K .......... .......... .......... .......... .......... 62% 631K 2m10s 2023-11-18T19:11:54.412 INFO:tasks.workunit.client.1.smithi135.stderr:105850K .......... .......... .......... .......... .......... 62% 895K 2m10s 2023-11-18T19:11:54.491 INFO:tasks.workunit.client.1.smithi135.stderr:105900K .......... .......... .......... .......... .......... 62% 634K 2m10s 2023-11-18T19:11:54.661 INFO:tasks.workunit.client.1.smithi135.stderr:105950K .......... .......... .......... .......... .......... 62% 296K 2m10s 2023-11-18T19:11:54.669 INFO:tasks.workunit.client.1.smithi135.stderr:106000K .......... .......... .......... .......... .......... 62% 11.5M 2m10s 2023-11-18T19:11:54.757 INFO:tasks.workunit.client.1.smithi135.stderr:106050K .......... .......... .......... .......... .......... 62% 556K 2m10s 2023-11-18T19:11:54.850 INFO:tasks.workunit.client.1.smithi135.stderr:106100K .......... .......... .......... .......... .......... 62% 523K 2m10s 2023-11-18T19:11:54.941 INFO:tasks.workunit.client.1.smithi135.stderr:106150K .......... .......... .......... .......... .......... 63% 586K 2m9s 2023-11-18T19:11:55.031 INFO:tasks.workunit.client.1.smithi135.stderr:106200K .......... .......... .......... .......... .......... 63% 523K 2m9s 2023-11-18T19:11:55.083 INFO:tasks.workunit.client.0.smithi045.stdout: 28 8519 22 5851 34 3578 56 2023-11-18T19:11:55.125 INFO:tasks.workunit.client.1.smithi135.stderr:106250K .......... .......... .......... .......... .......... 63% 529K 2m9s 2023-11-18T19:11:55.219 INFO:tasks.workunit.client.1.smithi135.stderr:106300K .......... .......... .......... .......... .......... 63% 534K 2m9s 2023-11-18T19:11:55.303 INFO:tasks.workunit.client.1.smithi135.stderr:106350K .......... .......... .......... .......... .......... 63% 593K 2m9s 2023-11-18T19:11:55.396 INFO:tasks.workunit.client.1.smithi135.stderr:106400K .......... .......... .......... .......... .......... 63% 541K 2m9s 2023-11-18T19:11:55.489 INFO:tasks.workunit.client.1.smithi135.stderr:106450K .......... .......... .......... .......... .......... 63% 537K 2m9s 2023-11-18T19:11:55.625 INFO:tasks.workunit.client.1.smithi135.stderr:106500K .......... .......... .......... .......... .......... 63% 368K 2m9s 2023-11-18T19:11:55.726 INFO:tasks.workunit.client.1.smithi135.stderr:106550K .......... .......... .......... .......... .......... 63% 540K 2m9s 2023-11-18T19:11:55.842 INFO:tasks.workunit.client.1.smithi135.stderr:106600K .......... .......... .......... .......... .......... 63% 478K 2m9s 2023-11-18T19:11:55.939 INFO:tasks.workunit.client.1.smithi135.stderr:106650K .......... .......... .......... .......... .......... 63% 425K 2m8s 2023-11-18T19:11:56.046 INFO:tasks.workunit.client.1.smithi135.stderr:106700K .......... .......... .......... .......... .......... 63% 469K 2m8s 2023-11-18T19:11:56.192 INFO:tasks.workunit.client.1.smithi135.stderr:106750K .......... .......... .......... .......... .......... 63% 344K 2m8s 2023-11-18T19:11:56.286 INFO:tasks.workunit.client.1.smithi135.stderr:106800K .......... .......... .......... .......... .......... 63% 526K 2m8s 2023-11-18T19:11:56.377 INFO:tasks.workunit.client.1.smithi135.stderr:106850K .......... .......... .......... .......... .......... 63% 553K 2m8s 2023-11-18T19:11:56.477 INFO:tasks.workunit.client.1.smithi135.stderr:106900K .......... .......... .......... .......... .......... 63% 499K 2m8s 2023-11-18T19:11:56.585 INFO:tasks.workunit.client.1.smithi135.stderr:106950K .......... .......... .......... .......... .......... 63% 571K 2m8s 2023-11-18T19:11:56.674 INFO:tasks.workunit.client.1.smithi135.stderr:107000K .......... .......... .......... .......... .......... 63% 457K 2m8s 2023-11-18T19:11:56.777 INFO:tasks.workunit.client.1.smithi135.stderr:107050K .......... .......... .......... .......... .......... 63% 564K 2m8s 2023-11-18T19:11:56.907 INFO:tasks.workunit.client.1.smithi135.stderr:107100K .......... .......... .......... .......... .......... 63% 346K 2m7s 2023-11-18T19:11:56.997 INFO:tasks.workunit.client.1.smithi135.stderr:107150K .......... .......... .......... .......... .......... 63% 559K 2m7s 2023-11-18T19:11:57.084 INFO:tasks.workunit.client.1.smithi135.stderr:107200K .......... .......... .......... .......... .......... 63% 575K 2m7s 2023-11-18T19:11:57.170 INFO:tasks.workunit.client.1.smithi135.stderr:107250K .......... .......... .......... .......... .......... 63% 581K 2m7s 2023-11-18T19:11:57.257 INFO:tasks.workunit.client.1.smithi135.stderr:107300K .......... .......... .......... .......... .......... 63% 571K 2m7s 2023-11-18T19:11:57.343 INFO:tasks.workunit.client.1.smithi135.stderr:107350K .......... .......... .......... .......... .......... 63% 581K 2m7s 2023-11-18T19:11:57.436 INFO:tasks.workunit.client.1.smithi135.stderr:107400K .......... .......... .......... .......... .......... 63% 542K 2m7s 2023-11-18T19:11:57.528 INFO:tasks.workunit.client.1.smithi135.stderr:107450K .......... .......... .......... .......... .......... 63% 541K 2m7s 2023-11-18T19:11:57.617 INFO:tasks.workunit.client.1.smithi135.stderr:107500K .......... .......... .......... .......... .......... 63% 564K 2m7s 2023-11-18T19:11:57.709 INFO:tasks.workunit.client.1.smithi135.stderr:107550K .......... .......... .......... .......... .......... 63% 540K 2m6s 2023-11-18T19:11:57.798 INFO:tasks.workunit.client.1.smithi135.stderr:107600K .......... .......... .......... .......... .......... 63% 561K 2m6s 2023-11-18T19:11:57.888 INFO:tasks.workunit.client.1.smithi135.stderr:107650K .......... .......... .......... .......... .......... 63% 556K 2m6s 2023-11-18T19:11:57.954 INFO:tasks.workunit.client.1.smithi135.stderr:107700K .......... .......... .......... .......... .......... 63% 758K 2m6s 2023-11-18T19:11:58.031 INFO:tasks.workunit.client.1.smithi135.stderr:107750K .......... .......... .......... .......... .......... 63% 673K 2m6s 2023-11-18T19:11:58.115 INFO:tasks.workunit.client.1.smithi135.stderr:107800K .......... .......... .......... .......... .......... 63% 580K 2m6s 2023-11-18T19:11:58.195 INFO:tasks.workunit.client.1.smithi135.stderr:107850K .......... .......... .......... .......... .......... 64% 633K 2m6s 2023-11-18T19:11:58.276 INFO:tasks.workunit.client.1.smithi135.stderr:107900K .......... .......... .......... .......... .......... 64% 611K 2m6s 2023-11-18T19:11:58.350 INFO:tasks.workunit.client.1.smithi135.stderr:107950K .......... .......... .......... .......... .......... 64% 679K 2m6s 2023-11-18T19:11:58.421 INFO:tasks.workunit.client.1.smithi135.stderr:108000K .......... .......... .......... .......... .......... 64% 692K 2m5s 2023-11-18T19:11:58.509 INFO:tasks.workunit.client.1.smithi135.stderr:108050K .......... .......... .......... .......... .......... 64% 573K 2m5s 2023-11-18T19:11:58.600 INFO:tasks.workunit.client.1.smithi135.stderr:108100K .......... .......... .......... .......... .......... 64% 552K 2m5s 2023-11-18T19:11:58.645 INFO:tasks.workunit.client.1.smithi135.stderr:108150K .......... .......... .......... .......... .......... 64% 1.06M 2m5s 2023-11-18T19:11:58.722 INFO:tasks.workunit.client.1.smithi135.stderr:108200K .......... .......... .......... .......... .......... 64% 659K 2m5s 2023-11-18T19:11:58.796 INFO:tasks.workunit.client.1.smithi135.stderr:108250K .......... .......... .......... .......... .......... 64% 669K 2m5s 2023-11-18T19:11:58.876 INFO:tasks.workunit.client.1.smithi135.stderr:108300K .......... .......... .......... .......... .......... 64% 625K 2m5s 2023-11-18T19:11:58.964 INFO:tasks.workunit.client.1.smithi135.stderr:108350K .......... .......... .......... .......... .......... 64% 572K 2m5s 2023-11-18T19:11:59.032 INFO:tasks.workunit.client.1.smithi135.stderr:108400K .......... .......... .......... .......... .......... 64% 996K 2m4s 2023-11-18T19:11:59.091 INFO:tasks.workunit.client.1.smithi135.stderr:108450K .......... .......... .......... .......... .......... 64% 646K 2m4s 2023-11-18T19:11:59.165 INFO:tasks.workunit.client.1.smithi135.stderr:108500K .......... .......... .......... .......... .......... 64% 673K 2m4s 2023-11-18T19:11:59.242 INFO:tasks.workunit.client.1.smithi135.stderr:108550K .......... .......... .......... .......... .......... 64% 657K 2m4s 2023-11-18T19:11:59.327 INFO:tasks.workunit.client.1.smithi135.stderr:108600K .......... .......... .......... .......... .......... 64% 586K 2m4s 2023-11-18T19:11:59.371 INFO:tasks.workunit.client.1.smithi135.stderr:108650K .......... .......... .......... .......... .......... 64% 1.16M 2m4s 2023-11-18T19:11:59.446 INFO:tasks.workunit.client.1.smithi135.stderr:108700K .......... .......... .......... .......... .......... 64% 655K 2m4s 2023-11-18T19:11:59.527 INFO:tasks.workunit.client.1.smithi135.stderr:108750K .......... .......... .......... .......... .......... 64% 732K 2m4s 2023-11-18T19:11:59.603 INFO:tasks.workunit.client.1.smithi135.stderr:108800K .......... .......... .......... .......... .......... 64% 558K 2m4s 2023-11-18T19:11:59.647 INFO:tasks.workunit.client.1.smithi135.stderr:108850K .......... .......... .......... .......... .......... 64% 1.14M 2m3s 2023-11-18T19:11:59.727 INFO:tasks.workunit.client.1.smithi135.stderr:108900K .......... .......... .......... .......... .......... 64% 617K 2m3s 2023-11-18T19:11:59.848 INFO:tasks.workunit.client.1.smithi135.stderr:108950K .......... .......... .......... .......... .......... 64% 414K 2m3s 2023-11-18T19:11:59.880 INFO:tasks.workunit.client.1.smithi135.stderr:109000K .......... .......... .......... .......... .......... 64% 1.53M 2m3s 2023-11-18T19:11:59.967 INFO:tasks.workunit.client.1.smithi135.stderr:109050K .......... .......... .......... .......... .......... 64% 608K 2m3s 2023-11-18T19:12:00.049 INFO:tasks.workunit.client.1.smithi135.stderr:109100K .......... .......... .......... .......... .......... 64% 580K 2m3s 2023-11-18T19:12:00.134 INFO:tasks.workunit.client.1.smithi135.stderr:109150K .......... .......... .......... .......... .......... 64% 605K 2m3s 2023-11-18T19:12:00.216 INFO:tasks.workunit.client.1.smithi135.stderr:109200K .......... .......... .......... .......... .......... 64% 587K 2m3s 2023-11-18T19:12:00.307 INFO:tasks.workunit.client.1.smithi135.stderr:109250K .......... .......... .......... .......... .......... 64% 558K 2m2s 2023-11-18T19:12:00.397 INFO:tasks.workunit.client.1.smithi135.stderr:109300K .......... .......... .......... .......... .......... 64% 549K 2m2s 2023-11-18T19:12:00.485 INFO:tasks.workunit.client.1.smithi135.stderr:109350K .......... .......... .......... .......... .......... 64% 569K 2m2s 2023-11-18T19:12:00.549 INFO:tasks.workunit.client.1.smithi135.stderr:109400K .......... .......... .......... .......... .......... 64% 784K 2m2s 2023-11-18T19:12:00.615 INFO:tasks.workunit.client.1.smithi135.stderr:109450K .......... .......... .......... .......... .......... 64% 753K 2m2s 2023-11-18T19:12:00.698 INFO:tasks.workunit.client.1.smithi135.stderr:109500K .......... .......... .......... .......... .......... 64% 605K 2m2s 2023-11-18T19:12:00.782 INFO:tasks.workunit.client.1.smithi135.stderr:109550K .......... .......... .......... .......... .......... 65% 593K 2m2s 2023-11-18T19:12:00.972 INFO:tasks.workunit.client.1.smithi135.stderr:109600K .......... .......... .......... .......... .......... 65% 264K 2m2s 2023-11-18T19:12:01.034 INFO:tasks.workunit.client.1.smithi135.stderr:109650K .......... .......... .......... .......... .......... 65% 809K 2m2s 2023-11-18T19:12:01.039 INFO:tasks.workunit.client.1.smithi135.stderr:109700K .......... .......... .......... .......... .......... 65% 21.5M 2m1s 2023-11-18T19:12:01.134 INFO:tasks.workunit.client.1.smithi135.stderr:109750K .......... .......... .......... .......... .......... 65% 529K 2m1s 2023-11-18T19:12:01.222 INFO:tasks.workunit.client.1.smithi135.stderr:109800K .......... .......... .......... .......... .......... 65% 541K 2m1s 2023-11-18T19:12:01.320 INFO:tasks.workunit.client.1.smithi135.stderr:109850K .......... .......... .......... .......... .......... 65% 512K 2m1s 2023-11-18T19:12:01.409 INFO:tasks.workunit.client.1.smithi135.stderr:109900K .......... .......... .......... .......... .......... 65% 561K 2m1s 2023-11-18T19:12:01.528 INFO:tasks.workunit.client.1.smithi135.stderr:109950K .......... .......... .......... .......... .......... 65% 565K 2m1s 2023-11-18T19:12:01.607 INFO:tasks.workunit.client.1.smithi135.stderr:110000K .......... .......... .......... .......... .......... 65% 457K 2m1s 2023-11-18T19:12:01.688 INFO:tasks.workunit.client.1.smithi135.stderr:110050K .......... .......... .......... .......... .......... 65% 619K 2m1s 2023-11-18T19:12:01.767 INFO:tasks.workunit.client.1.smithi135.stderr:110100K .......... .......... .......... .......... .......... 65% 630K 2m1s 2023-11-18T19:12:01.849 INFO:tasks.workunit.client.1.smithi135.stderr:110150K .......... .......... .......... .......... .......... 65% 619K 2m0s 2023-11-18T19:12:01.929 INFO:tasks.workunit.client.1.smithi135.stderr:110200K .......... .......... .......... .......... .......... 65% 615K 2m0s 2023-11-18T19:12:02.025 INFO:tasks.workunit.client.1.smithi135.stderr:110250K .......... .......... .......... .......... .......... 65% 520K 2m0s 2023-11-18T19:12:02.112 INFO:tasks.workunit.client.1.smithi135.stderr:110300K .......... .......... .......... .......... .......... 65% 580K 2m0s 2023-11-18T19:12:02.188 INFO:tasks.workunit.client.1.smithi135.stderr:110350K .......... .......... .......... .......... .......... 65% 654K 2m0s 2023-11-18T19:12:02.264 INFO:tasks.workunit.client.1.smithi135.stderr:110400K .......... .......... .......... .......... .......... 65% 939K 2m0s 2023-11-18T19:12:02.320 INFO:tasks.workunit.client.1.smithi135.stderr:110450K .......... .......... .......... .......... .......... 65% 635K 2m0s 2023-11-18T19:12:02.403 INFO:tasks.workunit.client.1.smithi135.stderr:110500K .......... .......... .......... .......... .......... 65% 604K 2m0s 2023-11-18T19:12:02.479 INFO:tasks.workunit.client.1.smithi135.stderr:110550K .......... .......... .......... .......... .......... 65% 655K 2m0s 2023-11-18T19:12:02.566 INFO:tasks.workunit.client.1.smithi135.stderr:110600K .......... .......... .......... .......... .......... 65% 592K 1m59s 2023-11-18T19:12:02.651 INFO:tasks.workunit.client.1.smithi135.stderr:110650K .......... .......... .......... .......... .......... 65% 572K 1m59s 2023-11-18T19:12:02.732 INFO:tasks.workunit.client.1.smithi135.stderr:110700K .......... .......... .......... .......... .......... 65% 620K 1m59s 2023-11-18T19:12:02.786 INFO:tasks.workunit.client.1.smithi135.stderr:110750K .......... .......... .......... .......... .......... 65% 928K 1m59s 2023-11-18T19:12:02.864 INFO:tasks.workunit.client.1.smithi135.stderr:110800K .......... .......... .......... .......... .......... 65% 638K 1m59s 2023-11-18T19:12:02.945 INFO:tasks.workunit.client.1.smithi135.stderr:110850K .......... .......... .......... .......... .......... 65% 638K 1m59s 2023-11-18T19:12:03.028 INFO:tasks.workunit.client.1.smithi135.stderr:110900K .......... .......... .......... .......... .......... 65% 586K 1m59s 2023-11-18T19:12:03.100 INFO:tasks.workunit.client.1.smithi135.stderr:110950K .......... .......... .......... .......... .......... 65% 701K 1m59s 2023-11-18T19:12:03.275 INFO:tasks.workunit.client.1.smithi135.stderr:111000K .......... .......... .......... .......... .......... 65% 286K 1m59s 2023-11-18T19:12:03.294 INFO:tasks.workunit.client.1.smithi135.stderr:111050K .......... .......... .......... .......... .......... 65% 2.50M 1m58s 2023-11-18T19:12:03.369 INFO:tasks.workunit.client.1.smithi135.stderr:111100K .......... .......... .......... .......... .......... 65% 668K 1m58s 2023-11-18T19:12:03.437 INFO:tasks.workunit.client.1.smithi135.stderr:111150K .......... .......... .......... .......... .......... 65% 732K 1m58s 2023-11-18T19:12:03.540 INFO:tasks.workunit.client.1.smithi135.stderr:111200K .......... .......... .......... .......... .......... 65% 487K 1m58s 2023-11-18T19:12:03.614 INFO:tasks.workunit.client.1.smithi135.stderr:111250K .......... .......... .......... .......... .......... 66% 669K 1m58s 2023-11-18T19:12:03.703 INFO:tasks.workunit.client.1.smithi135.stderr:111300K .......... .......... .......... .......... .......... 66% 566K 1m58s 2023-11-18T19:12:03.791 INFO:tasks.workunit.client.1.smithi135.stderr:111350K .......... .......... .......... .......... .......... 66% 563K 1m58s 2023-11-18T19:12:03.868 INFO:tasks.workunit.client.1.smithi135.stderr:111400K .......... .......... .......... .......... .......... 66% 649K 1m58s 2023-11-18T19:12:03.947 INFO:tasks.workunit.client.1.smithi135.stderr:111450K .......... .......... .......... .......... .......... 66% 637K 1m57s 2023-11-18T19:12:04.025 INFO:tasks.workunit.client.1.smithi135.stderr:111500K .......... .......... .......... .......... .......... 66% 643K 1m57s 2023-11-18T19:12:04.106 INFO:tasks.workunit.client.1.smithi135.stderr:111550K .......... .......... .......... .......... .......... 66% 620K 1m57s 2023-11-18T19:12:04.191 INFO:tasks.workunit.client.1.smithi135.stderr:111600K .......... .......... .......... .......... .......... 66% 581K 1m57s 2023-11-18T19:12:04.374 INFO:tasks.workunit.client.1.smithi135.stderr:111650K .......... .......... .......... .......... .......... 66% 274K 1m57s 2023-11-18T19:12:04.394 INFO:tasks.workunit.client.1.smithi135.stderr:111700K .......... .......... .......... .......... .......... 66% 2.38M 1m57s 2023-11-18T19:12:04.488 INFO:tasks.workunit.client.1.smithi135.stderr:111750K .......... .......... .......... .......... .......... 66% 528K 1m57s 2023-11-18T19:12:04.569 INFO:tasks.workunit.client.1.smithi135.stderr:111800K .......... .......... .......... .......... .......... 66% 620K 1m57s 2023-11-18T19:12:04.658 INFO:tasks.workunit.client.1.smithi135.stderr:111850K .......... .......... .......... .......... .......... 66% 564K 1m57s 2023-11-18T19:12:04.728 INFO:tasks.workunit.client.1.smithi135.stderr:111900K .......... .......... .......... .......... .......... 66% 714K 1m56s 2023-11-18T19:12:04.842 INFO:tasks.workunit.client.1.smithi135.stderr:111950K .......... .......... .......... .......... .......... 66% 474K 1m56s 2023-11-18T19:12:04.935 INFO:tasks.workunit.client.1.smithi135.stderr:112000K .......... .......... .......... .......... .......... 66% 497K 1m56s 2023-11-18T19:12:05.008 INFO:tasks.workunit.client.1.smithi135.stderr:112050K .......... .......... .......... .......... .......... 66% 678K 1m56s 2023-11-18T19:12:05.083 INFO:tasks.workunit.client.0.smithi045.stdout: 28 9420 19 6041 26 4146 65 2023-11-18T19:12:05.113 INFO:tasks.workunit.client.1.smithi135.stderr:112100K .......... .......... .......... .......... .......... 66% 474K 1m56s 2023-11-18T19:12:05.187 INFO:tasks.workunit.client.1.smithi135.stderr:112150K .......... .......... .......... .......... .......... 66% 672K 1m56s 2023-11-18T19:12:05.273 INFO:tasks.workunit.client.1.smithi135.stderr:112200K .......... .......... .......... .......... .......... 66% 605K 1m56s 2023-11-18T19:12:05.377 INFO:tasks.workunit.client.1.smithi135.stderr:112250K .......... .......... .......... .......... .......... 66% 468K 1m56s 2023-11-18T19:12:05.467 INFO:tasks.workunit.client.1.smithi135.stderr:112300K .......... .......... .......... .......... .......... 66% 589K 1m56s 2023-11-18T19:12:05.550 INFO:tasks.workunit.client.1.smithi135.stderr:112350K .......... .......... .......... .......... .......... 66% 567K 1m55s 2023-11-18T19:12:05.634 INFO:tasks.workunit.client.1.smithi135.stderr:112400K .......... .......... .......... .......... .......... 66% 599K 1m55s 2023-11-18T19:12:05.718 INFO:tasks.workunit.client.1.smithi135.stderr:112450K .......... .......... .......... .......... .......... 66% 589K 1m55s 2023-11-18T19:12:05.805 INFO:tasks.workunit.client.1.smithi135.stderr:112500K .......... .......... .......... .......... .......... 66% 581K 1m55s 2023-11-18T19:12:05.893 INFO:tasks.workunit.client.1.smithi135.stderr:112550K .......... .......... .......... .......... .......... 66% 565K 1m55s 2023-11-18T19:12:05.978 INFO:tasks.workunit.client.1.smithi135.stderr:112600K .......... .......... .......... .......... .......... 66% 587K 1m55s 2023-11-18T19:12:06.070 INFO:tasks.workunit.client.1.smithi135.stderr:112650K .......... .......... .......... .......... .......... 66% 561K 1m55s 2023-11-18T19:12:06.156 INFO:tasks.workunit.client.1.smithi135.stderr:112700K .......... .......... .......... .......... .......... 66% 563K 1m55s 2023-11-18T19:12:06.244 INFO:tasks.workunit.client.1.smithi135.stderr:112750K .......... .......... .......... .......... .......... 66% 573K 1m55s 2023-11-18T19:12:06.330 INFO:tasks.workunit.client.1.smithi135.stderr:112800K .......... .......... .......... .......... .......... 66% 581K 1m54s 2023-11-18T19:12:06.423 INFO:tasks.workunit.client.1.smithi135.stderr:112850K .......... .......... .......... .......... .......... 66% 601K 1m54s 2023-11-18T19:12:06.503 INFO:tasks.workunit.client.1.smithi135.stderr:112900K .......... .......... .......... .......... .......... 67% 555K 1m54s 2023-11-18T19:12:06.568 INFO:tasks.workunit.client.1.smithi135.stderr:112950K .......... .......... .......... .......... .......... 67% 774K 1m54s 2023-11-18T19:12:06.658 INFO:tasks.workunit.client.1.smithi135.stderr:113000K .......... .......... .......... .......... .......... 67% 552K 1m54s 2023-11-18T19:12:06.744 INFO:tasks.workunit.client.1.smithi135.stderr:113050K .......... .......... .......... .......... .......... 67% 583K 1m54s 2023-11-18T19:12:06.819 INFO:tasks.workunit.client.1.smithi135.stderr:113100K .......... .......... .......... .......... .......... 67% 668K 1m54s 2023-11-18T19:12:06.897 INFO:tasks.workunit.client.1.smithi135.stderr:113150K .......... .......... .......... .......... .......... 67% 643K 1m54s 2023-11-18T19:12:06.953 INFO:tasks.workunit.client.1.smithi135.stderr:113200K .......... .......... .......... .......... .......... 67% 907K 1m54s 2023-11-18T19:12:07.031 INFO:tasks.workunit.client.1.smithi135.stderr:113250K .......... .......... .......... .......... .......... 67% 631K 1m53s 2023-11-18T19:12:07.099 INFO:tasks.workunit.client.1.smithi135.stderr:113300K .......... .......... .......... .......... .......... 67% 734K 1m53s 2023-11-18T19:12:07.161 INFO:tasks.workunit.client.1.smithi135.stderr:113350K .......... .......... .......... .......... .......... 67% 810K 1m53s 2023-11-18T19:12:07.249 INFO:tasks.workunit.client.1.smithi135.stderr:113400K .......... .......... .......... .......... .......... 67% 568K 1m53s 2023-11-18T19:12:07.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:12:07.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:12:07.322 INFO:tasks.workunit.client.1.smithi135.stderr:113450K .......... .......... .......... .......... .......... 67% 684K 1m53s 2023-11-18T19:12:07.389 INFO:tasks.workunit.client.1.smithi135.stderr:113500K .......... .......... .......... .......... .......... 67% 746K 1m53s 2023-11-18T19:12:07.467 INFO:tasks.workunit.client.1.smithi135.stderr:113550K .......... .......... .......... .......... .......... 67% 749K 1m53s 2023-11-18T19:12:07.518 INFO:tasks.workunit.client.1.smithi135.stderr:113600K .......... .......... .......... .......... .......... 67% 801K 1m53s 2023-11-18T19:12:07.598 INFO:tasks.workunit.client.1.smithi135.stderr:113650K .......... .......... .......... .......... .......... 67% 625K 1m52s 2023-11-18T19:12:07.670 INFO:tasks.workunit.client.1.smithi135.stderr:113700K .......... .......... .......... .......... .......... 67% 701K 1m52s 2023-11-18T19:12:07.738 INFO:tasks.workunit.client.1.smithi135.stderr:113750K .......... .......... .......... .......... .......... 67% 762K 1m52s 2023-11-18T19:12:07.917 INFO:tasks.workunit.client.1.smithi135.stderr:113800K .......... .......... .......... .......... .......... 67% 277K 1m52s 2023-11-18T19:12:07.917 INFO:tasks.workunit.client.1.smithi135.stderr:113850K .......... .......... .......... .......... .......... 67% 46.0M 1m52s 2023-11-18T19:12:07.964 INFO:tasks.workunit.client.1.smithi135.stderr:113900K .......... .......... .......... .......... .......... 67% 1.02M 1m52s 2023-11-18T19:12:08.059 INFO:tasks.workunit.client.1.smithi135.stderr:113950K .......... .......... .......... .......... .......... 67% 529K 1m52s 2023-11-18T19:12:08.135 INFO:tasks.workunit.client.1.smithi135.stderr:114000K .......... .......... .......... .......... .......... 67% 656K 1m52s 2023-11-18T19:12:08.215 INFO:tasks.workunit.client.1.smithi135.stderr:114050K .......... .......... .......... .......... .......... 67% 626K 1m52s 2023-11-18T19:12:08.294 INFO:tasks.workunit.client.1.smithi135.stderr:114100K .......... .......... .......... .......... .......... 67% 626K 1m51s 2023-11-18T19:12:08.385 INFO:tasks.workunit.client.1.smithi135.stderr:114150K .......... .......... .......... .......... .......... 67% 554K 1m51s 2023-11-18T19:12:08.457 INFO:tasks.workunit.client.1.smithi135.stderr:114200K .......... .......... .......... .......... .......... 67% 696K 1m51s 2023-11-18T19:12:08.540 INFO:tasks.workunit.client.1.smithi135.stderr:114250K .......... .......... .......... .......... .......... 67% 602K 1m51s 2023-11-18T19:12:08.617 INFO:tasks.workunit.client.1.smithi135.stderr:114300K .......... .......... .......... .......... .......... 67% 643K 1m51s 2023-11-18T19:12:08.701 INFO:tasks.workunit.client.1.smithi135.stderr:114350K .......... .......... .......... .......... .......... 67% 599K 1m51s 2023-11-18T19:12:08.780 INFO:tasks.workunit.client.1.smithi135.stderr:114400K .......... .......... .......... .......... .......... 67% 634K 1m51s 2023-11-18T19:12:08.871 INFO:tasks.workunit.client.1.smithi135.stderr:114450K .......... .......... .......... .......... .......... 67% 794K 1m51s 2023-11-18T19:12:08.920 INFO:tasks.workunit.client.1.smithi135.stderr:114500K .......... .......... .......... .......... .......... 67% 644K 1m51s 2023-11-18T19:12:09.004 INFO:tasks.workunit.client.1.smithi135.stderr:114550K .......... .......... .......... .......... .......... 67% 604K 1m50s 2023-11-18T19:12:09.060 INFO:tasks.workunit.client.1.smithi135.stderr:114600K .......... .......... .......... .......... .......... 68% 880K 1m50s 2023-11-18T19:12:09.123 INFO:tasks.workunit.client.1.smithi135.stderr:114650K .......... .......... .......... .......... .......... 68% 815K 1m50s 2023-11-18T19:12:09.183 INFO:tasks.workunit.client.1.smithi135.stderr:114700K .......... .......... .......... .......... .......... 68% 807K 1m50s 2023-11-18T19:12:09.244 INFO:tasks.workunit.client.1.smithi135.stderr:114750K .......... .......... .......... .......... .......... 68% 826K 1m50s 2023-11-18T19:12:09.305 INFO:tasks.workunit.client.1.smithi135.stderr:114800K .......... .......... .......... .......... .......... 68% 808K 1m50s 2023-11-18T19:12:09.360 INFO:tasks.workunit.client.1.smithi135.stderr:114850K .......... .......... .......... .......... .......... 68% 922K 1m50s 2023-11-18T19:12:09.433 INFO:tasks.workunit.client.1.smithi135.stderr:114900K .......... .......... .......... .......... .......... 68% 710K 1m50s 2023-11-18T19:12:09.511 INFO:tasks.workunit.client.1.smithi135.stderr:114950K .......... .......... .......... .......... .......... 68% 616K 1m49s 2023-11-18T19:12:09.585 INFO:tasks.workunit.client.1.smithi135.stderr:115000K .......... .......... .......... .......... .......... 68% 751K 1m49s 2023-11-18T19:12:09.634 INFO:tasks.workunit.client.1.smithi135.stderr:115050K .......... .......... .......... .......... .......... 68% 892K 1m49s 2023-11-18T19:12:09.692 INFO:tasks.workunit.client.1.smithi135.stderr:115100K .......... .......... .......... .......... .......... 68% 867K 1m49s 2023-11-18T19:12:09.767 INFO:tasks.workunit.client.1.smithi135.stderr:115150K .......... .......... .......... .......... .......... 68% 664K 1m49s 2023-11-18T19:12:09.843 INFO:tasks.workunit.client.1.smithi135.stderr:115200K .......... .......... .......... .......... .......... 68% 657K 1m49s 2023-11-18T19:12:09.887 INFO:tasks.workunit.client.1.smithi135.stderr:115250K .......... .......... .......... .......... .......... 68% 1.10M 1m49s 2023-11-18T19:12:09.950 INFO:tasks.workunit.client.1.smithi135.stderr:115300K .......... .......... .......... .......... .......... 68% 794K 1m49s 2023-11-18T19:12:10.028 INFO:tasks.workunit.client.1.smithi135.stderr:115350K .......... .......... .......... .......... .......... 68% 647K 1m49s 2023-11-18T19:12:10.243 INFO:tasks.workunit.client.1.smithi135.stderr:115400K .......... .......... .......... .......... .......... 68% 234K 1m48s 2023-11-18T19:12:10.243 INFO:tasks.workunit.client.1.smithi135.stderr:115450K .......... .......... .......... .......... .......... 68% 42.6M 1m48s 2023-11-18T19:12:10.346 INFO:tasks.workunit.client.1.smithi135.stderr:115500K .......... .......... .......... .......... .......... 68% 487K 1m48s 2023-11-18T19:12:10.420 INFO:tasks.workunit.client.1.smithi135.stderr:115550K .......... .......... .......... .......... .......... 68% 665K 1m48s 2023-11-18T19:12:10.544 INFO:tasks.workunit.client.1.smithi135.stderr:115600K .......... .......... .......... .......... .......... 68% 405K 1m48s 2023-11-18T19:12:10.642 INFO:tasks.workunit.client.1.smithi135.stderr:115650K .......... .......... .......... .......... .......... 68% 509K 1m48s 2023-11-18T19:12:10.773 INFO:tasks.workunit.client.1.smithi135.stderr:115700K .......... .......... .......... .......... .......... 68% 381K 1m48s 2023-11-18T19:12:10.868 INFO:tasks.workunit.client.1.smithi135.stderr:115750K .......... .......... .......... .......... .......... 68% 526K 1m48s 2023-11-18T19:12:10.993 INFO:tasks.workunit.client.1.smithi135.stderr:115800K .......... .......... .......... .......... .......... 68% 434K 1m48s 2023-11-18T19:12:11.092 INFO:tasks.workunit.client.1.smithi135.stderr:115850K .......... .......... .......... .......... .......... 68% 462K 1m48s 2023-11-18T19:12:11.205 INFO:tasks.workunit.client.1.smithi135.stderr:115900K .......... .......... .......... .......... .......... 68% 478K 1m47s 2023-11-18T19:12:11.343 INFO:tasks.workunit.client.1.smithi135.stderr:115950K .......... .......... .......... .......... .......... 68% 342K 1m47s 2023-11-18T19:12:11.443 INFO:tasks.workunit.client.1.smithi135.stderr:116000K .......... .......... .......... .......... .......... 68% 554K 1m47s 2023-11-18T19:12:11.530 INFO:tasks.workunit.client.1.smithi135.stderr:116050K .......... .......... .......... .......... .......... 68% 513K 1m47s 2023-11-18T19:12:11.654 INFO:tasks.workunit.client.1.smithi135.stderr:116100K .......... .......... .......... .......... .......... 68% 402K 1m47s 2023-11-18T19:12:11.767 INFO:tasks.workunit.client.1.smithi135.stderr:116150K .......... .......... .......... .......... .......... 68% 444K 1m47s 2023-11-18T19:12:11.931 INFO:tasks.workunit.client.1.smithi135.stderr:116200K .......... .......... .......... .......... .......... 68% 306K 1m47s 2023-11-18T19:12:12.013 INFO:tasks.workunit.client.1.smithi135.stderr:116250K .......... .......... .......... .......... .......... 68% 613K 1m47s 2023-11-18T19:12:12.141 INFO:tasks.workunit.client.1.smithi135.stderr:116300K .......... .......... .......... .......... .......... 69% 390K 1m47s 2023-11-18T19:12:12.280 INFO:tasks.workunit.client.1.smithi135.stderr:116350K .......... .......... .......... .......... .......... 69% 364K 1m47s 2023-11-18T19:12:12.407 INFO:tasks.workunit.client.1.smithi135.stderr:116400K .......... .......... .......... .......... .......... 69% 385K 1m46s 2023-11-18T19:12:12.519 INFO:tasks.workunit.client.1.smithi135.stderr:116450K .......... .......... .......... .......... .......... 69% 448K 1m46s 2023-11-18T19:12:12.645 INFO:tasks.workunit.client.1.smithi135.stderr:116500K .......... .......... .......... .......... .......... 69% 400K 1m46s 2023-11-18T19:12:12.726 INFO:tasks.workunit.client.1.smithi135.stderr:116550K .......... .......... .......... .......... .......... 69% 613K 1m46s 2023-11-18T19:12:12.833 INFO:tasks.workunit.client.1.smithi135.stderr:116600K .......... .......... .......... .......... .......... 69% 501K 1m46s 2023-11-18T19:12:12.959 INFO:tasks.workunit.client.1.smithi135.stderr:116650K .......... .......... .......... .......... .......... 69% 376K 1m46s 2023-11-18T19:12:13.070 INFO:tasks.workunit.client.1.smithi135.stderr:116700K .......... .......... .......... .......... .......... 69% 452K 1m46s 2023-11-18T19:12:13.151 INFO:tasks.workunit.client.1.smithi135.stderr:116750K .......... .......... .......... .......... .......... 69% 616K 1m46s 2023-11-18T19:12:13.239 INFO:tasks.workunit.client.1.smithi135.stderr:116800K .......... .......... .......... .......... .......... 69% 607K 1m46s 2023-11-18T19:12:13.340 INFO:tasks.workunit.client.1.smithi135.stderr:116850K .......... .......... .......... .......... .......... 69% 470K 1m46s 2023-11-18T19:12:13.448 INFO:tasks.workunit.client.1.smithi135.stderr:116900K .......... .......... .......... .......... .......... 69% 466K 1m45s 2023-11-18T19:12:13.540 INFO:tasks.workunit.client.1.smithi135.stderr:116950K .......... .......... .......... .......... .......... 69% 534K 1m45s 2023-11-18T19:12:13.622 INFO:tasks.workunit.client.1.smithi135.stderr:117000K .......... .......... .......... .......... .......... 69% 609K 1m45s 2023-11-18T19:12:13.721 INFO:tasks.workunit.client.1.smithi135.stderr:117050K .......... .......... .......... .......... .......... 69% 582K 1m45s 2023-11-18T19:12:13.808 INFO:tasks.workunit.client.1.smithi135.stderr:117100K .......... .......... .......... .......... .......... 69% 503K 1m45s 2023-11-18T19:12:13.921 INFO:tasks.workunit.client.1.smithi135.stderr:117150K .......... .......... .......... .......... .......... 69% 445K 1m45s 2023-11-18T19:12:14.011 INFO:tasks.workunit.client.1.smithi135.stderr:117200K .......... .......... .......... .......... .......... 69% 549K 1m45s 2023-11-18T19:12:14.138 INFO:tasks.workunit.client.1.smithi135.stderr:117250K .......... .......... .......... .......... .......... 69% 395K 1m45s 2023-11-18T19:12:14.229 INFO:tasks.workunit.client.1.smithi135.stderr:117300K .......... .......... .......... .......... .......... 69% 550K 1m45s 2023-11-18T19:12:14.308 INFO:tasks.workunit.client.1.smithi135.stderr:117350K .......... .......... .......... .......... .......... 69% 628K 1m45s 2023-11-18T19:12:14.391 INFO:tasks.workunit.client.1.smithi135.stderr:117400K .......... .......... .......... .......... .......... 69% 607K 1m44s 2023-11-18T19:12:14.473 INFO:tasks.workunit.client.1.smithi135.stderr:117450K .......... .......... .......... .......... .......... 69% 607K 1m44s 2023-11-18T19:12:14.562 INFO:tasks.workunit.client.1.smithi135.stderr:117500K .......... .......... .......... .......... .......... 69% 593K 1m44s 2023-11-18T19:12:14.729 INFO:tasks.workunit.client.1.smithi135.stderr:117550K .......... .......... .......... .......... .......... 69% 292K 1m44s 2023-11-18T19:12:14.751 INFO:tasks.workunit.client.1.smithi135.stderr:117600K .......... .......... .......... .......... .......... 69% 2.18M 1m44s 2023-11-18T19:12:14.873 INFO:tasks.workunit.client.1.smithi135.stderr:117650K .......... .......... .......... .......... .......... 69% 409K 1m44s 2023-11-18T19:12:14.993 INFO:tasks.workunit.client.1.smithi135.stderr:117700K .......... .......... .......... .......... .......... 69% 519K 1m44s 2023-11-18T19:12:15.080 INFO:tasks.workunit.client.1.smithi135.stderr:117750K .......... .......... .......... .......... .......... 69% 451K 1m44s 2023-11-18T19:12:15.083 INFO:tasks.workunit.client.0.smithi045.stdout: 30 8778 23 5359 23 5156 61 2023-11-18T19:12:15.201 INFO:tasks.workunit.client.1.smithi135.stderr:117800K .......... .......... .......... .......... .......... 69% 543K 1m44s 2023-11-18T19:12:15.296 INFO:tasks.workunit.client.1.smithi135.stderr:117850K .......... .......... .......... .......... .......... 69% 405K 1m43s 2023-11-18T19:12:15.393 INFO:tasks.workunit.client.1.smithi135.stderr:117900K .......... .......... .......... .......... .......... 69% 516K 1m43s 2023-11-18T19:12:15.526 INFO:tasks.workunit.client.1.smithi135.stderr:117950K .......... .......... .......... .......... .......... 70% 377K 1m43s 2023-11-18T19:12:15.613 INFO:tasks.workunit.client.1.smithi135.stderr:118000K .......... .......... .......... .......... .......... 70% 573K 1m43s 2023-11-18T19:12:15.701 INFO:tasks.workunit.client.1.smithi135.stderr:118050K .......... .......... .......... .......... .......... 70% 564K 1m43s 2023-11-18T19:12:15.794 INFO:tasks.workunit.client.1.smithi135.stderr:118100K .......... .......... .......... .......... .......... 70% 536K 1m43s 2023-11-18T19:12:15.886 INFO:tasks.workunit.client.1.smithi135.stderr:118150K .......... .......... .......... .......... .......... 70% 542K 1m43s 2023-11-18T19:12:15.973 INFO:tasks.workunit.client.1.smithi135.stderr:118200K .......... .......... .......... .......... .......... 70% 580K 1m43s 2023-11-18T19:12:16.051 INFO:tasks.workunit.client.1.smithi135.stderr:118250K .......... .......... .......... .......... .......... 70% 642K 1m43s 2023-11-18T19:12:16.133 INFO:tasks.workunit.client.1.smithi135.stderr:118300K .......... .......... .......... .......... .......... 70% 604K 1m43s 2023-11-18T19:12:16.219 INFO:tasks.workunit.client.1.smithi135.stderr:118350K .......... .......... .......... .......... .......... 70% 582K 1m42s 2023-11-18T19:12:16.333 INFO:tasks.workunit.client.1.smithi135.stderr:118400K .......... .......... .......... .......... .......... 70% 547K 1m42s 2023-11-18T19:12:16.423 INFO:tasks.workunit.client.1.smithi135.stderr:118450K .......... .......... .......... .......... .......... 70% 443K 1m42s 2023-11-18T19:12:16.503 INFO:tasks.workunit.client.1.smithi135.stderr:118500K .......... .......... .......... .......... .......... 70% 632K 1m42s 2023-11-18T19:12:16.578 INFO:tasks.workunit.client.1.smithi135.stderr:118550K .......... .......... .......... .......... .......... 70% 662K 1m42s 2023-11-18T19:12:16.652 INFO:tasks.workunit.client.1.smithi135.stderr:118600K .......... .......... .......... .......... .......... 70% 800K 1m42s 2023-11-18T19:12:16.721 INFO:tasks.workunit.client.1.smithi135.stderr:118650K .......... .......... .......... .......... .......... 70% 624K 1m42s 2023-11-18T19:12:16.801 INFO:tasks.workunit.client.1.smithi135.stderr:118700K .......... .......... .......... .......... .......... 70% 627K 1m42s 2023-11-18T19:12:16.882 INFO:tasks.workunit.client.1.smithi135.stderr:118750K .......... .......... .......... .......... .......... 70% 621K 1m42s 2023-11-18T19:12:16.964 INFO:tasks.workunit.client.1.smithi135.stderr:118800K .......... .......... .......... .......... .......... 70% 603K 1m41s 2023-11-18T19:12:17.042 INFO:tasks.workunit.client.1.smithi135.stderr:118850K .......... .......... .......... .......... .......... 70% 660K 1m41s 2023-11-18T19:12:17.125 INFO:tasks.workunit.client.1.smithi135.stderr:118900K .......... .......... .......... .......... .......... 70% 584K 1m41s 2023-11-18T19:12:17.209 INFO:tasks.workunit.client.1.smithi135.stderr:118950K .......... .......... .......... .......... .......... 70% 626K 1m41s 2023-11-18T19:12:17.290 INFO:tasks.workunit.client.1.smithi135.stderr:119000K .......... .......... .......... .......... .......... 70% 591K 1m41s 2023-11-18T19:12:17.373 INFO:tasks.workunit.client.1.smithi135.stderr:119050K .......... .......... .......... .......... .......... 70% 602K 1m41s 2023-11-18T19:12:17.434 INFO:tasks.workunit.client.1.smithi135.stderr:119100K .......... .......... .......... .......... .......... 70% 823K 1m41s 2023-11-18T19:12:17.496 INFO:tasks.workunit.client.1.smithi135.stderr:119150K .......... .......... .......... .......... .......... 70% 816K 1m41s 2023-11-18T19:12:17.584 INFO:tasks.workunit.client.1.smithi135.stderr:119200K .......... .......... .......... .......... .......... 70% 560K 1m41s 2023-11-18T19:12:17.667 INFO:tasks.workunit.client.1.smithi135.stderr:119250K .......... .......... .......... .......... .......... 70% 608K 1m40s 2023-11-18T19:12:17.749 INFO:tasks.workunit.client.1.smithi135.stderr:119300K .......... .......... .......... .......... .......... 70% 607K 1m40s 2023-11-18T19:12:17.836 INFO:tasks.workunit.client.1.smithi135.stderr:119350K .......... .......... .......... .......... .......... 70% 576K 1m40s 2023-11-18T19:12:17.922 INFO:tasks.workunit.client.1.smithi135.stderr:119400K .......... .......... .......... .......... .......... 70% 584K 1m40s 2023-11-18T19:12:17.985 INFO:tasks.workunit.client.1.smithi135.stderr:119450K .......... .......... .......... .......... .......... 70% 789K 1m40s 2023-11-18T19:12:18.050 INFO:tasks.workunit.client.1.smithi135.stderr:119500K .......... .......... .......... .......... .......... 70% 777K 1m40s 2023-11-18T19:12:18.138 INFO:tasks.workunit.client.1.smithi135.stderr:119550K .......... .......... .......... .......... .......... 70% 566K 1m40s 2023-11-18T19:12:18.209 INFO:tasks.workunit.client.1.smithi135.stderr:119600K .......... .......... .......... .......... .......... 70% 700K 1m40s 2023-11-18T19:12:18.297 INFO:tasks.workunit.client.1.smithi135.stderr:119650K .......... .......... .......... .......... .......... 71% 569K 1m40s 2023-11-18T19:12:18.377 INFO:tasks.workunit.client.1.smithi135.stderr:119700K .......... .......... .......... .......... .......... 71% 626K 99s 2023-11-18T19:12:18.431 INFO:tasks.workunit.client.1.smithi135.stderr:119750K .......... .......... .......... .......... .......... 71% 1.37M 99s 2023-11-18T19:12:18.501 INFO:tasks.workunit.client.1.smithi135.stderr:119800K .......... .......... .......... .......... .......... 71% 564K 99s 2023-11-18T19:12:18.582 INFO:tasks.workunit.client.1.smithi135.stderr:119850K .......... .......... .......... .......... .......... 71% 643K 99s 2023-11-18T19:12:18.657 INFO:tasks.workunit.client.1.smithi135.stderr:119900K .......... .......... .......... .......... .......... 71% 640K 99s 2023-11-18T19:12:18.709 INFO:tasks.workunit.client.1.smithi135.stderr:119950K .......... .......... .......... .......... .......... 71% 980K 99s 2023-11-18T19:12:18.771 INFO:tasks.workunit.client.1.smithi135.stderr:120000K .......... .......... .......... .......... .......... 71% 789K 99s 2023-11-18T19:12:18.841 INFO:tasks.workunit.client.1.smithi135.stderr:120050K .......... .......... .......... .......... .......... 71% 714K 99s 2023-11-18T19:12:18.902 INFO:tasks.workunit.client.1.smithi135.stderr:120100K .......... .......... .......... .......... .......... 71% 825K 99s 2023-11-18T19:12:18.946 INFO:tasks.workunit.client.1.smithi135.stderr:120150K .......... .......... .......... .......... .......... 71% 1.11M 98s 2023-11-18T19:12:19.000 INFO:tasks.workunit.client.1.smithi135.stderr:120200K .......... .......... .......... .......... .......... 71% 933K 98s 2023-11-18T19:12:19.063 INFO:tasks.workunit.client.1.smithi135.stderr:120250K .......... .......... .......... .......... .......... 71% 782K 98s 2023-11-18T19:12:19.126 INFO:tasks.workunit.client.1.smithi135.stderr:120300K .......... .......... .......... .......... .......... 71% 808K 98s 2023-11-18T19:12:19.168 INFO:tasks.workunit.client.1.smithi135.stderr:120350K .......... .......... .......... .......... .......... 71% 1.15M 98s 2023-11-18T19:12:19.235 INFO:tasks.workunit.client.1.smithi135.stderr:120400K .......... .......... .......... .......... .......... 71% 781K 98s 2023-11-18T19:12:19.306 INFO:tasks.workunit.client.1.smithi135.stderr:120450K .......... .......... .......... .......... .......... 71% 673K 98s 2023-11-18T19:12:19.344 INFO:tasks.workunit.client.1.smithi135.stderr:120500K .......... .......... .......... .......... .......... 71% 1.26M 98s 2023-11-18T19:12:19.405 INFO:tasks.workunit.client.1.smithi135.stderr:120550K .......... .......... .......... .......... .......... 71% 828K 97s 2023-11-18T19:12:19.501 INFO:tasks.workunit.client.1.smithi135.stderr:120600K .......... .......... .......... .......... .......... 71% 522K 97s 2023-11-18T19:12:19.560 INFO:tasks.workunit.client.1.smithi135.stderr:120650K .......... .......... .......... .......... .......... 71% 1.16M 97s 2023-11-18T19:12:19.615 INFO:tasks.workunit.client.1.smithi135.stderr:120700K .......... .......... .......... .......... .......... 71% 690K 97s 2023-11-18T19:12:19.691 INFO:tasks.workunit.client.1.smithi135.stderr:120750K .......... .......... .......... .......... .......... 71% 669K 97s 2023-11-18T19:12:19.741 INFO:tasks.workunit.client.1.smithi135.stderr:120800K .......... .......... .......... .......... .......... 71% 990K 97s 2023-11-18T19:12:19.905 INFO:tasks.workunit.client.1.smithi135.stderr:120850K .......... .......... .......... .......... .......... 71% 305K 97s 2023-11-18T19:12:19.914 INFO:tasks.workunit.client.1.smithi135.stderr:120900K .......... .......... .......... .......... .......... 71% 5.48M 97s 2023-11-18T19:12:19.994 INFO:tasks.workunit.client.1.smithi135.stderr:120950K .......... .......... .......... .......... .......... 71% 623K 97s 2023-11-18T19:12:20.079 INFO:tasks.workunit.client.1.smithi135.stderr:121000K .......... .......... .......... .......... .......... 71% 588K 96s 2023-11-18T19:12:20.158 INFO:tasks.workunit.client.1.smithi135.stderr:121050K .......... .......... .......... .......... .......... 71% 631K 96s 2023-11-18T19:12:20.237 INFO:tasks.workunit.client.1.smithi135.stderr:121100K .......... .......... .......... .......... .......... 71% 673K 96s 2023-11-18T19:12:20.287 INFO:tasks.workunit.client.1.smithi135.stderr:121150K .......... .......... .......... .......... .......... 71% 920K 96s 2023-11-18T19:12:20.381 INFO:tasks.workunit.client.1.smithi135.stderr:121200K .......... .......... .......... .......... .......... 71% 618K 96s 2023-11-18T19:12:20.496 INFO:tasks.workunit.client.1.smithi135.stderr:121250K .......... .......... .......... .......... .......... 71% 391K 96s 2023-11-18T19:12:20.548 INFO:tasks.workunit.client.1.smithi135.stderr:121300K .......... .......... .......... .......... .......... 71% 949K 96s 2023-11-18T19:12:20.645 INFO:tasks.workunit.client.1.smithi135.stderr:121350K .......... .......... .......... .......... .......... 72% 513K 96s 2023-11-18T19:12:20.738 INFO:tasks.workunit.client.1.smithi135.stderr:121400K .......... .......... .......... .......... .......... 72% 539K 96s 2023-11-18T19:12:20.826 INFO:tasks.workunit.client.1.smithi135.stderr:121450K .......... .......... .......... .......... .......... 72% 573K 95s 2023-11-18T19:12:20.912 INFO:tasks.workunit.client.1.smithi135.stderr:121500K .......... .......... .......... .......... .......... 72% 580K 95s 2023-11-18T19:12:21.008 INFO:tasks.workunit.client.1.smithi135.stderr:121550K .......... .......... .......... .......... .......... 72% 537K 95s 2023-11-18T19:12:21.093 INFO:tasks.workunit.client.1.smithi135.stderr:121600K .......... .......... .......... .......... .......... 72% 562K 95s 2023-11-18T19:12:21.188 INFO:tasks.workunit.client.1.smithi135.stderr:121650K .......... .......... .......... .......... .......... 72% 544K 95s 2023-11-18T19:12:21.276 INFO:tasks.workunit.client.1.smithi135.stderr:121700K .......... .......... .......... .......... .......... 72% 553K 95s 2023-11-18T19:12:21.369 INFO:tasks.workunit.client.1.smithi135.stderr:121750K .......... .......... .......... .......... .......... 72% 542K 95s 2023-11-18T19:12:21.464 INFO:tasks.workunit.client.1.smithi135.stderr:121800K .......... .......... .......... .......... .......... 72% 522K 95s 2023-11-18T19:12:21.632 INFO:tasks.workunit.client.1.smithi135.stderr:121850K .......... .......... .......... .......... .......... 72% 299K 95s 2023-11-18T19:12:21.701 INFO:tasks.workunit.client.1.smithi135.stderr:121900K .......... .......... .......... .......... .......... 72% 717K 95s 2023-11-18T19:12:21.799 INFO:tasks.workunit.client.1.smithi135.stderr:121950K .......... .......... .......... .......... .......... 72% 514K 94s 2023-11-18T19:12:21.928 INFO:tasks.workunit.client.1.smithi135.stderr:122000K .......... .......... .......... .......... .......... 72% 453K 94s 2023-11-18T19:12:22.029 INFO:tasks.workunit.client.1.smithi135.stderr:122050K .......... .......... .......... .......... .......... 72% 417K 94s 2023-11-18T19:12:22.155 INFO:tasks.workunit.client.1.smithi135.stderr:122100K .......... .......... .......... .......... .......... 72% 399K 94s 2023-11-18T19:12:22.239 INFO:tasks.workunit.client.1.smithi135.stderr:122150K .......... .......... .......... .......... .......... 72% 586K 94s 2023-11-18T19:12:22.365 INFO:tasks.workunit.client.1.smithi135.stderr:122200K .......... .......... .......... .......... .......... 72% 400K 94s 2023-11-18T19:12:22.453 INFO:tasks.workunit.client.1.smithi135.stderr:122250K .......... .......... .......... .......... .......... 72% 565K 94s 2023-11-18T19:12:22.589 INFO:tasks.workunit.client.1.smithi135.stderr:122300K .......... .......... .......... .......... .......... 72% 369K 94s 2023-11-18T19:12:22.704 INFO:tasks.workunit.client.1.smithi135.stderr:122350K .......... .......... .......... .......... .......... 72% 432K 94s 2023-11-18T19:12:22.807 INFO:tasks.workunit.client.1.smithi135.stderr:122400K .......... .......... .......... .......... .......... 72% 487K 94s 2023-11-18T19:12:22.891 INFO:tasks.workunit.client.1.smithi135.stderr:122450K .......... .......... .......... .......... .......... 72% 598K 93s 2023-11-18T19:12:22.978 INFO:tasks.workunit.client.1.smithi135.stderr:122500K .......... .......... .......... .......... .......... 72% 569K 93s 2023-11-18T19:12:23.103 INFO:tasks.workunit.client.1.smithi135.stderr:122550K .......... .......... .......... .......... .......... 72% 416K 93s 2023-11-18T19:12:23.198 INFO:tasks.workunit.client.1.smithi135.stderr:122600K .......... .......... .......... .......... .......... 72% 501K 93s 2023-11-18T19:12:23.332 INFO:tasks.workunit.client.1.smithi135.stderr:122650K .......... .......... .......... .......... .......... 72% 376K 93s 2023-11-18T19:12:23.440 INFO:tasks.workunit.client.1.smithi135.stderr:122700K .......... .......... .......... .......... .......... 72% 462K 93s 2023-11-18T19:12:23.545 INFO:tasks.workunit.client.1.smithi135.stderr:122750K .......... .......... .......... .......... .......... 72% 475K 93s 2023-11-18T19:12:23.666 INFO:tasks.workunit.client.1.smithi135.stderr:122800K .......... .......... .......... .......... .......... 72% 412K 93s 2023-11-18T19:12:23.772 INFO:tasks.workunit.client.1.smithi135.stderr:122850K .......... .......... .......... .......... .......... 72% 473K 93s 2023-11-18T19:12:23.902 INFO:tasks.workunit.client.1.smithi135.stderr:122900K .......... .......... .......... .......... .......... 72% 387K 93s 2023-11-18T19:12:24.001 INFO:tasks.workunit.client.1.smithi135.stderr:122950K .......... .......... .......... .......... .......... 72% 504K 92s 2023-11-18T19:12:24.081 INFO:tasks.workunit.client.1.smithi135.stderr:123000K .......... .......... .......... .......... .......... 72% 629K 92s 2023-11-18T19:12:24.175 INFO:tasks.workunit.client.1.smithi135.stderr:123050K .......... .......... .......... .......... .......... 73% 528K 92s 2023-11-18T19:12:24.277 INFO:tasks.workunit.client.1.smithi135.stderr:123100K .......... .......... .......... .......... .......... 73% 516K 92s 2023-11-18T19:12:24.392 INFO:tasks.workunit.client.1.smithi135.stderr:123150K .......... .......... .......... .......... .......... 73% 417K 92s 2023-11-18T19:12:24.480 INFO:tasks.workunit.client.1.smithi135.stderr:123200K .......... .......... .......... .......... .......... 73% 568K 92s 2023-11-18T19:12:24.555 INFO:tasks.workunit.client.1.smithi135.stderr:123250K .......... .......... .......... .......... .......... 73% 667K 92s 2023-11-18T19:12:24.638 INFO:tasks.workunit.client.1.smithi135.stderr:123300K .......... .......... .......... .......... .......... 73% 599K 92s 2023-11-18T19:12:24.735 INFO:tasks.workunit.client.1.smithi135.stderr:123350K .......... .......... .......... .......... .......... 73% 519K 92s 2023-11-18T19:12:24.813 INFO:tasks.workunit.client.1.smithi135.stderr:123400K .......... .......... .......... .......... .......... 73% 640K 91s 2023-11-18T19:12:24.903 INFO:tasks.workunit.client.1.smithi135.stderr:123450K .......... .......... .......... .......... .......... 73% 565K 91s 2023-11-18T19:12:25.011 INFO:tasks.workunit.client.1.smithi135.stderr:123500K .......... .......... .......... .......... .......... 73% 455K 91s 2023-11-18T19:12:25.084 INFO:tasks.workunit.client.0.smithi045.stdout: 30 9289 39 5552 22 4385 74 2023-11-18T19:12:25.090 INFO:tasks.workunit.client.1.smithi135.stderr:123550K .......... .......... .......... .......... .......... 73% 646K 91s 2023-11-18T19:12:25.165 INFO:tasks.workunit.client.1.smithi135.stderr:123600K .......... .......... .......... .......... .......... 73% 652K 91s 2023-11-18T19:12:25.238 INFO:tasks.workunit.client.1.smithi135.stderr:123650K .......... .......... .......... .......... .......... 73% 684K 91s 2023-11-18T19:12:25.324 INFO:tasks.workunit.client.1.smithi135.stderr:123700K .......... .......... .......... .......... .......... 73% 582K 91s 2023-11-18T19:12:25.398 INFO:tasks.workunit.client.1.smithi135.stderr:123750K .......... .......... .......... .......... .......... 73% 672K 91s 2023-11-18T19:12:25.487 INFO:tasks.workunit.client.1.smithi135.stderr:123800K .......... .......... .......... .......... .......... 73% 570K 91s 2023-11-18T19:12:25.576 INFO:tasks.workunit.client.1.smithi135.stderr:123850K .......... .......... .......... .......... .......... 73% 556K 91s 2023-11-18T19:12:25.677 INFO:tasks.workunit.client.1.smithi135.stderr:123900K .......... .......... .......... .......... .......... 73% 634K 90s 2023-11-18T19:12:25.731 INFO:tasks.workunit.client.1.smithi135.stderr:123950K .......... .......... .......... .......... .......... 73% 655K 90s 2023-11-18T19:12:25.812 INFO:tasks.workunit.client.1.smithi135.stderr:124000K .......... .......... .......... .......... .......... 73% 627K 90s 2023-11-18T19:12:25.891 INFO:tasks.workunit.client.1.smithi135.stderr:124050K .......... .......... .......... .......... .......... 73% 626K 90s 2023-11-18T19:12:25.961 INFO:tasks.workunit.client.1.smithi135.stderr:124100K .......... .......... .......... .......... .......... 73% 711K 90s 2023-11-18T19:12:26.037 INFO:tasks.workunit.client.1.smithi135.stderr:124150K .......... .......... .......... .......... .......... 73% 655K 90s 2023-11-18T19:12:26.121 INFO:tasks.workunit.client.1.smithi135.stderr:124200K .......... .......... .......... .......... .......... 73% 599K 90s 2023-11-18T19:12:26.206 INFO:tasks.workunit.client.1.smithi135.stderr:124250K .......... .......... .......... .......... .......... 73% 601K 90s 2023-11-18T19:12:26.292 INFO:tasks.workunit.client.1.smithi135.stderr:124300K .......... .......... .......... .......... .......... 73% 571K 90s 2023-11-18T19:12:26.379 INFO:tasks.workunit.client.1.smithi135.stderr:124350K .......... .......... .......... .......... .......... 73% 753K 89s 2023-11-18T19:12:26.444 INFO:tasks.workunit.client.1.smithi135.stderr:124400K .......... .......... .......... .......... .......... 73% 583K 89s 2023-11-18T19:12:26.526 INFO:tasks.workunit.client.1.smithi135.stderr:124450K .......... .......... .......... .......... .......... 73% 622K 89s 2023-11-18T19:12:26.616 INFO:tasks.workunit.client.1.smithi135.stderr:124500K .......... .......... .......... .......... .......... 73% 545K 89s 2023-11-18T19:12:26.682 INFO:tasks.workunit.client.1.smithi135.stderr:124550K .......... .......... .......... .......... .......... 73% 758K 89s 2023-11-18T19:12:26.751 INFO:tasks.workunit.client.1.smithi135.stderr:124600K .......... .......... .......... .......... .......... 73% 721K 89s 2023-11-18T19:12:26.842 INFO:tasks.workunit.client.1.smithi135.stderr:124650K .......... .......... .......... .......... .......... 73% 552K 89s 2023-11-18T19:12:26.933 INFO:tasks.workunit.client.1.smithi135.stderr:124700K .......... .......... .......... .......... .......... 74% 780K 89s 2023-11-18T19:12:26.991 INFO:tasks.workunit.client.1.smithi135.stderr:124750K .......... .......... .......... .......... .......... 74% 592K 89s 2023-11-18T19:12:27.075 INFO:tasks.workunit.client.1.smithi135.stderr:124800K .......... .......... .......... .......... .......... 74% 599K 88s 2023-11-18T19:12:27.134 INFO:tasks.workunit.client.1.smithi135.stderr:124850K .......... .......... .......... .......... .......... 74% 832K 88s 2023-11-18T19:12:27.204 INFO:tasks.workunit.client.1.smithi135.stderr:124900K .......... .......... .......... .......... .......... 74% 724K 88s 2023-11-18T19:12:27.286 INFO:tasks.workunit.client.1.smithi135.stderr:124950K .......... .......... .......... .......... .......... 74% 603K 88s 2023-11-18T19:12:27.347 INFO:tasks.workunit.client.1.smithi135.stderr:125000K .......... .......... .......... .......... .......... 74% 814K 88s 2023-11-18T19:12:27.428 INFO:tasks.workunit.client.1.smithi135.stderr:125050K .......... .......... .......... .......... .......... 74% 623K 88s 2023-11-18T19:12:27.476 INFO:tasks.workunit.client.1.smithi135.stderr:125100K .......... .......... .......... .......... .......... 74% 1.01M 88s 2023-11-18T19:12:27.560 INFO:tasks.workunit.client.1.smithi135.stderr:125150K .......... .......... .......... .......... .......... 74% 604K 88s 2023-11-18T19:12:27.622 INFO:tasks.workunit.client.1.smithi135.stderr:125200K .......... .......... .......... .......... .......... 74% 784K 88s 2023-11-18T19:12:27.778 INFO:tasks.workunit.client.1.smithi135.stderr:125250K .......... .......... .......... .......... .......... 74% 325K 87s 2023-11-18T19:12:27.867 INFO:tasks.workunit.client.1.smithi135.stderr:125300K .......... .......... .......... .......... .......... 74% 559K 87s 2023-11-18T19:12:27.890 INFO:tasks.workunit.client.1.smithi135.stderr:125350K .......... .......... .......... .......... .......... 74% 2.06M 87s 2023-11-18T19:12:27.978 INFO:tasks.workunit.client.1.smithi135.stderr:125400K .......... .......... .......... .......... .......... 74% 563K 87s 2023-11-18T19:12:28.069 INFO:tasks.workunit.client.1.smithi135.stderr:125450K .......... .......... .......... .......... .......... 74% 554K 87s 2023-11-18T19:12:28.157 INFO:tasks.workunit.client.1.smithi135.stderr:125500K .......... .......... .......... .......... .......... 74% 592K 87s 2023-11-18T19:12:28.244 INFO:tasks.workunit.client.1.smithi135.stderr:125550K .......... .......... .......... .......... .......... 74% 550K 87s 2023-11-18T19:12:28.338 INFO:tasks.workunit.client.1.smithi135.stderr:125600K .......... .......... .......... .......... .......... 74% 531K 87s 2023-11-18T19:12:28.433 INFO:tasks.workunit.client.1.smithi135.stderr:125650K .......... .......... .......... .......... .......... 74% 529K 87s 2023-11-18T19:12:28.501 INFO:tasks.workunit.client.1.smithi135.stderr:125700K .......... .......... .......... .......... .......... 74% 741K 86s 2023-11-18T19:12:28.586 INFO:tasks.workunit.client.1.smithi135.stderr:125750K .......... .......... .......... .......... .......... 74% 583K 86s 2023-11-18T19:12:28.668 INFO:tasks.workunit.client.1.smithi135.stderr:125800K .......... .......... .......... .......... .......... 74% 613K 86s 2023-11-18T19:12:28.747 INFO:tasks.workunit.client.1.smithi135.stderr:125850K .......... .......... .......... .......... .......... 74% 640K 86s 2023-11-18T19:12:28.800 INFO:tasks.workunit.client.1.smithi135.stderr:125900K .......... .......... .......... .......... .......... 74% 922K 86s 2023-11-18T19:12:28.884 INFO:tasks.workunit.client.1.smithi135.stderr:125950K .......... .......... .......... .......... .......... 74% 594K 86s 2023-11-18T19:12:28.976 INFO:tasks.workunit.client.1.smithi135.stderr:126000K .......... .......... .......... .......... .......... 74% 545K 86s 2023-11-18T19:12:29.027 INFO:tasks.workunit.client.1.smithi135.stderr:126050K .......... .......... .......... .......... .......... 74% 1.12M 86s 2023-11-18T19:12:29.099 INFO:tasks.workunit.client.1.smithi135.stderr:126100K .......... .......... .......... .......... .......... 74% 625K 86s 2023-11-18T19:12:29.160 INFO:tasks.workunit.client.1.smithi135.stderr:126150K .......... .......... .......... .......... .......... 74% 874K 86s 2023-11-18T19:12:29.245 INFO:tasks.workunit.client.1.smithi135.stderr:126200K .......... .......... .......... .......... .......... 74% 561K 85s 2023-11-18T19:12:29.337 INFO:tasks.workunit.client.1.smithi135.stderr:126250K .......... .......... .......... .......... .......... 74% 727K 85s 2023-11-18T19:12:29.387 INFO:tasks.workunit.client.1.smithi135.stderr:126300K .......... .......... .......... .......... .......... 74% 687K 85s 2023-11-18T19:12:29.470 INFO:tasks.workunit.client.1.smithi135.stderr:126350K .......... .......... .......... .......... .......... 74% 602K 85s 2023-11-18T19:12:29.527 INFO:tasks.workunit.client.1.smithi135.stderr:126400K .......... .......... .......... .......... .......... 75% 900K 85s 2023-11-18T19:12:29.618 INFO:tasks.workunit.client.1.smithi135.stderr:126450K .......... .......... .......... .......... .......... 75% 545K 85s 2023-11-18T19:12:29.673 INFO:tasks.workunit.client.1.smithi135.stderr:126500K .......... .......... .......... .......... .......... 75% 1021K 85s 2023-11-18T19:12:29.738 INFO:tasks.workunit.client.1.smithi135.stderr:126550K .......... .......... .......... .......... .......... 75% 699K 85s 2023-11-18T19:12:29.788 INFO:tasks.workunit.client.1.smithi135.stderr:126600K .......... .......... .......... .......... .......... 75% 1009K 85s 2023-11-18T19:12:29.862 INFO:tasks.workunit.client.1.smithi135.stderr:126650K .......... .......... .......... .......... .......... 75% 670K 84s 2023-11-18T19:12:29.920 INFO:tasks.workunit.client.1.smithi135.stderr:126700K .......... .......... .......... .......... .......... 75% 1.05M 84s 2023-11-18T19:12:29.974 INFO:tasks.workunit.client.1.smithi135.stderr:126750K .......... .......... .......... .......... .......... 75% 767K 84s 2023-11-18T19:12:30.022 INFO:tasks.workunit.client.1.smithi135.stderr:126800K .......... .......... .......... .......... .......... 75% 1.00M 84s 2023-11-18T19:12:30.099 INFO:tasks.workunit.client.1.smithi135.stderr:126850K .......... .......... .......... .......... .......... 75% 662K 84s 2023-11-18T19:12:30.147 INFO:tasks.workunit.client.1.smithi135.stderr:126900K .......... .......... .......... .......... .......... 75% 1.00M 84s 2023-11-18T19:12:30.217 INFO:tasks.workunit.client.1.smithi135.stderr:126950K .......... .......... .......... .......... .......... 75% 719K 84s 2023-11-18T19:12:30.278 INFO:tasks.workunit.client.1.smithi135.stderr:127000K .......... .......... .......... .......... .......... 75% 811K 84s 2023-11-18T19:12:30.358 INFO:tasks.workunit.client.1.smithi135.stderr:127050K .......... .......... .......... .......... .......... 75% 628K 83s 2023-11-18T19:12:30.402 INFO:tasks.workunit.client.1.smithi135.stderr:127100K .......... .......... .......... .......... .......... 75% 1.09M 83s 2023-11-18T19:12:30.476 INFO:tasks.workunit.client.1.smithi135.stderr:127150K .......... .......... .......... .......... .......... 75% 674K 83s 2023-11-18T19:12:30.541 INFO:tasks.workunit.client.1.smithi135.stderr:127200K .......... .......... .......... .......... .......... 75% 774K 83s 2023-11-18T19:12:30.606 INFO:tasks.workunit.client.1.smithi135.stderr:127250K .......... .......... .......... .......... .......... 75% 765K 83s 2023-11-18T19:12:30.673 INFO:tasks.workunit.client.1.smithi135.stderr:127300K .......... .......... .......... .......... .......... 75% 817K 83s 2023-11-18T19:12:30.850 INFO:tasks.workunit.client.1.smithi135.stderr:127350K .......... .......... .......... .......... .......... 75% 275K 83s 2023-11-18T19:12:30.851 INFO:tasks.workunit.client.1.smithi135.stderr:127400K .......... .......... .......... .......... .......... 75% 173M 83s 2023-11-18T19:12:30.924 INFO:tasks.workunit.client.1.smithi135.stderr:127450K .......... .......... .......... .......... .......... 75% 704K 83s 2023-11-18T19:12:31.016 INFO:tasks.workunit.client.1.smithi135.stderr:127500K .......... .......... .......... .......... .......... 75% 527K 83s 2023-11-18T19:12:31.108 INFO:tasks.workunit.client.1.smithi135.stderr:127550K .......... .......... .......... .......... .......... 75% 549K 82s 2023-11-18T19:12:31.201 INFO:tasks.workunit.client.1.smithi135.stderr:127600K .......... .......... .......... .......... .......... 75% 535K 82s 2023-11-18T19:12:31.289 INFO:tasks.workunit.client.1.smithi135.stderr:127650K .......... .......... .......... .......... .......... 75% 568K 82s 2023-11-18T19:12:31.379 INFO:tasks.workunit.client.1.smithi135.stderr:127700K .......... .......... .......... .......... .......... 75% 552K 82s 2023-11-18T19:12:31.459 INFO:tasks.workunit.client.1.smithi135.stderr:127750K .......... .......... .......... .......... .......... 75% 626K 82s 2023-11-18T19:12:31.545 INFO:tasks.workunit.client.1.smithi135.stderr:127800K .......... .......... .......... .......... .......... 75% 580K 82s 2023-11-18T19:12:31.602 INFO:tasks.workunit.client.1.smithi135.stderr:127850K .......... .......... .......... .......... .......... 75% 875K 82s 2023-11-18T19:12:31.677 INFO:tasks.workunit.client.1.smithi135.stderr:127900K .......... .......... .......... .......... .......... 75% 702K 82s 2023-11-18T19:12:31.757 INFO:tasks.workunit.client.1.smithi135.stderr:127950K .......... .......... .......... .......... .......... 75% 598K 82s 2023-11-18T19:12:31.849 INFO:tasks.workunit.client.1.smithi135.stderr:128000K .......... .......... .......... .......... .......... 75% 543K 81s 2023-11-18T19:12:31.921 INFO:tasks.workunit.client.1.smithi135.stderr:128050K .......... .......... .......... .......... .......... 75% 692K 81s 2023-11-18T19:12:32.002 INFO:tasks.workunit.client.1.smithi135.stderr:128100K .......... .......... .......... .......... .......... 76% 622K 81s 2023-11-18T19:12:32.052 INFO:tasks.workunit.client.1.smithi135.stderr:128150K .......... .......... .......... .......... .......... 76% 997K 81s 2023-11-18T19:12:32.133 INFO:tasks.workunit.client.1.smithi135.stderr:128200K .......... .......... .......... .......... .......... 76% 619K 81s 2023-11-18T19:12:32.223 INFO:tasks.workunit.client.1.smithi135.stderr:128250K .......... .......... .......... .......... .......... 76% 702K 81s 2023-11-18T19:12:32.279 INFO:tasks.workunit.client.1.smithi135.stderr:128300K .......... .......... .......... .......... .......... 76% 669K 81s 2023-11-18T19:12:32.338 INFO:tasks.workunit.client.1.smithi135.stderr:128350K .......... .......... .......... .......... .......... 76% 841K 81s 2023-11-18T19:12:32.400 INFO:tasks.workunit.client.1.smithi135.stderr:128400K .......... .......... .......... .......... .......... 76% 807K 81s 2023-11-18T19:12:32.486 INFO:tasks.workunit.client.1.smithi135.stderr:128450K .......... .......... .......... .......... .......... 76% 582K 80s 2023-11-18T19:12:32.555 INFO:tasks.workunit.client.1.smithi135.stderr:128500K .......... .......... .......... .......... .......... 76% 719K 80s 2023-11-18T19:12:32.634 INFO:tasks.workunit.client.1.smithi135.stderr:128550K .......... .......... .......... .......... .......... 76% 635K 80s 2023-11-18T19:12:32.680 INFO:tasks.workunit.client.1.smithi135.stderr:128600K .......... .......... .......... .......... .......... 76% 1.06M 80s 2023-11-18T19:12:32.764 INFO:tasks.workunit.client.1.smithi135.stderr:128650K .......... .......... .......... .......... .......... 76% 596K 80s 2023-11-18T19:12:32.877 INFO:tasks.workunit.client.1.smithi135.stderr:128700K .......... .......... .......... .......... .......... 76% 444K 80s 2023-11-18T19:12:32.911 INFO:tasks.workunit.client.1.smithi135.stderr:128750K .......... .......... .......... .......... .......... 76% 1.41M 80s 2023-11-18T19:12:33.003 INFO:tasks.workunit.client.1.smithi135.stderr:128800K .......... .......... .......... .......... .......... 76% 546K 80s 2023-11-18T19:12:33.217 INFO:tasks.workunit.client.1.smithi135.stderr:128850K .......... .......... .......... .......... .......... 76% 233K 80s 2023-11-18T19:12:33.218 INFO:tasks.workunit.client.1.smithi135.stderr:128900K .......... .......... .......... .......... .......... 76% 39.8M 79s 2023-11-18T19:12:33.333 INFO:tasks.workunit.client.1.smithi135.stderr:128950K .......... .......... .......... .......... .......... 76% 438K 79s 2023-11-18T19:12:33.480 INFO:tasks.workunit.client.1.smithi135.stderr:129000K .......... .......... .......... .......... .......... 76% 338K 79s 2023-11-18T19:12:33.579 INFO:tasks.workunit.client.1.smithi135.stderr:129050K .......... .......... .......... .......... .......... 76% 520K 79s 2023-11-18T19:12:33.731 INFO:tasks.workunit.client.1.smithi135.stderr:129100K .......... .......... .......... .......... .......... 76% 325K 79s 2023-11-18T19:12:33.843 INFO:tasks.workunit.client.1.smithi135.stderr:129150K .......... .......... .......... .......... .......... 76% 453K 79s 2023-11-18T19:12:33.928 INFO:tasks.workunit.client.1.smithi135.stderr:129200K .......... .......... .......... .......... .......... 76% 575K 79s 2023-11-18T19:12:34.060 INFO:tasks.workunit.client.1.smithi135.stderr:129250K .......... .......... .......... .......... .......... 76% 515K 79s 2023-11-18T19:12:34.146 INFO:tasks.workunit.client.1.smithi135.stderr:129300K .......... .......... .......... .......... .......... 76% 412K 79s 2023-11-18T19:12:34.255 INFO:tasks.workunit.client.1.smithi135.stderr:129350K .......... .......... .......... .......... .......... 76% 463K 79s 2023-11-18T19:12:34.346 INFO:tasks.workunit.client.1.smithi135.stderr:129400K .......... .......... .......... .......... .......... 76% 547K 79s 2023-11-18T19:12:34.442 INFO:tasks.workunit.client.1.smithi135.stderr:129450K .......... .......... .......... .......... .......... 76% 518K 78s 2023-11-18T19:12:34.576 INFO:tasks.workunit.client.1.smithi135.stderr:129500K .......... .......... .......... .......... .......... 76% 375K 78s 2023-11-18T19:12:34.673 INFO:tasks.workunit.client.1.smithi135.stderr:129550K .......... .......... .......... .......... .......... 76% 515K 78s 2023-11-18T19:12:34.792 INFO:tasks.workunit.client.1.smithi135.stderr:129600K .......... .......... .......... .......... .......... 76% 503K 78s 2023-11-18T19:12:34.938 INFO:tasks.workunit.client.1.smithi135.stderr:129650K .......... .......... .......... .......... .......... 76% 302K 78s 2023-11-18T19:12:35.039 INFO:tasks.workunit.client.1.smithi135.stderr:129700K .......... .......... .......... .......... .......... 76% 523K 78s 2023-11-18T19:12:35.083 INFO:tasks.workunit.client.0.smithi045.stdout: 30 8093 48 4942 49 4469 95 2023-11-18T19:12:35.160 INFO:tasks.workunit.client.1.smithi135.stderr:129750K .......... .......... .......... .......... .......... 77% 394K 78s 2023-11-18T19:12:35.298 INFO:tasks.workunit.client.1.smithi135.stderr:129800K .......... .......... .......... .......... .......... 77% 375K 78s 2023-11-18T19:12:35.461 INFO:tasks.workunit.client.1.smithi135.stderr:129850K .......... .......... .......... .......... .......... 77% 298K 78s 2023-11-18T19:12:35.564 INFO:tasks.workunit.client.1.smithi135.stderr:129900K .......... .......... .......... .......... .......... 77% 483K 78s 2023-11-18T19:12:35.696 INFO:tasks.workunit.client.1.smithi135.stderr:129950K .......... .......... .......... .......... .......... 77% 379K 78s 2023-11-18T19:12:35.822 INFO:tasks.workunit.client.1.smithi135.stderr:130000K .......... .......... .......... .......... .......... 77% 397K 77s 2023-11-18T19:12:35.920 INFO:tasks.workunit.client.1.smithi135.stderr:130050K .......... .......... .......... .......... .......... 77% 512K 77s 2023-11-18T19:12:36.018 INFO:tasks.workunit.client.1.smithi135.stderr:130100K .......... .......... .......... .......... .......... 77% 513K 77s 2023-11-18T19:12:36.121 INFO:tasks.workunit.client.1.smithi135.stderr:130150K .......... .......... .......... .......... .......... 77% 486K 77s 2023-11-18T19:12:36.233 INFO:tasks.workunit.client.1.smithi135.stderr:130200K .......... .......... .......... .......... .......... 77% 444K 77s 2023-11-18T19:12:36.345 INFO:tasks.workunit.client.1.smithi135.stderr:130250K .......... .......... .......... .......... .......... 77% 529K 77s 2023-11-18T19:12:36.447 INFO:tasks.workunit.client.1.smithi135.stderr:130300K .......... .......... .......... .......... .......... 77% 419K 77s 2023-11-18T19:12:36.546 INFO:tasks.workunit.client.1.smithi135.stderr:130350K .......... .......... .......... .......... .......... 77% 504K 77s 2023-11-18T19:12:36.648 INFO:tasks.workunit.client.1.smithi135.stderr:130400K .......... .......... .......... .......... .......... 77% 540K 77s 2023-11-18T19:12:36.738 INFO:tasks.workunit.client.1.smithi135.stderr:130450K .......... .......... .......... .......... .......... 77% 500K 77s 2023-11-18T19:12:36.842 INFO:tasks.workunit.client.1.smithi135.stderr:130500K .......... .......... .......... .......... .......... 77% 561K 76s 2023-11-18T19:12:36.931 INFO:tasks.workunit.client.1.smithi135.stderr:130550K .......... .......... .......... .......... .......... 77% 484K 76s 2023-11-18T19:12:37.045 INFO:tasks.workunit.client.1.smithi135.stderr:130600K .......... .......... .......... .......... .......... 77% 544K 76s 2023-11-18T19:12:37.146 INFO:tasks.workunit.client.1.smithi135.stderr:130650K .......... .......... .......... .......... .......... 77% 406K 76s 2023-11-18T19:12:37.235 INFO:tasks.workunit.client.1.smithi135.stderr:130700K .......... .......... .......... .......... .......... 77% 566K 76s 2023-11-18T19:12:37.341 INFO:tasks.workunit.client.1.smithi135.stderr:130750K .......... .......... .......... .......... .......... 77% 469K 76s 2023-11-18T19:12:37.426 INFO:tasks.workunit.client.1.smithi135.stderr:130800K .......... .......... .......... .......... .......... 77% 585K 76s 2023-11-18T19:12:37.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:12:37.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:12:37.511 INFO:tasks.workunit.client.1.smithi135.stderr:130850K .......... .......... .......... .......... .......... 77% 588K 76s 2023-11-18T19:12:37.600 INFO:tasks.workunit.client.1.smithi135.stderr:130900K .......... .......... .......... .......... .......... 77% 563K 76s 2023-11-18T19:12:37.691 INFO:tasks.workunit.client.1.smithi135.stderr:130950K .......... .......... .......... .......... .......... 77% 550K 75s 2023-11-18T19:12:37.783 INFO:tasks.workunit.client.1.smithi135.stderr:131000K .......... .......... .......... .......... .......... 77% 546K 75s 2023-11-18T19:12:37.873 INFO:tasks.workunit.client.1.smithi135.stderr:131050K .......... .......... .......... .......... .......... 77% 718K 75s 2023-11-18T19:12:37.943 INFO:tasks.workunit.client.1.smithi135.stderr:131100K .......... .......... .......... .......... .......... 77% 554K 75s 2023-11-18T19:12:38.038 INFO:tasks.workunit.client.1.smithi135.stderr:131150K .......... .......... .......... .......... .......... 77% 545K 75s 2023-11-18T19:12:38.116 INFO:tasks.workunit.client.1.smithi135.stderr:131200K .......... .......... .......... .......... .......... 77% 615K 75s 2023-11-18T19:12:38.188 INFO:tasks.workunit.client.1.smithi135.stderr:131250K .......... .......... .......... .......... .......... 77% 693K 75s 2023-11-18T19:12:38.275 INFO:tasks.workunit.client.1.smithi135.stderr:131300K .......... .......... .......... .......... .......... 77% 575K 75s 2023-11-18T19:12:38.366 INFO:tasks.workunit.client.1.smithi135.stderr:131350K .......... .......... .......... .......... .......... 77% 550K 75s 2023-11-18T19:12:38.441 INFO:tasks.workunit.client.1.smithi135.stderr:131400K .......... .......... .......... .......... .......... 77% 736K 75s 2023-11-18T19:12:38.516 INFO:tasks.workunit.client.1.smithi135.stderr:131450K .......... .......... .......... .......... .......... 78% 611K 74s 2023-11-18T19:12:38.597 INFO:tasks.workunit.client.1.smithi135.stderr:131500K .......... .......... .......... .......... .......... 78% 614K 74s 2023-11-18T19:12:38.689 INFO:tasks.workunit.client.1.smithi135.stderr:131550K .......... .......... .......... .......... .......... 78% 547K 74s 2023-11-18T19:12:38.753 INFO:tasks.workunit.client.1.smithi135.stderr:131600K .......... .......... .......... .......... .......... 78% 769K 74s 2023-11-18T19:12:38.826 INFO:tasks.workunit.client.1.smithi135.stderr:131650K .......... .......... .......... .......... .......... 78% 692K 74s 2023-11-18T19:12:38.912 INFO:tasks.workunit.client.1.smithi135.stderr:131700K .......... .......... .......... .......... .......... 78% 578K 74s 2023-11-18T19:12:38.980 INFO:tasks.workunit.client.1.smithi135.stderr:131750K .......... .......... .......... .......... .......... 78% 768K 74s 2023-11-18T19:12:39.056 INFO:tasks.workunit.client.1.smithi135.stderr:131800K .......... .......... .......... .......... .......... 78% 632K 74s 2023-11-18T19:12:39.141 INFO:tasks.workunit.client.1.smithi135.stderr:131850K .......... .......... .......... .......... .......... 78% 591K 74s 2023-11-18T19:12:39.203 INFO:tasks.workunit.client.1.smithi135.stderr:131900K .......... .......... .......... .......... .......... 78% 806K 73s 2023-11-18T19:12:39.378 INFO:tasks.workunit.client.1.smithi135.stderr:131950K .......... .......... .......... .......... .......... 78% 286K 73s 2023-11-18T19:12:39.379 INFO:tasks.workunit.client.1.smithi135.stderr:132000K .......... .......... .......... .......... .......... 78% 106M 73s 2023-11-18T19:12:39.474 INFO:tasks.workunit.client.1.smithi135.stderr:132050K .......... .......... .......... .......... .......... 78% 524K 73s 2023-11-18T19:12:39.561 INFO:tasks.workunit.client.1.smithi135.stderr:132100K .......... .......... .......... .......... .......... 78% 571K 73s 2023-11-18T19:12:39.656 INFO:tasks.workunit.client.1.smithi135.stderr:132150K .......... .......... .......... .......... .......... 78% 525K 73s 2023-11-18T19:12:39.747 INFO:tasks.workunit.client.1.smithi135.stderr:132200K .......... .......... .......... .......... .......... 78% 573K 73s 2023-11-18T19:12:39.833 INFO:tasks.workunit.client.1.smithi135.stderr:132250K .......... .......... .......... .......... .......... 78% 561K 73s 2023-11-18T19:12:39.953 INFO:tasks.workunit.client.1.smithi135.stderr:132300K .......... .......... .......... .......... .......... 78% 564K 73s 2023-11-18T19:12:40.015 INFO:tasks.workunit.client.1.smithi135.stderr:132350K .......... .......... .......... .......... .......... 78% 534K 73s 2023-11-18T19:12:40.107 INFO:tasks.workunit.client.1.smithi135.stderr:132400K .......... .......... .......... .......... .......... 78% 559K 72s 2023-11-18T19:12:40.189 INFO:tasks.workunit.client.1.smithi135.stderr:132450K .......... .......... .......... .......... .......... 78% 590K 72s 2023-11-18T19:12:40.262 INFO:tasks.workunit.client.1.smithi135.stderr:132500K .......... .......... .......... .......... .......... 78% 687K 72s 2023-11-18T19:12:40.343 INFO:tasks.workunit.client.1.smithi135.stderr:132550K .......... .......... .......... .......... .......... 78% 617K 72s 2023-11-18T19:12:40.416 INFO:tasks.workunit.client.1.smithi135.stderr:132600K .......... .......... .......... .......... .......... 78% 684K 72s 2023-11-18T19:12:40.497 INFO:tasks.workunit.client.1.smithi135.stderr:132650K .......... .......... .......... .......... .......... 78% 624K 72s 2023-11-18T19:12:40.567 INFO:tasks.workunit.client.1.smithi135.stderr:132700K .......... .......... .......... .......... .......... 78% 704K 72s 2023-11-18T19:12:40.660 INFO:tasks.workunit.client.1.smithi135.stderr:132750K .......... .......... .......... .......... .......... 78% 547K 72s 2023-11-18T19:12:40.745 INFO:tasks.workunit.client.1.smithi135.stderr:132800K .......... .......... .......... .......... .......... 78% 584K 72s 2023-11-18T19:12:40.799 INFO:tasks.workunit.client.1.smithi135.stderr:132850K .......... .......... .......... .......... .......... 78% 1.15M 71s 2023-11-18T19:12:40.871 INFO:tasks.workunit.client.1.smithi135.stderr:132900K .......... .......... .......... .......... .......... 78% 589K 71s 2023-11-18T19:12:40.955 INFO:tasks.workunit.client.1.smithi135.stderr:132950K .......... .......... .......... .......... .......... 78% 601K 71s 2023-11-18T19:12:41.029 INFO:tasks.workunit.client.1.smithi135.stderr:133000K .......... .......... .......... .......... .......... 78% 669K 71s 2023-11-18T19:12:41.121 INFO:tasks.workunit.client.1.smithi135.stderr:133050K .......... .......... .......... .......... .......... 78% 546K 71s 2023-11-18T19:12:41.176 INFO:tasks.workunit.client.1.smithi135.stderr:133100K .......... .......... .......... .......... .......... 78% 919K 71s 2023-11-18T19:12:41.247 INFO:tasks.workunit.client.1.smithi135.stderr:133150K .......... .......... .......... .......... .......... 79% 697K 71s 2023-11-18T19:12:41.320 INFO:tasks.workunit.client.1.smithi135.stderr:133200K .......... .......... .......... .......... .......... 79% 683K 71s 2023-11-18T19:12:41.385 INFO:tasks.workunit.client.1.smithi135.stderr:133250K .......... .......... .......... .......... .......... 79% 776K 71s 2023-11-18T19:12:41.465 INFO:tasks.workunit.client.1.smithi135.stderr:133300K .......... .......... .......... .......... .......... 79% 622K 71s 2023-11-18T19:12:41.516 INFO:tasks.workunit.client.1.smithi135.stderr:133350K .......... .......... .......... .......... .......... 79% 997K 70s 2023-11-18T19:12:41.590 INFO:tasks.workunit.client.1.smithi135.stderr:133400K .......... .......... .......... .......... .......... 79% 674K 70s 2023-11-18T19:12:41.664 INFO:tasks.workunit.client.1.smithi135.stderr:133450K .......... .......... .......... .......... .......... 79% 668K 70s 2023-11-18T19:12:41.854 INFO:tasks.workunit.client.1.smithi135.stderr:133500K .......... .......... .......... .......... .......... 79% 265K 70s 2023-11-18T19:12:41.854 INFO:tasks.workunit.client.1.smithi135.stderr:133550K .......... .......... .......... .......... .......... 79% 97.4M 70s 2023-11-18T19:12:41.948 INFO:tasks.workunit.client.1.smithi135.stderr:133600K .......... .......... .......... .......... .......... 79% 529K 70s 2023-11-18T19:12:42.040 INFO:tasks.workunit.client.1.smithi135.stderr:133650K .......... .......... .......... .......... .......... 79% 547K 70s 2023-11-18T19:12:42.139 INFO:tasks.workunit.client.1.smithi135.stderr:133700K .......... .......... .......... .......... .......... 79% 502K 70s 2023-11-18T19:12:42.237 INFO:tasks.workunit.client.1.smithi135.stderr:133750K .......... .......... .......... .......... .......... 79% 529K 70s 2023-11-18T19:12:42.418 INFO:tasks.workunit.client.1.smithi135.stderr:133800K .......... .......... .......... .......... .......... 79% 271K 70s 2023-11-18T19:12:42.461 INFO:tasks.workunit.client.1.smithi135.stderr:133850K .......... .......... .......... .......... .......... 79% 1.13M 69s 2023-11-18T19:12:42.562 INFO:tasks.workunit.client.1.smithi135.stderr:133900K .......... .......... .......... .......... .......... 79% 493K 69s 2023-11-18T19:12:42.668 INFO:tasks.workunit.client.1.smithi135.stderr:133950K .......... .......... .......... .......... .......... 79% 475K 69s 2023-11-18T19:12:42.797 INFO:tasks.workunit.client.1.smithi135.stderr:134000K .......... .......... .......... .......... .......... 79% 389K 69s 2023-11-18T19:12:42.901 INFO:tasks.workunit.client.1.smithi135.stderr:134050K .......... .......... .......... .......... .......... 79% 475K 69s 2023-11-18T19:12:43.018 INFO:tasks.workunit.client.1.smithi135.stderr:134100K .......... .......... .......... .......... .......... 79% 453K 69s 2023-11-18T19:12:43.139 INFO:tasks.workunit.client.1.smithi135.stderr:134150K .......... .......... .......... .......... .......... 79% 394K 69s 2023-11-18T19:12:43.244 INFO:tasks.workunit.client.1.smithi135.stderr:134200K .......... .......... .......... .......... .......... 79% 475K 69s 2023-11-18T19:12:43.355 INFO:tasks.workunit.client.1.smithi135.stderr:134250K .......... .......... .......... .......... .......... 79% 452K 69s 2023-11-18T19:12:43.538 INFO:tasks.workunit.client.1.smithi135.stderr:134300K .......... .......... .......... .......... .......... 79% 275K 69s 2023-11-18T19:12:43.607 INFO:tasks.workunit.client.1.smithi135.stderr:134350K .......... .......... .......... .......... .......... 79% 713K 68s 2023-11-18T19:12:43.755 INFO:tasks.workunit.client.1.smithi135.stderr:134400K .......... .......... .......... .......... .......... 79% 338K 68s 2023-11-18T19:12:43.878 INFO:tasks.workunit.client.1.smithi135.stderr:134450K .......... .......... .......... .......... .......... 79% 461K 68s 2023-11-18T19:12:44.012 INFO:tasks.workunit.client.1.smithi135.stderr:134500K .......... .......... .......... .......... .......... 79% 335K 68s 2023-11-18T19:12:44.141 INFO:tasks.workunit.client.1.smithi135.stderr:134550K .......... .......... .......... .......... .......... 79% 402K 68s 2023-11-18T19:12:44.282 INFO:tasks.workunit.client.1.smithi135.stderr:134600K .......... .......... .......... .......... .......... 79% 344K 68s 2023-11-18T19:12:44.445 INFO:tasks.workunit.client.1.smithi135.stderr:134650K .......... .......... .......... .......... .......... 79% 379K 68s 2023-11-18T19:12:44.556 INFO:tasks.workunit.client.1.smithi135.stderr:134700K .......... .......... .......... .......... .......... 79% 351K 68s 2023-11-18T19:12:44.663 INFO:tasks.workunit.client.1.smithi135.stderr:134750K .......... .......... .......... .......... .......... 79% 467K 68s 2023-11-18T19:12:44.795 INFO:tasks.workunit.client.1.smithi135.stderr:134800K .......... .......... .......... .......... .......... 79% 381K 68s 2023-11-18T19:12:44.886 INFO:tasks.workunit.client.1.smithi135.stderr:134850K .......... .......... .......... .......... .......... 80% 546K 67s 2023-11-18T19:12:44.991 INFO:tasks.workunit.client.1.smithi135.stderr:134900K .......... .......... .......... .......... .......... 80% 589K 67s 2023-11-18T19:12:45.083 INFO:tasks.workunit.client.0.smithi045.stdout: 31 8545 78 5393 41 4292 119 2023-11-18T19:12:45.099 INFO:tasks.workunit.client.1.smithi135.stderr:134950K .......... .......... .......... .......... .......... 80% 392K 67s 2023-11-18T19:12:45.199 INFO:tasks.workunit.client.1.smithi135.stderr:135000K .......... .......... .......... .......... .......... 80% 559K 67s 2023-11-18T19:12:45.291 INFO:tasks.workunit.client.1.smithi135.stderr:135050K .......... .......... .......... .......... .......... 80% 485K 67s 2023-11-18T19:12:45.402 INFO:tasks.workunit.client.1.smithi135.stderr:135100K .......... .......... .......... .......... .......... 80% 548K 67s 2023-11-18T19:12:45.495 INFO:tasks.workunit.client.1.smithi135.stderr:135150K .......... .......... .......... .......... .......... 80% 443K 67s 2023-11-18T19:12:45.616 INFO:tasks.workunit.client.1.smithi135.stderr:135200K .......... .......... .......... .......... .......... 80% 415K 67s 2023-11-18T19:12:45.714 INFO:tasks.workunit.client.1.smithi135.stderr:135250K .......... .......... .......... .......... .......... 80% 512K 67s 2023-11-18T19:12:45.808 INFO:tasks.workunit.client.1.smithi135.stderr:135300K .......... .......... .......... .......... .......... 80% 527K 67s 2023-11-18T19:12:45.914 INFO:tasks.workunit.client.1.smithi135.stderr:135350K .......... .......... .......... .......... .......... 80% 477K 66s 2023-11-18T19:12:46.008 INFO:tasks.workunit.client.1.smithi135.stderr:135400K .......... .......... .......... .......... .......... 80% 529K 66s 2023-11-18T19:12:46.109 INFO:tasks.workunit.client.1.smithi135.stderr:135450K .......... .......... .......... .......... .......... 80% 550K 66s 2023-11-18T19:12:46.205 INFO:tasks.workunit.client.1.smithi135.stderr:135500K .......... .......... .......... .......... .......... 80% 472K 66s 2023-11-18T19:12:46.300 INFO:tasks.workunit.client.1.smithi135.stderr:135550K .......... .......... .......... .......... .......... 80% 525K 66s 2023-11-18T19:12:46.440 INFO:tasks.workunit.client.1.smithi135.stderr:135600K .......... .......... .......... .......... .......... 80% 359K 66s 2023-11-18T19:12:46.519 INFO:tasks.workunit.client.1.smithi135.stderr:135650K .......... .......... .......... .......... .......... 80% 628K 66s 2023-11-18T19:12:46.629 INFO:tasks.workunit.client.1.smithi135.stderr:135700K .......... .......... .......... .......... .......... 80% 452K 66s 2023-11-18T19:12:46.756 INFO:tasks.workunit.client.1.smithi135.stderr:135750K .......... .......... .......... .......... .......... 80% 394K 66s 2023-11-18T19:12:46.868 INFO:tasks.workunit.client.1.smithi135.stderr:135800K .......... .......... .......... .......... .......... 80% 447K 66s 2023-11-18T19:12:46.980 INFO:tasks.workunit.client.1.smithi135.stderr:135850K .......... .......... .......... .......... .......... 80% 447K 66s 2023-11-18T19:12:47.085 INFO:tasks.workunit.client.1.smithi135.stderr:135900K .......... .......... .......... .......... .......... 80% 474K 65s 2023-11-18T19:12:47.189 INFO:tasks.workunit.client.1.smithi135.stderr:135950K .......... .......... .......... .......... .......... 80% 484K 65s 2023-11-18T19:12:47.288 INFO:tasks.workunit.client.1.smithi135.stderr:136000K .......... .......... .......... .......... .......... 80% 508K 65s 2023-11-18T19:12:47.399 INFO:tasks.workunit.client.1.smithi135.stderr:136050K .......... .......... .......... .......... .......... 80% 446K 65s 2023-11-18T19:12:47.495 INFO:tasks.workunit.client.1.smithi135.stderr:136100K .......... .......... .......... .......... .......... 80% 520K 65s 2023-11-18T19:12:47.587 INFO:tasks.workunit.client.1.smithi135.stderr:136150K .......... .......... .......... .......... .......... 80% 547K 65s 2023-11-18T19:12:47.690 INFO:tasks.workunit.client.1.smithi135.stderr:136200K .......... .......... .......... .......... .......... 80% 483K 65s 2023-11-18T19:12:47.807 INFO:tasks.workunit.client.1.smithi135.stderr:136250K .......... .......... .......... .......... .......... 80% 442K 65s 2023-11-18T19:12:47.910 INFO:tasks.workunit.client.1.smithi135.stderr:136300K .......... .......... .......... .......... .......... 80% 467K 65s 2023-11-18T19:12:48.013 INFO:tasks.workunit.client.1.smithi135.stderr:136350K .......... .......... .......... .......... .......... 80% 587K 65s 2023-11-18T19:12:48.114 INFO:tasks.workunit.client.1.smithi135.stderr:136400K .......... .......... .......... .......... .......... 80% 421K 64s 2023-11-18T19:12:48.201 INFO:tasks.workunit.client.1.smithi135.stderr:136450K .......... .......... .......... .......... .......... 80% 576K 64s 2023-11-18T19:12:48.313 INFO:tasks.workunit.client.1.smithi135.stderr:136500K .......... .......... .......... .......... .......... 81% 445K 64s 2023-11-18T19:12:48.420 INFO:tasks.workunit.client.1.smithi135.stderr:136550K .......... .......... .......... .......... .......... 81% 470K 64s 2023-11-18T19:12:48.541 INFO:tasks.workunit.client.1.smithi135.stderr:136600K .......... .......... .......... .......... .......... 81% 414K 64s 2023-11-18T19:12:48.723 INFO:tasks.workunit.client.1.smithi135.stderr:136650K .......... .......... .......... .......... .......... 81% 275K 64s 2023-11-18T19:12:48.793 INFO:tasks.workunit.client.1.smithi135.stderr:136700K .......... .......... .......... .......... .......... 81% 712K 64s 2023-11-18T19:12:48.867 INFO:tasks.workunit.client.1.smithi135.stderr:136750K .......... .......... .......... .......... .......... 81% 670K 64s 2023-11-18T19:12:48.965 INFO:tasks.workunit.client.1.smithi135.stderr:136800K .......... .......... .......... .......... .......... 81% 610K 64s 2023-11-18T19:12:49.078 INFO:tasks.workunit.client.1.smithi135.stderr:136850K .......... .......... .......... .......... .......... 81% 391K 64s 2023-11-18T19:12:49.181 INFO:tasks.workunit.client.1.smithi135.stderr:136900K .......... .......... .......... .......... .......... 81% 494K 63s 2023-11-18T19:12:49.265 INFO:tasks.workunit.client.1.smithi135.stderr:136950K .......... .......... .......... .......... .......... 81% 580K 63s 2023-11-18T19:12:49.347 INFO:tasks.workunit.client.1.smithi135.stderr:137000K .......... .......... .......... .......... .......... 81% 605K 63s 2023-11-18T19:12:49.492 INFO:tasks.workunit.client.1.smithi135.stderr:137050K .......... .......... .......... .......... .......... 81% 347K 63s 2023-11-18T19:12:49.573 INFO:tasks.workunit.client.1.smithi135.stderr:137100K .......... .......... .......... .......... .......... 81% 609K 63s 2023-11-18T19:12:49.684 INFO:tasks.workunit.client.1.smithi135.stderr:137150K .......... .......... .......... .......... .......... 81% 454K 63s 2023-11-18T19:12:49.877 INFO:tasks.workunit.client.1.smithi135.stderr:137200K .......... .......... .......... .......... .......... 81% 259K 63s 2023-11-18T19:12:49.925 INFO:tasks.workunit.client.1.smithi135.stderr:137250K .......... .......... .......... .......... .......... 81% 1.01M 63s 2023-11-18T19:12:50.015 INFO:tasks.workunit.client.1.smithi135.stderr:137300K .......... .......... .......... .......... .......... 81% 552K 63s 2023-11-18T19:12:50.140 INFO:tasks.workunit.client.1.smithi135.stderr:137350K .......... .......... .......... .......... .......... 81% 423K 63s 2023-11-18T19:12:50.236 INFO:tasks.workunit.client.1.smithi135.stderr:137400K .......... .......... .......... .......... .......... 81% 488K 62s 2023-11-18T19:12:50.367 INFO:tasks.workunit.client.1.smithi135.stderr:137450K .......... .......... .......... .......... .......... 81% 381K 62s 2023-11-18T19:12:50.475 INFO:tasks.workunit.client.1.smithi135.stderr:137500K .......... .......... .......... .......... .......... 81% 462K 62s 2023-11-18T19:12:50.598 INFO:tasks.workunit.client.1.smithi135.stderr:137550K .......... .......... .......... .......... .......... 81% 408K 62s 2023-11-18T19:12:50.716 INFO:tasks.workunit.client.1.smithi135.stderr:137600K .......... .......... .......... .......... .......... 81% 425K 62s 2023-11-18T19:12:50.799 INFO:tasks.workunit.client.1.smithi135.stderr:137650K .......... .......... .......... .......... .......... 81% 597K 62s 2023-11-18T19:12:50.934 INFO:tasks.workunit.client.1.smithi135.stderr:137700K .......... .......... .......... .......... .......... 81% 373K 62s 2023-11-18T19:12:51.067 INFO:tasks.workunit.client.1.smithi135.stderr:137750K .......... .......... .......... .......... .......... 81% 375K 62s 2023-11-18T19:12:51.159 INFO:tasks.workunit.client.1.smithi135.stderr:137800K .......... .......... .......... .......... .......... 81% 547K 62s 2023-11-18T19:12:51.335 INFO:tasks.workunit.client.1.smithi135.stderr:137850K .......... .......... .......... .......... .......... 81% 283K 62s 2023-11-18T19:12:51.417 INFO:tasks.workunit.client.1.smithi135.stderr:137900K .......... .......... .......... .......... .......... 81% 609K 61s 2023-11-18T19:12:51.645 INFO:tasks.workunit.client.1.smithi135.stderr:137950K .......... .......... .......... .......... .......... 81% 220K 61s 2023-11-18T19:12:51.645 INFO:tasks.workunit.client.1.smithi135.stderr:138000K .......... .......... .......... .......... .......... 81% 40.1M 61s 2023-11-18T19:12:51.814 INFO:tasks.workunit.client.1.smithi135.stderr:138050K .......... .......... .......... .......... .......... 81% 295K 61s 2023-11-18T19:12:51.945 INFO:tasks.workunit.client.1.smithi135.stderr:138100K .......... .......... .......... .......... .......... 81% 384K 61s 2023-11-18T19:12:52.084 INFO:tasks.workunit.client.1.smithi135.stderr:138150K .......... .......... .......... .......... .......... 81% 360K 61s 2023-11-18T19:12:52.221 INFO:tasks.workunit.client.1.smithi135.stderr:138200K .......... .......... .......... .......... .......... 82% 365K 61s 2023-11-18T19:12:52.317 INFO:tasks.workunit.client.1.smithi135.stderr:138250K .......... .......... .......... .......... .......... 82% 524K 61s 2023-11-18T19:12:52.459 INFO:tasks.workunit.client.1.smithi135.stderr:138300K .......... .......... .......... .......... .......... 82% 350K 61s 2023-11-18T19:12:52.601 INFO:tasks.workunit.client.1.smithi135.stderr:138350K .......... .......... .......... .......... .......... 82% 352K 61s 2023-11-18T19:12:52.697 INFO:tasks.workunit.client.1.smithi135.stderr:138400K .......... .......... .......... .......... .......... 82% 521K 61s 2023-11-18T19:12:52.788 INFO:tasks.workunit.client.1.smithi135.stderr:138450K .......... .......... .......... .......... .......... 82% 548K 60s 2023-11-18T19:12:52.914 INFO:tasks.workunit.client.1.smithi135.stderr:138500K .......... .......... .......... .......... .......... 82% 407K 60s 2023-11-18T19:12:53.003 INFO:tasks.workunit.client.1.smithi135.stderr:138550K .......... .......... .......... .......... .......... 82% 542K 60s 2023-11-18T19:12:53.144 INFO:tasks.workunit.client.1.smithi135.stderr:138600K .......... .......... .......... .......... .......... 82% 366K 60s 2023-11-18T19:12:53.234 INFO:tasks.workunit.client.1.smithi135.stderr:138650K .......... .......... .......... .......... .......... 82% 534K 60s 2023-11-18T19:12:53.360 INFO:tasks.workunit.client.1.smithi135.stderr:138700K .......... .......... .......... .......... .......... 82% 396K 60s 2023-11-18T19:12:53.458 INFO:tasks.workunit.client.1.smithi135.stderr:138750K .......... .......... .......... .......... .......... 82% 508K 60s 2023-11-18T19:12:53.548 INFO:tasks.workunit.client.1.smithi135.stderr:138800K .......... .......... .......... .......... .......... 82% 555K 60s 2023-11-18T19:12:53.672 INFO:tasks.workunit.client.1.smithi135.stderr:138850K .......... .......... .......... .......... .......... 82% 549K 60s 2023-11-18T19:12:53.769 INFO:tasks.workunit.client.1.smithi135.stderr:138900K .......... .......... .......... .......... .......... 82% 385K 60s 2023-11-18T19:12:53.860 INFO:tasks.workunit.client.1.smithi135.stderr:138950K .......... .......... .......... .......... .......... 82% 552K 59s 2023-11-18T19:12:53.944 INFO:tasks.workunit.client.1.smithi135.stderr:139000K .......... .......... .......... .......... .......... 82% 591K 59s 2023-11-18T19:12:54.034 INFO:tasks.workunit.client.1.smithi135.stderr:139050K .......... .......... .......... .......... .......... 82% 600K 59s 2023-11-18T19:12:54.142 INFO:tasks.workunit.client.1.smithi135.stderr:139100K .......... .......... .......... .......... .......... 82% 436K 59s 2023-11-18T19:12:54.229 INFO:tasks.workunit.client.1.smithi135.stderr:139150K .......... .......... .......... .......... .......... 82% 582K 59s 2023-11-18T19:12:54.319 INFO:tasks.workunit.client.1.smithi135.stderr:139200K .......... .......... .......... .......... .......... 82% 551K 59s 2023-11-18T19:12:54.406 INFO:tasks.workunit.client.1.smithi135.stderr:139250K .......... .......... .......... .......... .......... 82% 577K 59s 2023-11-18T19:12:54.501 INFO:tasks.workunit.client.1.smithi135.stderr:139300K .......... .......... .......... .......... .......... 82% 558K 59s 2023-11-18T19:12:54.585 INFO:tasks.workunit.client.1.smithi135.stderr:139350K .......... .......... .......... .......... .......... 82% 558K 59s 2023-11-18T19:12:54.677 INFO:tasks.workunit.client.1.smithi135.stderr:139400K .......... .......... .......... .......... .......... 82% 556K 59s 2023-11-18T19:12:54.768 INFO:tasks.workunit.client.1.smithi135.stderr:139450K .......... .......... .......... .......... .......... 82% 536K 58s 2023-11-18T19:12:54.920 INFO:tasks.workunit.client.1.smithi135.stderr:139500K .......... .......... .......... .......... .......... 82% 329K 58s 2023-11-18T19:12:54.956 INFO:tasks.workunit.client.1.smithi135.stderr:139550K .......... .......... .......... .......... .......... 82% 1.44M 58s 2023-11-18T19:12:55.078 INFO:tasks.workunit.client.1.smithi135.stderr:139600K .......... .......... .......... .......... .......... 82% 403K 58s 2023-11-18T19:12:55.084 INFO:tasks.workunit.client.0.smithi045.stdout: 32 8442 78 5351 19 4882 95 2023-11-18T19:12:55.163 INFO:tasks.workunit.client.1.smithi135.stderr:139650K .......... .......... .......... .......... .......... 82% 589K 58s 2023-11-18T19:12:55.255 INFO:tasks.workunit.client.1.smithi135.stderr:139700K .......... .......... .......... .......... .......... 82% 544K 58s 2023-11-18T19:12:55.369 INFO:tasks.workunit.client.1.smithi135.stderr:139750K .......... .......... .......... .......... .......... 82% 440K 58s 2023-11-18T19:12:55.459 INFO:tasks.workunit.client.1.smithi135.stderr:139800K .......... .......... .......... .......... .......... 82% 551K 58s 2023-11-18T19:12:55.566 INFO:tasks.workunit.client.1.smithi135.stderr:139850K .......... .......... .......... .......... .......... 82% 546K 58s 2023-11-18T19:12:55.655 INFO:tasks.workunit.client.1.smithi135.stderr:139900K .......... .......... .......... .......... .......... 83% 482K 58s 2023-11-18T19:12:55.776 INFO:tasks.workunit.client.1.smithi135.stderr:139950K .......... .......... .......... .......... .......... 83% 529K 57s 2023-11-18T19:12:55.868 INFO:tasks.workunit.client.1.smithi135.stderr:140000K .......... .......... .......... .......... .......... 83% 419K 57s 2023-11-18T19:12:55.964 INFO:tasks.workunit.client.1.smithi135.stderr:140050K .......... .......... .......... .......... .......... 83% 528K 57s 2023-11-18T19:12:56.058 INFO:tasks.workunit.client.1.smithi135.stderr:140100K .......... .......... .......... .......... .......... 83% 528K 57s 2023-11-18T19:12:56.144 INFO:tasks.workunit.client.1.smithi135.stderr:140150K .......... .......... .......... .......... .......... 83% 584K 57s 2023-11-18T19:12:56.224 INFO:tasks.workunit.client.1.smithi135.stderr:140200K .......... .......... .......... .......... .......... 83% 950K 57s 2023-11-18T19:12:56.280 INFO:tasks.workunit.client.1.smithi135.stderr:140250K .......... .......... .......... .......... .......... 83% 597K 57s 2023-11-18T19:12:56.366 INFO:tasks.workunit.client.1.smithi135.stderr:140300K .......... .......... .......... .......... .......... 83% 586K 57s 2023-11-18T19:12:56.448 INFO:tasks.workunit.client.1.smithi135.stderr:140350K .......... .......... .......... .......... .......... 83% 602K 57s 2023-11-18T19:12:56.537 INFO:tasks.workunit.client.1.smithi135.stderr:140400K .......... .......... .......... .......... .......... 83% 563K 56s 2023-11-18T19:12:56.632 INFO:tasks.workunit.client.1.smithi135.stderr:140450K .......... .......... .......... .......... .......... 83% 529K 56s 2023-11-18T19:12:56.708 INFO:tasks.workunit.client.1.smithi135.stderr:140500K .......... .......... .......... .......... .......... 83% 652K 56s 2023-11-18T19:12:56.793 INFO:tasks.workunit.client.1.smithi135.stderr:140550K .......... .......... .......... .......... .......... 83% 593K 56s 2023-11-18T19:12:56.881 INFO:tasks.workunit.client.1.smithi135.stderr:140600K .......... .......... .......... .......... .......... 83% 565K 56s 2023-11-18T19:12:56.971 INFO:tasks.workunit.client.1.smithi135.stderr:140650K .......... .......... .......... .......... .......... 83% 560K 56s 2023-11-18T19:12:57.025 INFO:tasks.workunit.client.1.smithi135.stderr:140700K .......... .......... .......... .......... .......... 83% 912K 56s 2023-11-18T19:12:57.116 INFO:tasks.workunit.client.1.smithi135.stderr:140750K .......... .......... .......... .......... .......... 83% 607K 56s 2023-11-18T19:12:57.334 INFO:tasks.workunit.client.1.smithi135.stderr:140800K .......... .......... .......... .......... .......... 83% 222K 56s 2023-11-18T19:12:57.334 INFO:tasks.workunit.client.1.smithi135.stderr:140850K .......... .......... .......... .......... .......... 83% 71.0M 56s 2023-11-18T19:12:57.417 INFO:tasks.workunit.client.1.smithi135.stderr:140900K .......... .......... .......... .......... .......... 83% 597K 55s 2023-11-18T19:12:57.533 INFO:tasks.workunit.client.1.smithi135.stderr:140950K .......... .......... .......... .......... .......... 83% 431K 55s 2023-11-18T19:12:57.627 INFO:tasks.workunit.client.1.smithi135.stderr:141000K .......... .......... .......... .......... .......... 83% 532K 55s 2023-11-18T19:12:57.717 INFO:tasks.workunit.client.1.smithi135.stderr:141050K .......... .......... .......... .......... .......... 83% 557K 55s 2023-11-18T19:12:57.848 INFO:tasks.workunit.client.1.smithi135.stderr:141100K .......... .......... .......... .......... .......... 83% 381K 55s 2023-11-18T19:12:57.936 INFO:tasks.workunit.client.1.smithi135.stderr:141150K .......... .......... .......... .......... .......... 83% 568K 55s 2023-11-18T19:12:58.036 INFO:tasks.workunit.client.1.smithi135.stderr:141200K .......... .......... .......... .......... .......... 83% 547K 55s 2023-11-18T19:12:58.126 INFO:tasks.workunit.client.1.smithi135.stderr:141250K .......... .......... .......... .......... .......... 83% 507K 55s 2023-11-18T19:12:58.300 INFO:tasks.workunit.client.1.smithi135.stderr:141300K .......... .......... .......... .......... .......... 83% 287K 55s 2023-11-18T19:12:58.363 INFO:tasks.workunit.client.1.smithi135.stderr:141350K .......... .......... .......... .......... .......... 83% 801K 55s 2023-11-18T19:12:58.470 INFO:tasks.workunit.client.1.smithi135.stderr:141400K .......... .......... .......... .......... .......... 83% 465K 54s 2023-11-18T19:12:58.598 INFO:tasks.workunit.client.1.smithi135.stderr:141450K .......... .......... .......... .......... .......... 83% 391K 54s 2023-11-18T19:12:58.697 INFO:tasks.workunit.client.1.smithi135.stderr:141500K .......... .......... .......... .......... .......... 83% 504K 54s 2023-11-18T19:12:58.817 INFO:tasks.workunit.client.1.smithi135.stderr:141550K .......... .......... .......... .......... .......... 84% 535K 54s 2023-11-18T19:12:58.935 INFO:tasks.workunit.client.1.smithi135.stderr:141600K .......... .......... .......... .......... .......... 84% 346K 54s 2023-11-18T19:12:59.045 INFO:tasks.workunit.client.1.smithi135.stderr:141650K .......... .......... .......... .......... .......... 84% 457K 54s 2023-11-18T19:12:59.144 INFO:tasks.workunit.client.1.smithi135.stderr:141700K .......... .......... .......... .......... .......... 84% 502K 54s 2023-11-18T19:12:59.284 INFO:tasks.workunit.client.1.smithi135.stderr:141750K .......... .......... .......... .......... .......... 84% 413K 54s 2023-11-18T19:12:59.381 INFO:tasks.workunit.client.1.smithi135.stderr:141800K .......... .......... .......... .......... .......... 84% 431K 54s 2023-11-18T19:12:59.502 INFO:tasks.workunit.client.1.smithi135.stderr:141850K .......... .......... .......... .......... .......... 84% 415K 54s 2023-11-18T19:12:59.597 INFO:tasks.workunit.client.1.smithi135.stderr:141900K .......... .......... .......... .......... .......... 84% 525K 53s 2023-11-18T19:12:59.706 INFO:tasks.workunit.client.1.smithi135.stderr:141950K .......... .......... .......... .......... .......... 84% 458K 53s 2023-11-18T19:12:59.800 INFO:tasks.workunit.client.1.smithi135.stderr:142000K .......... .......... .......... .......... .......... 84% 623K 53s 2023-11-18T19:12:59.885 INFO:tasks.workunit.client.1.smithi135.stderr:142050K .......... .......... .......... .......... .......... 84% 509K 53s 2023-11-18T19:12:59.973 INFO:tasks.workunit.client.1.smithi135.stderr:142100K .......... .......... .......... .......... .......... 84% 582K 53s 2023-11-18T19:13:00.072 INFO:tasks.workunit.client.1.smithi135.stderr:142150K .......... .......... .......... .......... .......... 84% 493K 53s 2023-11-18T19:13:00.181 INFO:tasks.workunit.client.1.smithi135.stderr:142200K .......... .......... .......... .......... .......... 84% 556K 53s 2023-11-18T19:13:00.268 INFO:tasks.workunit.client.1.smithi135.stderr:142250K .......... .......... .......... .......... .......... 84% 472K 53s 2023-11-18T19:13:00.356 INFO:tasks.workunit.client.1.smithi135.stderr:142300K .......... .......... .......... .......... .......... 84% 567K 53s 2023-11-18T19:13:00.452 INFO:tasks.workunit.client.1.smithi135.stderr:142350K .......... .......... .......... .......... .......... 84% 522K 53s 2023-11-18T19:13:00.662 INFO:tasks.workunit.client.1.smithi135.stderr:142400K .......... .......... .......... .......... .......... 84% 240K 52s 2023-11-18T19:13:00.662 INFO:tasks.workunit.client.1.smithi135.stderr:142450K .......... .......... .......... .......... .......... 84% 39.8M 52s 2023-11-18T19:13:00.760 INFO:tasks.workunit.client.1.smithi135.stderr:142500K .......... .......... .......... .......... .......... 84% 510K 52s 2023-11-18T19:13:00.865 INFO:tasks.workunit.client.1.smithi135.stderr:142550K .......... .......... .......... .......... .......... 84% 593K 52s 2023-11-18T19:13:00.956 INFO:tasks.workunit.client.1.smithi135.stderr:142600K .......... .......... .......... .......... .......... 84% 447K 52s 2023-11-18T19:13:01.066 INFO:tasks.workunit.client.1.smithi135.stderr:142650K .......... .......... .......... .......... .......... 84% 532K 52s 2023-11-18T19:13:01.159 INFO:tasks.workunit.client.1.smithi135.stderr:142700K .......... .......... .......... .......... .......... 84% 458K 52s 2023-11-18T19:13:01.245 INFO:tasks.workunit.client.1.smithi135.stderr:142750K .......... .......... .......... .......... .......... 84% 578K 52s 2023-11-18T19:13:01.363 INFO:tasks.workunit.client.1.smithi135.stderr:142800K .......... .......... .......... .......... .......... 84% 422K 52s 2023-11-18T19:13:01.467 INFO:tasks.workunit.client.1.smithi135.stderr:142850K .......... .......... .......... .......... .......... 84% 483K 52s 2023-11-18T19:13:01.567 INFO:tasks.workunit.client.1.smithi135.stderr:142900K .......... .......... .......... .......... .......... 84% 571K 51s 2023-11-18T19:13:01.658 INFO:tasks.workunit.client.1.smithi135.stderr:142950K .......... .......... .......... .......... .......... 84% 483K 51s 2023-11-18T19:13:01.812 INFO:tasks.workunit.client.1.smithi135.stderr:143000K .......... .......... .......... .......... .......... 84% 325K 51s 2023-11-18T19:13:01.861 INFO:tasks.workunit.client.1.smithi135.stderr:143050K .......... .......... .......... .......... .......... 84% 1.00M 51s 2023-11-18T19:13:01.995 INFO:tasks.workunit.client.1.smithi135.stderr:143100K .......... .......... .......... .......... .......... 84% 379K 51s 2023-11-18T19:13:02.094 INFO:tasks.workunit.client.1.smithi135.stderr:143150K .......... .......... .......... .......... .......... 84% 495K 51s 2023-11-18T19:13:02.217 INFO:tasks.workunit.client.1.smithi135.stderr:143200K .......... .......... .......... .......... .......... 84% 405K 51s 2023-11-18T19:13:02.356 INFO:tasks.workunit.client.1.smithi135.stderr:143250K .......... .......... .......... .......... .......... 85% 361K 51s 2023-11-18T19:13:02.466 INFO:tasks.workunit.client.1.smithi135.stderr:143300K .......... .......... .......... .......... .......... 85% 452K 51s 2023-11-18T19:13:02.580 INFO:tasks.workunit.client.1.smithi135.stderr:143350K .......... .......... .......... .......... .......... 85% 447K 51s 2023-11-18T19:13:02.704 INFO:tasks.workunit.client.1.smithi135.stderr:143400K .......... .......... .......... .......... .......... 85% 398K 50s 2023-11-18T19:13:02.819 INFO:tasks.workunit.client.1.smithi135.stderr:143450K .......... .......... .......... .......... .......... 85% 438K 50s 2023-11-18T19:13:02.925 INFO:tasks.workunit.client.1.smithi135.stderr:143500K .......... .......... .......... .......... .......... 85% 466K 50s 2023-11-18T19:13:03.055 INFO:tasks.workunit.client.1.smithi135.stderr:143550K .......... .......... .......... .......... .......... 85% 484K 50s 2023-11-18T19:13:03.134 INFO:tasks.workunit.client.1.smithi135.stderr:143600K .......... .......... .......... .......... .......... 85% 475K 50s 2023-11-18T19:13:03.214 INFO:tasks.workunit.client.1.smithi135.stderr:143650K .......... .......... .......... .......... .......... 85% 622K 50s 2023-11-18T19:13:03.310 INFO:tasks.workunit.client.1.smithi135.stderr:143700K .......... .......... .......... .......... .......... 85% 519K 50s 2023-11-18T19:13:03.403 INFO:tasks.workunit.client.1.smithi135.stderr:143750K .......... .......... .......... .......... .......... 85% 542K 50s 2023-11-18T19:13:03.505 INFO:tasks.workunit.client.1.smithi135.stderr:143800K .......... .......... .......... .......... .......... 85% 539K 50s 2023-11-18T19:13:03.591 INFO:tasks.workunit.client.1.smithi135.stderr:143850K .......... .......... .......... .......... .......... 85% 526K 50s 2023-11-18T19:13:03.710 INFO:tasks.workunit.client.1.smithi135.stderr:143900K .......... .......... .......... .......... .......... 85% 559K 49s 2023-11-18T19:13:03.798 INFO:tasks.workunit.client.1.smithi135.stderr:143950K .......... .......... .......... .......... .......... 85% 425K 49s 2023-11-18T19:13:03.886 INFO:tasks.workunit.client.1.smithi135.stderr:144000K .......... .......... .......... .......... .......... 85% 572K 49s 2023-11-18T19:13:03.982 INFO:tasks.workunit.client.1.smithi135.stderr:144050K .......... .......... .......... .......... .......... 85% 521K 49s 2023-11-18T19:13:04.103 INFO:tasks.workunit.client.1.smithi135.stderr:144100K .......... .......... .......... .......... .......... 85% 413K 49s 2023-11-18T19:13:04.194 INFO:tasks.workunit.client.1.smithi135.stderr:144150K .......... .......... .......... .......... .......... 85% 549K 49s 2023-11-18T19:13:04.304 INFO:tasks.workunit.client.1.smithi135.stderr:144200K .......... .......... .......... .......... .......... 85% 453K 49s 2023-11-18T19:13:04.404 INFO:tasks.workunit.client.1.smithi135.stderr:144250K .......... .......... .......... .......... .......... 85% 499K 49s 2023-11-18T19:13:04.494 INFO:tasks.workunit.client.1.smithi135.stderr:144300K .......... .......... .......... .......... .......... 85% 558K 49s 2023-11-18T19:13:04.638 INFO:tasks.workunit.client.1.smithi135.stderr:144350K .......... .......... .......... .......... .......... 85% 351K 49s 2023-11-18T19:13:04.746 INFO:tasks.workunit.client.1.smithi135.stderr:144400K .......... .......... .......... .......... .......... 85% 456K 48s 2023-11-18T19:13:04.848 INFO:tasks.workunit.client.1.smithi135.stderr:144450K .......... .......... .......... .......... .......... 85% 523K 48s 2023-11-18T19:13:04.938 INFO:tasks.workunit.client.1.smithi135.stderr:144500K .......... .......... .......... .......... .......... 85% 518K 48s 2023-11-18T19:13:05.030 INFO:tasks.workunit.client.1.smithi135.stderr:144550K .......... .......... .......... .......... .......... 85% 544K 48s 2023-11-18T19:13:05.084 INFO:tasks.workunit.client.0.smithi045.stdout: 33 8165 96 4888 8 5016 109 2023-11-18T19:13:05.132 INFO:tasks.workunit.client.1.smithi135.stderr:144600K .......... .......... .......... .......... .......... 85% 491K 48s 2023-11-18T19:13:05.299 INFO:tasks.workunit.client.1.smithi135.stderr:144650K .......... .......... .......... .......... .......... 85% 299K 48s 2023-11-18T19:13:05.357 INFO:tasks.workunit.client.1.smithi135.stderr:144700K .......... .......... .......... .......... .......... 85% 852K 48s 2023-11-18T19:13:05.468 INFO:tasks.workunit.client.1.smithi135.stderr:144750K .......... .......... .......... .......... .......... 85% 452K 48s 2023-11-18T19:13:05.558 INFO:tasks.workunit.client.1.smithi135.stderr:144800K .......... .......... .......... .......... .......... 85% 560K 48s 2023-11-18T19:13:05.643 INFO:tasks.workunit.client.1.smithi135.stderr:144850K .......... .......... .......... .......... .......... 85% 580K 48s 2023-11-18T19:13:05.783 INFO:tasks.workunit.client.1.smithi135.stderr:144900K .......... .......... .......... .......... .......... 85% 378K 47s 2023-11-18T19:13:05.877 INFO:tasks.workunit.client.1.smithi135.stderr:144950K .......... .......... .......... .......... .......... 86% 497K 47s 2023-11-18T19:13:05.984 INFO:tasks.workunit.client.1.smithi135.stderr:145000K .......... .......... .......... .......... .......... 86% 467K 47s 2023-11-18T19:13:06.091 INFO:tasks.workunit.client.1.smithi135.stderr:145050K .......... .......... .......... .......... .......... 86% 467K 47s 2023-11-18T19:13:06.181 INFO:tasks.workunit.client.1.smithi135.stderr:145100K .......... .......... .......... .......... .......... 86% 555K 47s 2023-11-18T19:13:06.284 INFO:tasks.workunit.client.1.smithi135.stderr:145150K .......... .......... .......... .......... .......... 86% 539K 47s 2023-11-18T19:13:06.486 INFO:tasks.workunit.client.1.smithi135.stderr:145200K .......... .......... .......... .......... .......... 86% 236K 47s 2023-11-18T19:13:06.542 INFO:tasks.workunit.client.1.smithi135.stderr:145250K .......... .......... .......... .......... .......... 86% 892K 47s 2023-11-18T19:13:06.686 INFO:tasks.workunit.client.1.smithi135.stderr:145300K .......... .......... .......... .......... .......... 86% 346K 47s 2023-11-18T19:13:06.824 INFO:tasks.workunit.client.1.smithi135.stderr:145350K .......... .......... .......... .......... .......... 86% 366K 47s 2023-11-18T19:13:06.959 INFO:tasks.workunit.client.1.smithi135.stderr:145400K .......... .......... .......... .......... .......... 86% 368K 46s 2023-11-18T19:13:07.070 INFO:tasks.workunit.client.1.smithi135.stderr:145450K .......... .......... .......... .......... .......... 86% 453K 46s 2023-11-18T19:13:07.187 INFO:tasks.workunit.client.1.smithi135.stderr:145500K .......... .......... .......... .......... .......... 86% 424K 46s 2023-11-18T19:13:07.292 INFO:tasks.workunit.client.1.smithi135.stderr:145550K .......... .......... .......... .......... .......... 86% 477K 46s 2023-11-18T19:13:07.380 INFO:tasks.workunit.client.1.smithi135.stderr:145600K .......... .......... .......... .......... .......... 86% 585K 46s 2023-11-18T19:13:07.507 INFO:tasks.workunit.client.1.smithi135.stderr:145650K .......... .......... .......... .......... .......... 86% 386K 46s 2023-11-18T19:13:07.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:13:07.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:13:07.626 INFO:tasks.workunit.client.1.smithi135.stderr:145700K .......... .......... .......... .......... .......... 86% 422K 46s 2023-11-18T19:13:07.716 INFO:tasks.workunit.client.1.smithi135.stderr:145750K .......... .......... .......... .......... .......... 86% 556K 46s 2023-11-18T19:13:07.849 INFO:tasks.workunit.client.1.smithi135.stderr:145800K .......... .......... .......... .......... .......... 86% 392K 46s 2023-11-18T19:13:07.939 INFO:tasks.workunit.client.1.smithi135.stderr:145850K .......... .......... .......... .......... .......... 86% 524K 46s 2023-11-18T19:13:08.060 INFO:tasks.workunit.client.1.smithi135.stderr:145900K .......... .......... .......... .......... .......... 86% 412K 46s 2023-11-18T19:13:08.167 INFO:tasks.workunit.client.1.smithi135.stderr:145950K .......... .......... .......... .......... .......... 86% 467K 45s 2023-11-18T19:13:08.274 INFO:tasks.workunit.client.1.smithi135.stderr:146000K .......... .......... .......... .......... .......... 86% 469K 45s 2023-11-18T19:13:08.353 INFO:tasks.workunit.client.1.smithi135.stderr:146050K .......... .......... .......... .......... .......... 86% 632K 45s 2023-11-18T19:13:08.442 INFO:tasks.workunit.client.1.smithi135.stderr:146100K .......... .......... .......... .......... .......... 86% 557K 45s 2023-11-18T19:13:08.540 INFO:tasks.workunit.client.1.smithi135.stderr:146150K .......... .......... .......... .......... .......... 86% 525K 45s 2023-11-18T19:13:08.625 INFO:tasks.workunit.client.1.smithi135.stderr:146200K .......... .......... .......... .......... .......... 86% 571K 45s 2023-11-18T19:13:08.732 INFO:tasks.workunit.client.1.smithi135.stderr:146250K .......... .......... .......... .......... .......... 86% 517K 45s 2023-11-18T19:13:08.815 INFO:tasks.workunit.client.1.smithi135.stderr:146300K .......... .......... .......... .......... .......... 86% 539K 45s 2023-11-18T19:13:08.897 INFO:tasks.workunit.client.1.smithi135.stderr:146350K .......... .......... .......... .......... .......... 86% 607K 45s 2023-11-18T19:13:09.003 INFO:tasks.workunit.client.1.smithi135.stderr:146400K .......... .......... .......... .......... .......... 86% 473K 44s 2023-11-18T19:13:09.088 INFO:tasks.workunit.client.1.smithi135.stderr:146450K .......... .......... .......... .......... .......... 86% 588K 44s 2023-11-18T19:13:09.178 INFO:tasks.workunit.client.1.smithi135.stderr:146500K .......... .......... .......... .......... .......... 86% 569K 44s 2023-11-18T19:13:09.273 INFO:tasks.workunit.client.1.smithi135.stderr:146550K .......... .......... .......... .......... .......... 86% 513K 44s 2023-11-18T19:13:09.384 INFO:tasks.workunit.client.1.smithi135.stderr:146600K .......... .......... .......... .......... .......... 86% 453K 44s 2023-11-18T19:13:09.470 INFO:tasks.workunit.client.1.smithi135.stderr:146650K .......... .......... .......... .......... .......... 87% 578K 44s 2023-11-18T19:13:09.584 INFO:tasks.workunit.client.1.smithi135.stderr:146700K .......... .......... .......... .......... .......... 87% 604K 44s 2023-11-18T19:13:09.669 INFO:tasks.workunit.client.1.smithi135.stderr:146750K .......... .......... .......... .......... .......... 87% 430K 44s 2023-11-18T19:13:09.788 INFO:tasks.workunit.client.1.smithi135.stderr:146800K .......... .......... .......... .......... .......... 87% 421K 44s 2023-11-18T19:13:09.881 INFO:tasks.workunit.client.1.smithi135.stderr:146850K .......... .......... .......... .......... .......... 87% 535K 44s 2023-11-18T19:13:09.970 INFO:tasks.workunit.client.1.smithi135.stderr:146900K .......... .......... .......... .......... .......... 87% 567K 43s 2023-11-18T19:13:10.071 INFO:tasks.workunit.client.1.smithi135.stderr:146950K .......... .......... .......... .......... .......... 87% 508K 43s 2023-11-18T19:13:10.149 INFO:tasks.workunit.client.1.smithi135.stderr:147000K .......... .......... .......... .......... .......... 87% 622K 43s 2023-11-18T19:13:10.230 INFO:tasks.workunit.client.1.smithi135.stderr:147050K .......... .......... .......... .......... .......... 87% 614K 43s 2023-11-18T19:13:10.322 INFO:tasks.workunit.client.1.smithi135.stderr:147100K .......... .......... .......... .......... .......... 87% 542K 43s 2023-11-18T19:13:10.518 INFO:tasks.workunit.client.1.smithi135.stderr:147150K .......... .......... .......... .......... .......... 87% 256K 43s 2023-11-18T19:13:10.556 INFO:tasks.workunit.client.1.smithi135.stderr:147200K .......... .......... .......... .......... .......... 87% 1.27M 43s 2023-11-18T19:13:10.653 INFO:tasks.workunit.client.1.smithi135.stderr:147250K .......... .......... .......... .......... .......... 87% 512K 43s 2023-11-18T19:13:10.759 INFO:tasks.workunit.client.1.smithi135.stderr:147300K .......... .......... .......... .......... .......... 87% 525K 43s 2023-11-18T19:13:10.861 INFO:tasks.workunit.client.1.smithi135.stderr:147350K .......... .......... .......... .......... .......... 87% 445K 43s 2023-11-18T19:13:10.962 INFO:tasks.workunit.client.1.smithi135.stderr:147400K .......... .......... .......... .......... .......... 87% 568K 42s 2023-11-18T19:13:11.056 INFO:tasks.workunit.client.1.smithi135.stderr:147450K .......... .......... .......... .......... .......... 87% 468K 42s 2023-11-18T19:13:11.174 INFO:tasks.workunit.client.1.smithi135.stderr:147500K .......... .......... .......... .......... .......... 87% 439K 42s 2023-11-18T19:13:11.261 INFO:tasks.workunit.client.1.smithi135.stderr:147550K .......... .......... .......... .......... .......... 87% 550K 42s 2023-11-18T19:13:11.392 INFO:tasks.workunit.client.1.smithi135.stderr:147600K .......... .......... .......... .......... .......... 87% 498K 42s 2023-11-18T19:13:11.487 INFO:tasks.workunit.client.1.smithi135.stderr:147650K .......... .......... .......... .......... .......... 87% 397K 42s 2023-11-18T19:13:11.579 INFO:tasks.workunit.client.1.smithi135.stderr:147700K .......... .......... .......... .......... .......... 87% 549K 42s 2023-11-18T19:13:11.692 INFO:tasks.workunit.client.1.smithi135.stderr:147750K .......... .......... .......... .......... .......... 87% 537K 42s 2023-11-18T19:13:11.779 INFO:tasks.workunit.client.1.smithi135.stderr:147800K .......... .......... .......... .......... .......... 87% 464K 42s 2023-11-18T19:13:11.907 INFO:tasks.workunit.client.1.smithi135.stderr:147850K .......... .......... .......... .......... .......... 87% 528K 42s 2023-11-18T19:13:11.999 INFO:tasks.workunit.client.1.smithi135.stderr:147900K .......... .......... .......... .......... .......... 87% 401K 41s 2023-11-18T19:13:12.105 INFO:tasks.workunit.client.1.smithi135.stderr:147950K .......... .......... .......... .......... .......... 87% 489K 41s 2023-11-18T19:13:12.196 INFO:tasks.workunit.client.1.smithi135.stderr:148000K .......... .......... .......... .......... .......... 87% 522K 41s 2023-11-18T19:13:12.301 INFO:tasks.workunit.client.1.smithi135.stderr:148050K .......... .......... .......... .......... .......... 87% 561K 41s 2023-11-18T19:13:12.395 INFO:tasks.workunit.client.1.smithi135.stderr:148100K .......... .......... .......... .......... .......... 87% 459K 41s 2023-11-18T19:13:12.505 INFO:tasks.workunit.client.1.smithi135.stderr:148150K .......... .......... .......... .......... .......... 87% 455K 41s 2023-11-18T19:13:12.599 INFO:tasks.workunit.client.1.smithi135.stderr:148200K .......... .......... .......... .......... .......... 87% 530K 41s 2023-11-18T19:13:12.691 INFO:tasks.workunit.client.1.smithi135.stderr:148250K .......... .......... .......... .......... .......... 87% 542K 41s 2023-11-18T19:13:12.777 INFO:tasks.workunit.client.1.smithi135.stderr:148300K .......... .......... .......... .......... .......... 88% 580K 41s 2023-11-18T19:13:12.862 INFO:tasks.workunit.client.1.smithi135.stderr:148350K .......... .......... .......... .......... .......... 88% 592K 41s 2023-11-18T19:13:12.943 INFO:tasks.workunit.client.1.smithi135.stderr:148400K .......... .......... .......... .......... .......... 88% 618K 40s 2023-11-18T19:13:13.028 INFO:tasks.workunit.client.1.smithi135.stderr:148450K .......... .......... .......... .......... .......... 88% 589K 40s 2023-11-18T19:13:13.114 INFO:tasks.workunit.client.1.smithi135.stderr:148500K .......... .......... .......... .......... .......... 88% 687K 40s 2023-11-18T19:13:13.192 INFO:tasks.workunit.client.1.smithi135.stderr:148550K .......... .......... .......... .......... .......... 88% 547K 40s 2023-11-18T19:13:13.263 INFO:tasks.workunit.client.1.smithi135.stderr:148600K .......... .......... .......... .......... .......... 88% 704K 40s 2023-11-18T19:13:13.354 INFO:tasks.workunit.client.1.smithi135.stderr:148650K .......... .......... .......... .......... .......... 88% 617K 40s 2023-11-18T19:13:13.438 INFO:tasks.workunit.client.1.smithi135.stderr:148700K .......... .......... .......... .......... .......... 88% 530K 40s 2023-11-18T19:13:13.528 INFO:tasks.workunit.client.1.smithi135.stderr:148750K .......... .......... .......... .......... .......... 88% 558K 40s 2023-11-18T19:13:13.616 INFO:tasks.workunit.client.1.smithi135.stderr:148800K .......... .......... .......... .......... .......... 88% 565K 40s 2023-11-18T19:13:13.677 INFO:tasks.workunit.client.1.smithi135.stderr:148850K .......... .......... .......... .......... .......... 88% 834K 40s 2023-11-18T19:13:13.862 INFO:tasks.workunit.client.1.smithi135.stderr:148900K .......... .......... .......... .......... .......... 88% 270K 39s 2023-11-18T19:13:13.862 INFO:tasks.workunit.client.1.smithi135.stderr:148950K .......... .......... .......... .......... .......... 88% 85.6M 39s 2023-11-18T19:13:13.971 INFO:tasks.workunit.client.1.smithi135.stderr:149000K .......... .......... .......... .......... .......... 88% 460K 39s 2023-11-18T19:13:14.051 INFO:tasks.workunit.client.1.smithi135.stderr:149050K .......... .......... .......... .......... .......... 88% 623K 39s 2023-11-18T19:13:14.139 INFO:tasks.workunit.client.1.smithi135.stderr:149100K .......... .......... .......... .......... .......... 88% 574K 39s 2023-11-18T19:13:14.240 INFO:tasks.workunit.client.1.smithi135.stderr:149150K .......... .......... .......... .......... .......... 88% 492K 39s 2023-11-18T19:13:14.330 INFO:tasks.workunit.client.1.smithi135.stderr:149200K .......... .......... .......... .......... .......... 88% 580K 39s 2023-11-18T19:13:14.417 INFO:tasks.workunit.client.1.smithi135.stderr:149250K .......... .......... .......... .......... .......... 88% 550K 39s 2023-11-18T19:13:14.499 INFO:tasks.workunit.client.1.smithi135.stderr:149300K .......... .......... .......... .......... .......... 88% 607K 39s 2023-11-18T19:13:14.585 INFO:tasks.workunit.client.1.smithi135.stderr:149350K .......... .......... .......... .......... .......... 88% 577K 39s 2023-11-18T19:13:14.666 INFO:tasks.workunit.client.1.smithi135.stderr:149400K .......... .......... .......... .......... .......... 88% 619K 38s 2023-11-18T19:13:14.752 INFO:tasks.workunit.client.1.smithi135.stderr:149450K .......... .......... .......... .......... .......... 88% 586K 38s 2023-11-18T19:13:14.843 INFO:tasks.workunit.client.1.smithi135.stderr:149500K .......... .......... .......... .......... .......... 88% 548K 38s 2023-11-18T19:13:15.025 INFO:tasks.workunit.client.1.smithi135.stderr:149550K .......... .......... .......... .......... .......... 88% 275K 38s 2023-11-18T19:13:15.026 INFO:tasks.workunit.client.1.smithi135.stderr:149600K .......... .......... .......... .......... .......... 88% 41.6M 38s 2023-11-18T19:13:15.084 INFO:tasks.workunit.client.0.smithi045.stdout: 34 8399 43 5258 25 3748 69 2023-11-18T19:13:15.151 INFO:tasks.workunit.client.1.smithi135.stderr:149650K .......... .......... .......... .......... .......... 88% 399K 38s 2023-11-18T19:13:15.235 INFO:tasks.workunit.client.1.smithi135.stderr:149700K .......... .......... .......... .......... .......... 88% 593K 38s 2023-11-18T19:13:15.335 INFO:tasks.workunit.client.1.smithi135.stderr:149750K .......... .......... .......... .......... .......... 88% 503K 38s 2023-11-18T19:13:15.429 INFO:tasks.workunit.client.1.smithi135.stderr:149800K .......... .......... .......... .......... .......... 88% 526K 38s 2023-11-18T19:13:15.549 INFO:tasks.workunit.client.1.smithi135.stderr:149850K .......... .......... .......... .......... .......... 88% 417K 37s 2023-11-18T19:13:15.638 INFO:tasks.workunit.client.1.smithi135.stderr:149900K .......... .......... .......... .......... .......... 88% 563K 37s 2023-11-18T19:13:15.728 INFO:tasks.workunit.client.1.smithi135.stderr:149950K .......... .......... .......... .......... .......... 88% 556K 37s 2023-11-18T19:13:15.841 INFO:tasks.workunit.client.1.smithi135.stderr:150000K .......... .......... .......... .......... .......... 89% 508K 37s 2023-11-18T19:13:15.928 INFO:tasks.workunit.client.1.smithi135.stderr:150050K .......... .......... .......... .......... .......... 89% 492K 37s 2023-11-18T19:13:16.039 INFO:tasks.workunit.client.1.smithi135.stderr:150100K .......... .......... .......... .......... .......... 89% 468K 37s 2023-11-18T19:13:16.142 INFO:tasks.workunit.client.1.smithi135.stderr:150150K .......... .......... .......... .......... .......... 89% 465K 37s 2023-11-18T19:13:16.264 INFO:tasks.workunit.client.1.smithi135.stderr:150200K .......... .......... .......... .......... .......... 89% 414K 37s 2023-11-18T19:13:16.345 INFO:tasks.workunit.client.1.smithi135.stderr:150250K .......... .......... .......... .......... .......... 89% 614K 37s 2023-11-18T19:13:16.424 INFO:tasks.workunit.client.1.smithi135.stderr:150300K .......... .......... .......... .......... .......... 89% 630K 37s 2023-11-18T19:13:16.509 INFO:tasks.workunit.client.1.smithi135.stderr:150350K .......... .......... .......... .......... .......... 89% 590K 36s 2023-11-18T19:13:16.602 INFO:tasks.workunit.client.1.smithi135.stderr:150400K .......... .......... .......... .......... .......... 89% 537K 36s 2023-11-18T19:13:16.693 INFO:tasks.workunit.client.1.smithi135.stderr:150450K .......... .......... .......... .......... .......... 89% 546K 36s 2023-11-18T19:13:16.783 INFO:tasks.workunit.client.1.smithi135.stderr:150500K .......... .......... .......... .......... .......... 89% 562K 36s 2023-11-18T19:13:16.871 INFO:tasks.workunit.client.1.smithi135.stderr:150550K .......... .......... .......... .......... .......... 89% 569K 36s 2023-11-18T19:13:16.955 INFO:tasks.workunit.client.1.smithi135.stderr:150600K .......... .......... .......... .......... .......... 89% 588K 36s 2023-11-18T19:13:17.039 INFO:tasks.workunit.client.1.smithi135.stderr:150650K .......... .......... .......... .......... .......... 89% 597K 36s 2023-11-18T19:13:17.133 INFO:tasks.workunit.client.1.smithi135.stderr:150700K .......... .......... .......... .......... .......... 89% 531K 36s 2023-11-18T19:13:17.269 INFO:tasks.workunit.client.1.smithi135.stderr:150750K .......... .......... .......... .......... .......... 89% 371K 36s 2023-11-18T19:13:17.318 INFO:tasks.workunit.client.1.smithi135.stderr:150800K .......... .......... .......... .......... .......... 89% 1009K 36s 2023-11-18T19:13:17.407 INFO:tasks.workunit.client.1.smithi135.stderr:150850K .......... .......... .......... .......... .......... 89% 557K 35s 2023-11-18T19:13:17.497 INFO:tasks.workunit.client.1.smithi135.stderr:150900K .......... .......... .......... .......... .......... 89% 579K 35s 2023-11-18T19:13:17.619 INFO:tasks.workunit.client.1.smithi135.stderr:150950K .......... .......... .......... .......... .......... 89% 401K 35s 2023-11-18T19:13:17.705 INFO:tasks.workunit.client.1.smithi135.stderr:151000K .......... .......... .......... .......... .......... 89% 590K 35s 2023-11-18T19:13:17.799 INFO:tasks.workunit.client.1.smithi135.stderr:151050K .......... .......... .......... .......... .......... 89% 526K 35s 2023-11-18T19:13:17.912 INFO:tasks.workunit.client.1.smithi135.stderr:151100K .......... .......... .......... .......... .......... 89% 506K 35s 2023-11-18T19:13:17.996 INFO:tasks.workunit.client.1.smithi135.stderr:151150K .......... .......... .......... .......... .......... 89% 507K 35s 2023-11-18T19:13:18.083 INFO:tasks.workunit.client.1.smithi135.stderr:151200K .......... .......... .......... .......... .......... 89% 576K 35s 2023-11-18T19:13:18.176 INFO:tasks.workunit.client.1.smithi135.stderr:151250K .......... .......... .......... .......... .......... 89% 534K 35s 2023-11-18T19:13:18.269 INFO:tasks.workunit.client.1.smithi135.stderr:151300K .......... .......... .......... .......... .......... 89% 540K 35s 2023-11-18T19:13:18.482 INFO:tasks.workunit.client.1.smithi135.stderr:151350K .......... .......... .......... .......... .......... 89% 523K 34s 2023-11-18T19:13:18.503 INFO:tasks.workunit.client.1.smithi135.stderr:151400K .......... .......... .......... .......... .......... 89% 361K 34s 2023-11-18T19:13:18.537 INFO:tasks.workunit.client.1.smithi135.stderr:151450K .......... .......... .......... .......... .......... 89% 1.51M 34s 2023-11-18T19:13:18.662 INFO:tasks.workunit.client.1.smithi135.stderr:151500K .......... .......... .......... .......... .......... 89% 393K 34s 2023-11-18T19:13:18.749 INFO:tasks.workunit.client.1.smithi135.stderr:151550K .......... .......... .......... .......... .......... 89% 574K 34s 2023-11-18T19:13:18.867 INFO:tasks.workunit.client.1.smithi135.stderr:151600K .......... .......... .......... .......... .......... 89% 426K 34s 2023-11-18T19:13:18.971 INFO:tasks.workunit.client.1.smithi135.stderr:151650K .......... .......... .......... .......... .......... 89% 482K 34s 2023-11-18T19:13:19.059 INFO:tasks.workunit.client.1.smithi135.stderr:151700K .......... .......... .......... .......... .......... 90% 566K 34s 2023-11-18T19:13:19.144 INFO:tasks.workunit.client.1.smithi135.stderr:151750K .......... .......... .......... .......... .......... 90% 587K 34s 2023-11-18T19:13:19.263 INFO:tasks.workunit.client.1.smithi135.stderr:151800K .......... .......... .......... .......... .......... 90% 425K 34s 2023-11-18T19:13:19.354 INFO:tasks.workunit.client.1.smithi135.stderr:151850K .......... .......... .......... .......... .......... 90% 539K 33s 2023-11-18T19:13:19.470 INFO:tasks.workunit.client.1.smithi135.stderr:151900K .......... .......... .......... .......... .......... 90% 473K 33s 2023-11-18T19:13:19.561 INFO:tasks.workunit.client.1.smithi135.stderr:151950K .......... .......... .......... .......... .......... 90% 497K 33s 2023-11-18T19:13:19.659 INFO:tasks.workunit.client.1.smithi135.stderr:152000K .......... .......... .......... .......... .......... 90% 508K 33s 2023-11-18T19:13:19.793 INFO:tasks.workunit.client.1.smithi135.stderr:152050K .......... .......... .......... .......... .......... 90% 373K 33s 2023-11-18T19:13:19.887 INFO:tasks.workunit.client.1.smithi135.stderr:152100K .......... .......... .......... .......... .......... 90% 535K 33s 2023-11-18T19:13:19.987 INFO:tasks.workunit.client.1.smithi135.stderr:152150K .......... .......... .......... .......... .......... 90% 502K 33s 2023-11-18T19:13:20.081 INFO:tasks.workunit.client.1.smithi135.stderr:152200K .......... .......... .......... .......... .......... 90% 527K 33s 2023-11-18T19:13:20.217 INFO:tasks.workunit.client.1.smithi135.stderr:152250K .......... .......... .......... .......... .......... 90% 368K 33s 2023-11-18T19:13:20.302 INFO:tasks.workunit.client.1.smithi135.stderr:152300K .......... .......... .......... .......... .......... 90% 588K 33s 2023-11-18T19:13:20.450 INFO:tasks.workunit.client.1.smithi135.stderr:152350K .......... .......... .......... .......... .......... 90% 339K 32s 2023-11-18T19:13:20.546 INFO:tasks.workunit.client.1.smithi135.stderr:152400K .......... .......... .......... .......... .......... 90% 516K 32s 2023-11-18T19:13:20.704 INFO:tasks.workunit.client.1.smithi135.stderr:152450K .......... .......... .......... .......... .......... 90% 319K 32s 2023-11-18T19:13:20.815 INFO:tasks.workunit.client.1.smithi135.stderr:152500K .......... .......... .......... .......... .......... 90% 448K 32s 2023-11-18T19:13:20.901 INFO:tasks.workunit.client.1.smithi135.stderr:152550K .......... .......... .......... .......... .......... 90% 579K 32s 2023-11-18T19:13:21.004 INFO:tasks.workunit.client.1.smithi135.stderr:152600K .......... .......... .......... .......... .......... 90% 485K 32s 2023-11-18T19:13:21.143 INFO:tasks.workunit.client.1.smithi135.stderr:152650K .......... .......... .......... .......... .......... 90% 361K 32s 2023-11-18T19:13:21.238 INFO:tasks.workunit.client.1.smithi135.stderr:152700K .......... .......... .......... .......... .......... 90% 524K 32s 2023-11-18T19:13:21.356 INFO:tasks.workunit.client.1.smithi135.stderr:152750K .......... .......... .......... .......... .......... 90% 424K 32s 2023-11-18T19:13:21.431 INFO:tasks.workunit.client.1.smithi135.stderr:152800K .......... .......... .......... .......... .......... 90% 664K 32s 2023-11-18T19:13:21.509 INFO:tasks.workunit.client.1.smithi135.stderr:152850K .......... .......... .......... .......... .......... 90% 644K 31s 2023-11-18T19:13:21.602 INFO:tasks.workunit.client.1.smithi135.stderr:152900K .......... .......... .......... .......... .......... 90% 650K 31s 2023-11-18T19:13:21.679 INFO:tasks.workunit.client.1.smithi135.stderr:152950K .......... .......... .......... .......... .......... 90% 538K 31s 2023-11-18T19:13:21.768 INFO:tasks.workunit.client.1.smithi135.stderr:153000K .......... .......... .......... .......... .......... 90% 561K 31s 2023-11-18T19:13:21.887 INFO:tasks.workunit.client.1.smithi135.stderr:153050K .......... .......... .......... .......... .......... 90% 421K 31s 2023-11-18T19:13:22.002 INFO:tasks.workunit.client.1.smithi135.stderr:153100K .......... .......... .......... .......... .......... 90% 594K 31s 2023-11-18T19:13:22.088 INFO:tasks.workunit.client.1.smithi135.stderr:153150K .......... .......... .......... .......... .......... 90% 427K 31s 2023-11-18T19:13:22.174 INFO:tasks.workunit.client.1.smithi135.stderr:153200K .......... .......... .......... .......... .......... 90% 586K 31s 2023-11-18T19:13:22.279 INFO:tasks.workunit.client.1.smithi135.stderr:153250K .......... .......... .......... .......... .......... 90% 480K 31s 2023-11-18T19:13:22.388 INFO:tasks.workunit.client.1.smithi135.stderr:153300K .......... .......... .......... .......... .......... 90% 451K 31s 2023-11-18T19:13:22.555 INFO:tasks.workunit.client.1.smithi135.stderr:153350K .......... .......... .......... .......... .......... 91% 301K 30s 2023-11-18T19:13:22.624 INFO:tasks.workunit.client.1.smithi135.stderr:153400K .......... .......... .......... .......... .......... 91% 994K 30s 2023-11-18T19:13:22.720 INFO:tasks.workunit.client.1.smithi135.stderr:153450K .......... .......... .......... .......... .......... 91% 436K 30s 2023-11-18T19:13:22.815 INFO:tasks.workunit.client.1.smithi135.stderr:153500K .......... .......... .......... .......... .......... 91% 525K 30s 2023-11-18T19:13:22.927 INFO:tasks.workunit.client.1.smithi135.stderr:153550K .......... .......... .......... .......... .......... 91% 446K 30s 2023-11-18T19:13:23.034 INFO:tasks.workunit.client.1.smithi135.stderr:153600K .......... .......... .......... .......... .......... 91% 489K 30s 2023-11-18T19:13:23.129 INFO:tasks.workunit.client.1.smithi135.stderr:153650K .......... .......... .......... .......... .......... 91% 503K 30s 2023-11-18T19:13:23.237 INFO:tasks.workunit.client.1.smithi135.stderr:153700K .......... .......... .......... .......... .......... 91% 506K 30s 2023-11-18T19:13:23.347 INFO:tasks.workunit.client.1.smithi135.stderr:153750K .......... .......... .......... .......... .......... 91% 418K 30s 2023-11-18T19:13:23.454 INFO:tasks.workunit.client.1.smithi135.stderr:153800K .......... .......... .......... .......... .......... 91% 556K 30s 2023-11-18T19:13:23.550 INFO:tasks.workunit.client.1.smithi135.stderr:153850K .......... .......... .......... .......... .......... 91% 442K 29s 2023-11-18T19:13:23.647 INFO:tasks.workunit.client.1.smithi135.stderr:153900K .......... .......... .......... .......... .......... 91% 519K 29s 2023-11-18T19:13:23.742 INFO:tasks.workunit.client.1.smithi135.stderr:153950K .......... .......... .......... .......... .......... 91% 527K 29s 2023-11-18T19:13:23.822 INFO:tasks.workunit.client.1.smithi135.stderr:154000K .......... .......... .......... .......... .......... 91% 622K 29s 2023-11-18T19:13:23.920 INFO:tasks.workunit.client.1.smithi135.stderr:154050K .......... .......... .......... .......... .......... 91% 594K 29s 2023-11-18T19:13:24.006 INFO:tasks.workunit.client.1.smithi135.stderr:154100K .......... .......... .......... .......... .......... 91% 503K 29s 2023-11-18T19:13:24.107 INFO:tasks.workunit.client.1.smithi135.stderr:154150K .......... .......... .......... .......... .......... 91% 539K 29s 2023-11-18T19:13:24.198 INFO:tasks.workunit.client.1.smithi135.stderr:154200K .......... .......... .......... .......... .......... 91% 504K 29s 2023-11-18T19:13:24.303 INFO:tasks.workunit.client.1.smithi135.stderr:154250K .......... .......... .......... .......... .......... 91% 606K 29s 2023-11-18T19:13:24.379 INFO:tasks.workunit.client.1.smithi135.stderr:154300K .......... .......... .......... .......... .......... 91% 507K 29s 2023-11-18T19:13:24.456 INFO:tasks.workunit.client.1.smithi135.stderr:154350K .......... .......... .......... .......... .......... 91% 652K 28s 2023-11-18T19:13:24.536 INFO:tasks.workunit.client.1.smithi135.stderr:154400K .......... .......... .......... .......... .......... 91% 623K 28s 2023-11-18T19:13:24.622 INFO:tasks.workunit.client.1.smithi135.stderr:154450K .......... .......... .......... .......... .......... 91% 581K 28s 2023-11-18T19:13:24.725 INFO:tasks.workunit.client.1.smithi135.stderr:154500K .......... .......... .......... .......... .......... 91% 528K 28s 2023-11-18T19:13:24.801 INFO:tasks.workunit.client.1.smithi135.stderr:154550K .......... .......... .......... .......... .......... 91% 590K 28s 2023-11-18T19:13:24.877 INFO:tasks.workunit.client.1.smithi135.stderr:154600K .......... .......... .......... .......... .......... 91% 663K 28s 2023-11-18T19:13:24.955 INFO:tasks.workunit.client.1.smithi135.stderr:154650K .......... .......... .......... .......... .......... 91% 641K 28s 2023-11-18T19:13:25.031 INFO:tasks.workunit.client.1.smithi135.stderr:154700K .......... .......... .......... .......... .......... 91% 852K 28s 2023-11-18T19:13:25.084 INFO:tasks.workunit.client.0.smithi045.stdout: 34 8954 51 5564 22 4237 103 2023-11-18T19:13:25.094 INFO:tasks.workunit.client.1.smithi135.stderr:154750K .......... .......... .......... .......... .......... 91% 622K 28s 2023-11-18T19:13:25.164 INFO:tasks.workunit.client.1.smithi135.stderr:154800K .......... .......... .......... .......... .......... 91% 713K 28s 2023-11-18T19:13:25.257 INFO:tasks.workunit.client.1.smithi135.stderr:154850K .......... .......... .......... .......... .......... 91% 535K 27s 2023-11-18T19:13:25.390 INFO:tasks.workunit.client.1.smithi135.stderr:154900K .......... .......... .......... .......... .......... 91% 379K 27s 2023-11-18T19:13:25.435 INFO:tasks.workunit.client.1.smithi135.stderr:154950K .......... .......... .......... .......... .......... 91% 1.07M 27s 2023-11-18T19:13:25.527 INFO:tasks.workunit.client.1.smithi135.stderr:155000K .......... .......... .......... .......... .......... 91% 543K 27s 2023-11-18T19:13:25.600 INFO:tasks.workunit.client.1.smithi135.stderr:155050K .......... .......... .......... .......... .......... 92% 689K 27s 2023-11-18T19:13:25.696 INFO:tasks.workunit.client.1.smithi135.stderr:155100K .......... .......... .......... .......... .......... 92% 520K 27s 2023-11-18T19:13:25.786 INFO:tasks.workunit.client.1.smithi135.stderr:155150K .......... .......... .......... .......... .......... 92% 619K 27s 2023-11-18T19:13:25.884 INFO:tasks.workunit.client.1.smithi135.stderr:155200K .......... .......... .......... .......... .......... 92% 468K 27s 2023-11-18T19:13:25.961 INFO:tasks.workunit.client.1.smithi135.stderr:155250K .......... .......... .......... .......... .......... 92% 650K 27s 2023-11-18T19:13:26.033 INFO:tasks.workunit.client.1.smithi135.stderr:155300K .......... .......... .......... .......... .......... 92% 697K 27s 2023-11-18T19:13:26.117 INFO:tasks.workunit.client.1.smithi135.stderr:155350K .......... .......... .......... .......... .......... 92% 600K 26s 2023-11-18T19:13:26.200 INFO:tasks.workunit.client.1.smithi135.stderr:155400K .......... .......... .......... .......... .......... 92% 624K 26s 2023-11-18T19:13:26.289 INFO:tasks.workunit.client.1.smithi135.stderr:155450K .......... .......... .......... .......... .......... 92% 547K 26s 2023-11-18T19:13:26.375 INFO:tasks.workunit.client.1.smithi135.stderr:155500K .......... .......... .......... .......... .......... 92% 567K 26s 2023-11-18T19:13:26.460 INFO:tasks.workunit.client.1.smithi135.stderr:155550K .......... .......... .......... .......... .......... 92% 591K 26s 2023-11-18T19:13:26.548 INFO:tasks.workunit.client.1.smithi135.stderr:155600K .......... .......... .......... .......... .......... 92% 571K 26s 2023-11-18T19:13:26.630 INFO:tasks.workunit.client.1.smithi135.stderr:155650K .......... .......... .......... .......... .......... 92% 605K 26s 2023-11-18T19:13:26.710 INFO:tasks.workunit.client.1.smithi135.stderr:155700K .......... .......... .......... .......... .......... 92% 622K 26s 2023-11-18T19:13:26.800 INFO:tasks.workunit.client.1.smithi135.stderr:155750K .......... .......... .......... .......... .......... 92% 608K 26s 2023-11-18T19:13:26.888 INFO:tasks.workunit.client.1.smithi135.stderr:155800K .......... .......... .......... .......... .......... 92% 524K 25s 2023-11-18T19:13:27.088 INFO:tasks.workunit.client.1.smithi135.stderr:155850K .......... .......... .......... .......... .......... 92% 554K 25s 2023-11-18T19:13:27.088 INFO:tasks.workunit.client.1.smithi135.stderr:155900K .......... .......... .......... .......... .......... 92% 457K 25s 2023-11-18T19:13:27.189 INFO:tasks.workunit.client.1.smithi135.stderr:155950K .......... .......... .......... .......... .......... 92% 492K 25s 2023-11-18T19:13:27.302 INFO:tasks.workunit.client.1.smithi135.stderr:156000K .......... .......... .......... .......... .......... 92% 442K 25s 2023-11-18T19:13:27.433 INFO:tasks.workunit.client.1.smithi135.stderr:156050K .......... .......... .......... .......... .......... 92% 473K 25s 2023-11-18T19:13:27.535 INFO:tasks.workunit.client.1.smithi135.stderr:156100K .......... .......... .......... .......... .......... 92% 393K 25s 2023-11-18T19:13:27.628 INFO:tasks.workunit.client.1.smithi135.stderr:156150K .......... .......... .......... .......... .......... 92% 539K 25s 2023-11-18T19:13:27.736 INFO:tasks.workunit.client.1.smithi135.stderr:156200K .......... .......... .......... .......... .......... 92% 492K 25s 2023-11-18T19:13:27.838 INFO:tasks.workunit.client.1.smithi135.stderr:156250K .......... .......... .......... .......... .......... 92% 460K 25s 2023-11-18T19:13:27.938 INFO:tasks.workunit.client.1.smithi135.stderr:156300K .......... .......... .......... .......... .......... 92% 526K 25s 2023-11-18T19:13:28.056 INFO:tasks.workunit.client.1.smithi135.stderr:156350K .......... .......... .......... .......... .......... 92% 409K 24s 2023-11-18T19:13:28.269 INFO:tasks.workunit.client.1.smithi135.stderr:156400K .......... .......... .......... .......... .......... 92% 236K 24s 2023-11-18T19:13:28.269 INFO:tasks.workunit.client.1.smithi135.stderr:156450K .......... .......... .......... .......... .......... 92% 63.2M 24s 2023-11-18T19:13:28.418 INFO:tasks.workunit.client.1.smithi135.stderr:156500K .......... .......... .......... .......... .......... 92% 384K 24s 2023-11-18T19:13:28.528 INFO:tasks.workunit.client.1.smithi135.stderr:156550K .......... .......... .......... .......... .......... 92% 388K 24s 2023-11-18T19:13:28.658 INFO:tasks.workunit.client.1.smithi135.stderr:156600K .......... .......... .......... .......... .......... 92% 383K 24s 2023-11-18T19:13:28.777 INFO:tasks.workunit.client.1.smithi135.stderr:156650K .......... .......... .......... .......... .......... 92% 428K 24s 2023-11-18T19:13:28.902 INFO:tasks.workunit.client.1.smithi135.stderr:156700K .......... .......... .......... .......... .......... 92% 392K 24s 2023-11-18T19:13:29.004 INFO:tasks.workunit.client.1.smithi135.stderr:156750K .......... .......... .......... .......... .......... 93% 522K 24s 2023-11-18T19:13:29.119 INFO:tasks.workunit.client.1.smithi135.stderr:156800K .......... .......... .......... .......... .......... 93% 415K 24s 2023-11-18T19:13:29.218 INFO:tasks.workunit.client.1.smithi135.stderr:156850K .......... .......... .......... .......... .......... 93% 504K 23s 2023-11-18T19:13:29.350 INFO:tasks.workunit.client.1.smithi135.stderr:156900K .......... .......... .......... .......... .......... 93% 379K 23s 2023-11-18T19:13:29.437 INFO:tasks.workunit.client.1.smithi135.stderr:156950K .......... .......... .......... .......... .......... 93% 627K 23s 2023-11-18T19:13:29.526 INFO:tasks.workunit.client.1.smithi135.stderr:157000K .......... .......... .......... .......... .......... 93% 521K 23s 2023-11-18T19:13:29.605 INFO:tasks.workunit.client.1.smithi135.stderr:157050K .......... .......... .......... .......... .......... 93% 626K 23s 2023-11-18T19:13:29.714 INFO:tasks.workunit.client.1.smithi135.stderr:157100K .......... .......... .......... .......... .......... 93% 472K 23s 2023-11-18T19:13:29.806 INFO:tasks.workunit.client.1.smithi135.stderr:157150K .......... .......... .......... .......... .......... 93% 530K 23s 2023-11-18T19:13:29.920 INFO:tasks.workunit.client.1.smithi135.stderr:157200K .......... .......... .......... .......... .......... 93% 496K 23s 2023-11-18T19:13:30.008 INFO:tasks.workunit.client.1.smithi135.stderr:157250K .......... .......... .......... .......... .......... 93% 492K 23s 2023-11-18T19:13:30.102 INFO:tasks.workunit.client.1.smithi135.stderr:157300K .......... .......... .......... .......... .......... 93% 558K 23s 2023-11-18T19:13:30.202 INFO:tasks.workunit.client.1.smithi135.stderr:157350K .......... .......... .......... .......... .......... 93% 479K 22s 2023-11-18T19:13:30.307 INFO:tasks.workunit.client.1.smithi135.stderr:157400K .......... .......... .......... .......... .......... 93% 521K 22s 2023-11-18T19:13:30.403 INFO:tasks.workunit.client.1.smithi135.stderr:157450K .......... .......... .......... .......... .......... 93% 479K 22s 2023-11-18T19:13:30.542 INFO:tasks.workunit.client.1.smithi135.stderr:157500K .......... .......... .......... .......... .......... 93% 360K 22s 2023-11-18T19:13:30.637 INFO:tasks.workunit.client.1.smithi135.stderr:157550K .......... .......... .......... .......... .......... 93% 599K 22s 2023-11-18T19:13:30.771 INFO:tasks.workunit.client.1.smithi135.stderr:157600K .......... .......... .......... .......... .......... 93% 343K 22s 2023-11-18T19:13:30.874 INFO:tasks.workunit.client.1.smithi135.stderr:157650K .......... .......... .......... .......... .......... 93% 503K 22s 2023-11-18T19:13:31.009 INFO:tasks.workunit.client.1.smithi135.stderr:157700K .......... .......... .......... .......... .......... 93% 359K 22s 2023-11-18T19:13:31.125 INFO:tasks.workunit.client.1.smithi135.stderr:157750K .......... .......... .......... .......... .......... 93% 433K 22s 2023-11-18T19:13:31.223 INFO:tasks.workunit.client.1.smithi135.stderr:157800K .......... .......... .......... .......... .......... 93% 508K 22s 2023-11-18T19:13:31.323 INFO:tasks.workunit.client.1.smithi135.stderr:157850K .......... .......... .......... .......... .......... 93% 503K 21s 2023-11-18T19:13:31.558 INFO:tasks.workunit.client.1.smithi135.stderr:157900K .......... .......... .......... .......... .......... 93% 213K 21s 2023-11-18T19:13:31.584 INFO:tasks.workunit.client.1.smithi135.stderr:157950K .......... .......... .......... .......... .......... 93% 1.84M 21s 2023-11-18T19:13:31.744 INFO:tasks.workunit.client.1.smithi135.stderr:158000K .......... .......... .......... .......... .......... 93% 359K 21s 2023-11-18T19:13:31.834 INFO:tasks.workunit.client.1.smithi135.stderr:158050K .......... .......... .......... .......... .......... 93% 451K 21s 2023-11-18T19:13:32.003 INFO:tasks.workunit.client.1.smithi135.stderr:158100K .......... .......... .......... .......... .......... 93% 305K 21s 2023-11-18T19:13:32.103 INFO:tasks.workunit.client.1.smithi135.stderr:158150K .......... .......... .......... .......... .......... 93% 478K 21s 2023-11-18T19:13:32.278 INFO:tasks.workunit.client.1.smithi135.stderr:158200K .......... .......... .......... .......... .......... 93% 298K 21s 2023-11-18T19:13:32.374 INFO:tasks.workunit.client.1.smithi135.stderr:158250K .......... .......... .......... .......... .......... 93% 487K 21s 2023-11-18T19:13:32.520 INFO:tasks.workunit.client.1.smithi135.stderr:158300K .......... .......... .......... .......... .......... 93% 342K 21s 2023-11-18T19:13:32.653 INFO:tasks.workunit.client.1.smithi135.stderr:158350K .......... .......... .......... .......... .......... 93% 377K 20s 2023-11-18T19:13:32.762 INFO:tasks.workunit.client.1.smithi135.stderr:158400K .......... .......... .......... .......... .......... 93% 460K 20s 2023-11-18T19:13:32.887 INFO:tasks.workunit.client.1.smithi135.stderr:158450K .......... .......... .......... .......... .......... 94% 412K 20s 2023-11-18T19:13:32.983 INFO:tasks.workunit.client.1.smithi135.stderr:158500K .......... .......... .......... .......... .......... 94% 500K 20s 2023-11-18T19:13:33.079 INFO:tasks.workunit.client.1.smithi135.stderr:158550K .......... .......... .......... .......... .......... 94% 599K 20s 2023-11-18T19:13:33.176 INFO:tasks.workunit.client.1.smithi135.stderr:158600K .......... .......... .......... .......... .......... 94% 454K 20s 2023-11-18T19:13:33.276 INFO:tasks.workunit.client.1.smithi135.stderr:158650K .......... .......... .......... .......... .......... 94% 528K 20s 2023-11-18T19:13:33.377 INFO:tasks.workunit.client.1.smithi135.stderr:158700K .......... .......... .......... .......... .......... 94% 472K 20s 2023-11-18T19:13:33.474 INFO:tasks.workunit.client.1.smithi135.stderr:158750K .......... .......... .......... .......... .......... 94% 515K 20s 2023-11-18T19:13:33.570 INFO:tasks.workunit.client.1.smithi135.stderr:158800K .......... .......... .......... .......... .......... 94% 519K 20s 2023-11-18T19:13:33.659 INFO:tasks.workunit.client.1.smithi135.stderr:158850K .......... .......... .......... .......... .......... 94% 562K 19s 2023-11-18T19:13:33.762 INFO:tasks.workunit.client.1.smithi135.stderr:158900K .......... .......... .......... .......... .......... 94% 492K 19s 2023-11-18T19:13:33.857 INFO:tasks.workunit.client.1.smithi135.stderr:158950K .......... .......... .......... .......... .......... 94% 522K 19s 2023-11-18T19:13:33.997 INFO:tasks.workunit.client.1.smithi135.stderr:159000K .......... .......... .......... .......... .......... 94% 359K 19s 2023-11-18T19:13:34.091 INFO:tasks.workunit.client.1.smithi135.stderr:159050K .......... .......... .......... .......... .......... 94% 526K 19s 2023-11-18T19:13:34.215 INFO:tasks.workunit.client.1.smithi135.stderr:159100K .......... .......... .......... .......... .......... 94% 404K 19s 2023-11-18T19:13:34.344 INFO:tasks.workunit.client.1.smithi135.stderr:159150K .......... .......... .......... .......... .......... 94% 387K 19s 2023-11-18T19:13:34.442 INFO:tasks.workunit.client.1.smithi135.stderr:159200K .......... .......... .......... .......... .......... 94% 512K 19s 2023-11-18T19:13:34.553 INFO:tasks.workunit.client.1.smithi135.stderr:159250K .......... .......... .......... .......... .......... 94% 451K 19s 2023-11-18T19:13:34.659 INFO:tasks.workunit.client.1.smithi135.stderr:159300K .......... .......... .......... .......... .......... 94% 470K 19s 2023-11-18T19:13:34.759 INFO:tasks.workunit.client.1.smithi135.stderr:159350K .......... .......... .......... .......... .......... 94% 511K 18s 2023-11-18T19:13:34.891 INFO:tasks.workunit.client.1.smithi135.stderr:159400K .......... .......... .......... .......... .......... 94% 373K 18s 2023-11-18T19:13:35.032 INFO:tasks.workunit.client.1.smithi135.stderr:159450K .......... .......... .......... .......... .......... 94% 353K 18s 2023-11-18T19:13:35.084 INFO:tasks.workunit.client.0.smithi045.stdout: 34 9535 32 4748 38 4217 91 2023-11-18T19:13:35.125 INFO:tasks.workunit.client.1.smithi135.stderr:159500K .......... .......... .......... .......... .......... 94% 559K 18s 2023-11-18T19:13:35.264 INFO:tasks.workunit.client.1.smithi135.stderr:159550K .......... .......... .......... .......... .......... 94% 352K 18s 2023-11-18T19:13:35.369 INFO:tasks.workunit.client.1.smithi135.stderr:159600K .......... .......... .......... .......... .......... 94% 476K 18s 2023-11-18T19:13:35.515 INFO:tasks.workunit.client.1.smithi135.stderr:159650K .......... .......... .......... .......... .......... 94% 342K 18s 2023-11-18T19:13:35.621 INFO:tasks.workunit.client.1.smithi135.stderr:159700K .......... .......... .......... .......... .......... 94% 472K 18s 2023-11-18T19:13:35.768 INFO:tasks.workunit.client.1.smithi135.stderr:159750K .......... .......... .......... .......... .......... 94% 339K 18s 2023-11-18T19:13:35.887 INFO:tasks.workunit.client.1.smithi135.stderr:159800K .......... .......... .......... .......... .......... 94% 421K 18s 2023-11-18T19:13:35.990 INFO:tasks.workunit.client.1.smithi135.stderr:159850K .......... .......... .......... .......... .......... 94% 487K 17s 2023-11-18T19:13:36.148 INFO:tasks.workunit.client.1.smithi135.stderr:159900K .......... .......... .......... .......... .......... 94% 332K 17s 2023-11-18T19:13:36.252 INFO:tasks.workunit.client.1.smithi135.stderr:159950K .......... .......... .......... .......... .......... 94% 450K 17s 2023-11-18T19:13:36.346 INFO:tasks.workunit.client.1.smithi135.stderr:160000K .......... .......... .......... .......... .......... 94% 571K 17s 2023-11-18T19:13:36.473 INFO:tasks.workunit.client.1.smithi135.stderr:160050K .......... .......... .......... .......... .......... 94% 373K 17s 2023-11-18T19:13:36.578 INFO:tasks.workunit.client.1.smithi135.stderr:160100K .......... .......... .......... .......... .......... 95% 474K 17s 2023-11-18T19:13:36.682 INFO:tasks.workunit.client.1.smithi135.stderr:160150K .......... .......... .......... .......... .......... 95% 484K 17s 2023-11-18T19:13:36.794 INFO:tasks.workunit.client.1.smithi135.stderr:160200K .......... .......... .......... .......... .......... 95% 447K 17s 2023-11-18T19:13:36.892 INFO:tasks.workunit.client.1.smithi135.stderr:160250K .......... .......... .......... .......... .......... 95% 534K 17s 2023-11-18T19:13:36.989 INFO:tasks.workunit.client.1.smithi135.stderr:160300K .......... .......... .......... .......... .......... 95% 490K 17s 2023-11-18T19:13:37.106 INFO:tasks.workunit.client.1.smithi135.stderr:160350K .......... .......... .......... .......... .......... 95% 429K 16s 2023-11-18T19:13:37.193 INFO:tasks.workunit.client.1.smithi135.stderr:160400K .......... .......... .......... .......... .......... 95% 569K 16s 2023-11-18T19:13:37.290 INFO:tasks.workunit.client.1.smithi135.stderr:160450K .......... .......... .......... .......... .......... 95% 543K 16s 2023-11-18T19:13:37.383 INFO:tasks.workunit.client.1.smithi135.stderr:160500K .......... .......... .......... .......... .......... 95% 510K 16s 2023-11-18T19:13:37.476 INFO:tasks.workunit.client.1.smithi135.stderr:160550K .......... .......... .......... .......... .......... 95% 540K 16s 2023-11-18T19:13:37.610 INFO:tasks.workunit.client.1.smithi135.stderr:160600K .......... .......... .......... .......... .......... 95% 375K 16s 2023-11-18T19:13:37.706 INFO:tasks.workunit.client.1.smithi135.stderr:160650K .......... .......... .......... .......... .......... 95% 533K 16s 2023-11-18T19:13:37.839 INFO:tasks.workunit.client.1.smithi135.stderr:160700K .......... .......... .......... .......... .......... 95% 386K 16s 2023-11-18T19:13:37.966 INFO:tasks.workunit.client.1.smithi135.stderr:160750K .......... .......... .......... .......... .......... 95% 374K 16s 2023-11-18T19:13:38.103 INFO:tasks.workunit.client.1.smithi135.stderr:160800K .......... .......... .......... .......... .......... 95% 464K 16s 2023-11-18T19:13:38.193 INFO:tasks.workunit.client.1.smithi135.stderr:160850K .......... .......... .......... .......... .......... 95% 421K 15s 2023-11-18T19:13:38.411 INFO:tasks.workunit.client.1.smithi135.stderr:160900K .......... .......... .......... .......... .......... 95% 230K 15s 2023-11-18T19:13:38.477 INFO:tasks.workunit.client.1.smithi135.stderr:160950K .......... .......... .......... .......... .......... 95% 753K 15s 2023-11-18T19:13:38.575 INFO:tasks.workunit.client.1.smithi135.stderr:161000K .......... .......... .......... .......... .......... 95% 511K 15s 2023-11-18T19:13:38.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:13:38.700 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:13:38.959 INFO:tasks.workunit.client.1.smithi135.stderr:161050K .......... .......... .......... .......... .......... 95% 130K 15s 2023-11-18T19:13:39.049 INFO:tasks.workunit.client.1.smithi135.stderr:161100K .......... .......... .......... .......... .......... 95% 550K 15s 2023-11-18T19:13:39.176 INFO:tasks.workunit.client.1.smithi135.stderr:161150K .......... .......... .......... .......... .......... 95% 559K 15s 2023-11-18T19:13:39.299 INFO:tasks.workunit.client.1.smithi135.stderr:161200K .......... .......... .......... .......... .......... 95% 312K 15s 2023-11-18T19:13:39.385 INFO:tasks.workunit.client.1.smithi135.stderr:161250K .......... .......... .......... .......... .......... 95% 588K 15s 2023-11-18T19:13:39.555 INFO:tasks.workunit.client.1.smithi135.stderr:161300K .......... .......... .......... .......... .......... 95% 294K 15s 2023-11-18T19:13:39.646 INFO:tasks.workunit.client.1.smithi135.stderr:161350K .......... .......... .......... .......... .......... 95% 550K 14s 2023-11-18T19:13:39.814 INFO:tasks.workunit.client.1.smithi135.stderr:161400K .......... .......... .......... .......... .......... 95% 379K 14s 2023-11-18T19:13:39.911 INFO:tasks.workunit.client.1.smithi135.stderr:161450K .......... .......... .......... .......... .......... 95% 373K 14s 2023-11-18T19:13:40.045 INFO:tasks.workunit.client.1.smithi135.stderr:161500K .......... .......... .......... .......... .......... 95% 373K 14s 2023-11-18T19:13:40.140 INFO:tasks.workunit.client.1.smithi135.stderr:161550K .......... .......... .......... .......... .......... 95% 525K 14s 2023-11-18T19:13:40.310 INFO:tasks.workunit.client.1.smithi135.stderr:161600K .......... .......... .......... .......... .......... 95% 295K 14s 2023-11-18T19:13:40.397 INFO:tasks.workunit.client.1.smithi135.stderr:161650K .......... .......... .......... .......... .......... 95% 574K 14s 2023-11-18T19:13:40.493 INFO:tasks.workunit.client.1.smithi135.stderr:161700K .......... .......... .......... .......... .......... 95% 520K 14s 2023-11-18T19:13:40.589 INFO:tasks.workunit.client.1.smithi135.stderr:161750K .......... .......... .......... .......... .......... 95% 520K 14s 2023-11-18T19:13:40.687 INFO:tasks.workunit.client.1.smithi135.stderr:161800K .......... .......... .......... .......... .......... 96% 515K 14s 2023-11-18T19:13:40.903 INFO:tasks.workunit.client.1.smithi135.stderr:161850K .......... .......... .......... .......... .......... 96% 231K 13s 2023-11-18T19:13:40.946 INFO:tasks.workunit.client.1.smithi135.stderr:161900K .......... .......... .......... .......... .......... 96% 1.12M 13s 2023-11-18T19:13:41.043 INFO:tasks.workunit.client.1.smithi135.stderr:161950K .......... .......... .......... .......... .......... 96% 517K 13s 2023-11-18T19:13:41.202 INFO:tasks.workunit.client.1.smithi135.stderr:162000K .......... .......... .......... .......... .......... 96% 315K 13s 2023-11-18T19:13:41.304 INFO:tasks.workunit.client.1.smithi135.stderr:162050K .......... .......... .......... .......... .......... 96% 490K 13s 2023-11-18T19:13:41.418 INFO:tasks.workunit.client.1.smithi135.stderr:162100K .......... .......... .......... .......... .......... 96% 435K 13s 2023-11-18T19:13:41.579 INFO:tasks.workunit.client.1.smithi135.stderr:162150K .......... .......... .......... .......... .......... 96% 321K 13s 2023-11-18T19:13:41.674 INFO:tasks.workunit.client.1.smithi135.stderr:162200K .......... .......... .......... .......... .......... 96% 502K 13s 2023-11-18T19:13:41.783 INFO:tasks.workunit.client.1.smithi135.stderr:162250K .......... .......... .......... .......... .......... 96% 535K 13s 2023-11-18T19:13:41.930 INFO:tasks.workunit.client.1.smithi135.stderr:162300K .......... .......... .......... .......... .......... 96% 309K 13s 2023-11-18T19:13:42.036 INFO:tasks.workunit.client.1.smithi135.stderr:162350K .......... .......... .......... .......... .......... 96% 468K 12s 2023-11-18T19:13:42.160 INFO:tasks.workunit.client.1.smithi135.stderr:162400K .......... .......... .......... .......... .......... 96% 403K 12s 2023-11-18T19:13:42.256 INFO:tasks.workunit.client.1.smithi135.stderr:162450K .......... .......... .......... .......... .......... 96% 523K 12s 2023-11-18T19:13:42.355 INFO:tasks.workunit.client.1.smithi135.stderr:162500K .......... .......... .......... .......... .......... 96% 503K 12s 2023-11-18T19:13:42.476 INFO:tasks.workunit.client.1.smithi135.stderr:162550K .......... .......... .......... .......... .......... 96% 414K 12s 2023-11-18T19:13:42.604 INFO:tasks.workunit.client.1.smithi135.stderr:162600K .......... .......... .......... .......... .......... 96% 509K 12s 2023-11-18T19:13:42.700 INFO:tasks.workunit.client.1.smithi135.stderr:162650K .......... .......... .......... .......... .......... 96% 399K 12s 2023-11-18T19:13:42.797 INFO:tasks.workunit.client.1.smithi135.stderr:162700K .......... .......... .......... .......... .......... 96% 533K 12s 2023-11-18T19:13:42.888 INFO:tasks.workunit.client.1.smithi135.stderr:162750K .......... .......... .......... .......... .......... 96% 528K 12s 2023-11-18T19:13:42.991 INFO:tasks.workunit.client.1.smithi135.stderr:162800K .......... .......... .......... .......... .......... 96% 484K 12s 2023-11-18T19:13:43.086 INFO:tasks.workunit.client.1.smithi135.stderr:162850K .......... .......... .......... .......... .......... 96% 527K 11s 2023-11-18T19:13:43.176 INFO:tasks.workunit.client.1.smithi135.stderr:162900K .......... .......... .......... .......... .......... 96% 554K 11s 2023-11-18T19:13:43.271 INFO:tasks.workunit.client.1.smithi135.stderr:162950K .......... .......... .......... .......... .......... 96% 530K 11s 2023-11-18T19:13:43.364 INFO:tasks.workunit.client.1.smithi135.stderr:163000K .......... .......... .......... .......... .......... 96% 538K 11s 2023-11-18T19:13:43.455 INFO:tasks.workunit.client.1.smithi135.stderr:163050K .......... .......... .......... .......... .......... 96% 549K 11s 2023-11-18T19:13:43.638 INFO:tasks.workunit.client.1.smithi135.stderr:163100K .......... .......... .......... .......... .......... 96% 277K 11s 2023-11-18T19:13:43.703 INFO:tasks.workunit.client.1.smithi135.stderr:163150K .......... .......... .......... .......... .......... 96% 1.10M 11s 2023-11-18T19:13:43.805 INFO:tasks.workunit.client.1.smithi135.stderr:163200K .......... .......... .......... .......... .......... 96% 400K 11s 2023-11-18T19:13:43.930 INFO:tasks.workunit.client.1.smithi135.stderr:163250K .......... .......... .......... .......... .......... 96% 400K 11s 2023-11-18T19:13:44.047 INFO:tasks.workunit.client.1.smithi135.stderr:163300K .......... .......... .......... .......... .......... 96% 427K 11s 2023-11-18T19:13:44.145 INFO:tasks.workunit.client.1.smithi135.stderr:163350K .......... .......... .......... .......... .......... 96% 518K 10s 2023-11-18T19:13:44.247 INFO:tasks.workunit.client.1.smithi135.stderr:163400K .......... .......... .......... .......... .......... 96% 483K 10s 2023-11-18T19:13:44.379 INFO:tasks.workunit.client.1.smithi135.stderr:163450K .......... .......... .......... .......... .......... 96% 379K 10s 2023-11-18T19:13:44.474 INFO:tasks.workunit.client.1.smithi135.stderr:163500K .......... .......... .......... .......... .......... 97% 530K 10s 2023-11-18T19:13:44.595 INFO:tasks.workunit.client.1.smithi135.stderr:163550K .......... .......... .......... .......... .......... 97% 412K 10s 2023-11-18T19:13:44.691 INFO:tasks.workunit.client.1.smithi135.stderr:163600K .......... .......... .......... .......... .......... 97% 531K 10s 2023-11-18T19:13:44.782 INFO:tasks.workunit.client.1.smithi135.stderr:163650K .......... .......... .......... .......... .......... 97% 536K 10s 2023-11-18T19:13:44.870 INFO:tasks.workunit.client.1.smithi135.stderr:163700K .......... .......... .......... .......... .......... 97% 571K 10s 2023-11-18T19:13:44.966 INFO:tasks.workunit.client.1.smithi135.stderr:163750K .......... .......... .......... .......... .......... 97% 569K 10s 2023-11-18T19:13:45.053 INFO:tasks.workunit.client.1.smithi135.stderr:163800K .......... .......... .......... .......... .......... 97% 524K 10s 2023-11-18T19:13:45.084 INFO:tasks.workunit.client.0.smithi045.stdout: 35 9140 30 5282 28 3765 72 2023-11-18T19:13:45.145 INFO:tasks.workunit.client.1.smithi135.stderr:163850K .......... .......... .......... .......... .......... 97% 563K 9s 2023-11-18T19:13:45.236 INFO:tasks.workunit.client.1.smithi135.stderr:163900K .......... .......... .......... .......... .......... 97% 531K 9s 2023-11-18T19:13:45.328 INFO:tasks.workunit.client.1.smithi135.stderr:163950K .......... .......... .......... .......... .......... 97% 546K 9s 2023-11-18T19:13:45.421 INFO:tasks.workunit.client.1.smithi135.stderr:164000K .......... .......... .......... .......... .......... 97% 538K 9s 2023-11-18T19:13:45.516 INFO:tasks.workunit.client.1.smithi135.stderr:164050K .......... .......... .......... .......... .......... 97% 540K 9s 2023-11-18T19:13:45.610 INFO:tasks.workunit.client.1.smithi135.stderr:164100K .......... .......... .......... .......... .......... 97% 516K 9s 2023-11-18T19:13:45.704 INFO:tasks.workunit.client.1.smithi135.stderr:164150K .......... .......... .......... .......... .......... 97% 534K 9s 2023-11-18T19:13:45.835 INFO:tasks.workunit.client.1.smithi135.stderr:164200K .......... .......... .......... .......... .......... 97% 530K 9s 2023-11-18T19:13:45.927 INFO:tasks.workunit.client.1.smithi135.stderr:164250K .......... .......... .......... .......... .......... 97% 389K 9s 2023-11-18T19:13:46.019 INFO:tasks.workunit.client.1.smithi135.stderr:164300K .......... .......... .......... .......... .......... 97% 540K 9s 2023-11-18T19:13:46.112 INFO:tasks.workunit.client.1.smithi135.stderr:164350K .......... .......... .......... .......... .......... 97% 542K 8s 2023-11-18T19:13:46.205 INFO:tasks.workunit.client.1.smithi135.stderr:164400K .......... .......... .......... .......... .......... 97% 862K 8s 2023-11-18T19:13:46.262 INFO:tasks.workunit.client.1.smithi135.stderr:164450K .......... .......... .......... .......... .......... 97% 540K 8s 2023-11-18T19:13:46.352 INFO:tasks.workunit.client.1.smithi135.stderr:164500K .......... .......... .......... .......... .......... 97% 556K 8s 2023-11-18T19:13:46.442 INFO:tasks.workunit.client.1.smithi135.stderr:164550K .......... .......... .......... .......... .......... 97% 555K 8s 2023-11-18T19:13:46.532 INFO:tasks.workunit.client.1.smithi135.stderr:164600K .......... .......... .......... .......... .......... 97% 561K 8s 2023-11-18T19:13:46.616 INFO:tasks.workunit.client.1.smithi135.stderr:164650K .......... .......... .......... .......... .......... 97% 615K 8s 2023-11-18T19:13:46.699 INFO:tasks.workunit.client.1.smithi135.stderr:164700K .......... .......... .......... .......... .......... 97% 577K 8s 2023-11-18T19:13:46.792 INFO:tasks.workunit.client.1.smithi135.stderr:164750K .......... .......... .......... .......... .......... 97% 571K 8s 2023-11-18T19:13:46.973 INFO:tasks.workunit.client.1.smithi135.stderr:164800K .......... .......... .......... .......... .......... 97% 268K 8s 2023-11-18T19:13:46.975 INFO:tasks.workunit.client.1.smithi135.stderr:164850K .......... .......... .......... .......... .......... 97% 44.0M 7s 2023-11-18T19:13:47.074 INFO:tasks.workunit.client.1.smithi135.stderr:164900K .......... .......... .......... .......... .......... 97% 504K 7s 2023-11-18T19:13:47.180 INFO:tasks.workunit.client.1.smithi135.stderr:164950K .......... .......... .......... .......... .......... 97% 471K 7s 2023-11-18T19:13:47.305 INFO:tasks.workunit.client.1.smithi135.stderr:165000K .......... .......... .......... .......... .......... 97% 399K 7s 2023-11-18T19:13:47.399 INFO:tasks.workunit.client.1.smithi135.stderr:165050K .......... .......... .......... .......... .......... 97% 537K 7s 2023-11-18T19:13:47.495 INFO:tasks.workunit.client.1.smithi135.stderr:165100K .......... .......... .......... .......... .......... 97% 525K 7s 2023-11-18T19:13:47.587 INFO:tasks.workunit.client.1.smithi135.stderr:165150K .......... .......... .......... .......... .......... 98% 534K 7s 2023-11-18T19:13:47.678 INFO:tasks.workunit.client.1.smithi135.stderr:165200K .......... .......... .......... .......... .......... 98% 558K 7s 2023-11-18T19:13:47.760 INFO:tasks.workunit.client.1.smithi135.stderr:165250K .......... .......... .......... .......... .......... 98% 600K 7s 2023-11-18T19:13:47.840 INFO:tasks.workunit.client.1.smithi135.stderr:165300K .......... .......... .......... .......... .......... 98% 635K 6s 2023-11-18T19:13:47.925 INFO:tasks.workunit.client.1.smithi135.stderr:165350K .......... .......... .......... .......... .......... 98% 578K 6s 2023-11-18T19:13:48.009 INFO:tasks.workunit.client.1.smithi135.stderr:165400K .......... .......... .......... .......... .......... 98% 596K 6s 2023-11-18T19:13:48.097 INFO:tasks.workunit.client.1.smithi135.stderr:165450K .......... .......... .......... .......... .......... 98% 569K 6s 2023-11-18T19:13:48.184 INFO:tasks.workunit.client.1.smithi135.stderr:165500K .......... .......... .......... .......... .......... 98% 575K 6s 2023-11-18T19:13:48.276 INFO:tasks.workunit.client.1.smithi135.stderr:165550K .......... .......... .......... .......... .......... 98% 833K 6s 2023-11-18T19:13:48.336 INFO:tasks.workunit.client.1.smithi135.stderr:165600K .......... .......... .......... .......... .......... 98% 545K 6s 2023-11-18T19:13:48.426 INFO:tasks.workunit.client.1.smithi135.stderr:165650K .......... .......... .......... .......... .......... 98% 573K 6s 2023-11-18T19:13:48.508 INFO:tasks.workunit.client.1.smithi135.stderr:165700K .......... .......... .......... .......... .......... 98% 585K 6s 2023-11-18T19:13:48.591 INFO:tasks.workunit.client.1.smithi135.stderr:165750K .......... .......... .......... .......... .......... 98% 607K 6s 2023-11-18T19:13:48.662 INFO:tasks.workunit.client.1.smithi135.stderr:165800K .......... .......... .......... .......... .......... 98% 698K 5s 2023-11-18T19:13:48.759 INFO:tasks.workunit.client.1.smithi135.stderr:165850K .......... .......... .......... .......... .......... 98% 536K 5s 2023-11-18T19:13:48.858 INFO:tasks.workunit.client.1.smithi135.stderr:165900K .......... .......... .......... .......... .......... 98% 493K 5s 2023-11-18T19:13:48.951 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-18T19:13:48.951 INFO:tasks.workunit.client.0.smithi045.stdout:Final score for writes: 35 2023-11-18T19:13:48.951 INFO:tasks.workunit.client.0.smithi045.stdout:Final score for reads : 6996 2023-11-18T19:13:48.951 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-18T19:13:48.953 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-18T19:13:48.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-18T19:13:48.958 INFO:tasks.workunit.client.1.smithi135.stderr:165950K .......... .......... .......... .......... .......... 98% 492K 5s 2023-11-18T19:13:49.055 INFO:tasks.workunit.client.1.smithi135.stderr:166000K .......... .......... .......... .......... .......... 98% 879K 5s 2023-11-18T19:13:49.104 INFO:tasks.workunit.client.1.smithi135.stderr:166050K .......... .......... .......... .......... .......... 98% 564K 5s 2023-11-18T19:13:49.200 INFO:tasks.workunit.client.1.smithi135.stderr:166100K .......... .......... .......... .......... .......... 98% 589K 5s 2023-11-18T19:13:49.291 INFO:tasks.workunit.client.1.smithi135.stderr:166150K .......... .......... .......... .......... .......... 98% 489K 5s 2023-11-18T19:13:49.394 INFO:tasks.workunit.client.1.smithi135.stderr:166200K .......... .......... .......... .......... .......... 98% 717K 5s 2023-11-18T19:13:49.457 INFO:tasks.workunit.client.1.smithi135.stderr:166250K .......... .......... .......... .......... .......... 98% 521K 5s 2023-11-18T19:13:49.544 INFO:tasks.workunit.client.1.smithi135.stderr:166300K .......... .......... .......... .......... .......... 98% 573K 4s 2023-11-18T19:13:49.627 INFO:tasks.workunit.client.1.smithi135.stderr:166350K .......... .......... .......... .......... .......... 98% 606K 4s 2023-11-18T19:13:49.675 INFO:tasks.workunit.client.1.smithi135.stderr:166400K .......... .......... .......... .......... .......... 98% 1.01M 4s 2023-11-18T19:13:49.762 INFO:tasks.workunit.client.1.smithi135.stderr:166450K .......... .......... .......... .......... .......... 98% 579K 4s 2023-11-18T19:13:49.838 INFO:tasks.workunit.client.1.smithi135.stderr:166500K .......... .......... .......... .......... .......... 98% 648K 4s 2023-11-18T19:13:49.890 INFO:tasks.workunit.client.1.smithi135.stderr:166550K .......... .......... .......... .......... .......... 98% 983K 4s 2023-11-18T19:13:49.982 INFO:tasks.workunit.client.1.smithi135.stderr:166600K .......... .......... .......... .......... .......... 98% 539K 4s 2023-11-18T19:13:50.073 INFO:tasks.workunit.client.1.smithi135.stderr:166650K .......... .......... .......... .......... .......... 98% 557K 4s 2023-11-18T19:13:50.129 INFO:tasks.workunit.client.1.smithi135.stderr:166700K .......... .......... .......... .......... .......... 98% 880K 4s 2023-11-18T19:13:50.205 INFO:tasks.workunit.client.1.smithi135.stderr:166750K .......... .......... .......... .......... .......... 98% 657K 4s 2023-11-18T19:13:50.261 INFO:tasks.workunit.client.1.smithi135.stderr:166800K .......... .......... .......... .......... .......... 98% 886K 3s 2023-11-18T19:13:50.347 INFO:tasks.workunit.client.1.smithi135.stderr:166850K .......... .......... .......... .......... .......... 99% 580K 3s 2023-11-18T19:13:50.439 INFO:tasks.workunit.client.1.smithi135.stderr:166900K .......... .......... .......... .......... .......... 99% 954K 3s 2023-11-18T19:13:50.485 INFO:tasks.workunit.client.1.smithi135.stderr:166950K .......... .......... .......... .......... .......... 99% 587K 3s 2023-11-18T19:13:50.570 INFO:tasks.workunit.client.1.smithi135.stderr:167000K .......... .......... .......... .......... .......... 99% 591K 3s 2023-11-18T19:13:50.628 INFO:tasks.workunit.client.1.smithi135.stderr:167050K .......... .......... .......... .......... .......... 99% 858K 3s 2023-11-18T19:13:50.715 INFO:tasks.workunit.client.1.smithi135.stderr:167100K .......... .......... .......... .......... .......... 99% 576K 3s 2023-11-18T19:13:50.760 INFO:tasks.workunit.client.1.smithi135.stderr:167150K .......... .......... .......... .......... .......... 99% 1.09M 3s 2023-11-18T19:13:50.809 INFO:tasks.workunit.client.1.smithi135.stderr:167200K .......... .......... .......... .......... .......... 99% 1012K 3s 2023-11-18T19:13:50.892 INFO:tasks.workunit.client.1.smithi135.stderr:167250K .......... .......... .......... .......... .......... 99% 601K 3s 2023-11-18T19:13:50.940 INFO:tasks.workunit.client.1.smithi135.stderr:167300K .......... .......... .......... .......... .......... 99% 1.03M 2s 2023-11-18T19:13:51.009 INFO:tasks.workunit.client.1.smithi135.stderr:167350K .......... .......... .......... .......... .......... 99% 733K 2s 2023-11-18T19:13:51.071 INFO:tasks.workunit.client.1.smithi135.stderr:167400K .......... .......... .......... .......... .......... 99% 796K 2s 2023-11-18T19:13:51.157 INFO:tasks.workunit.client.1.smithi135.stderr:167450K .......... .......... .......... .......... .......... 99% 584K 2s 2023-11-18T19:13:51.224 INFO:tasks.workunit.client.1.smithi135.stderr:167500K .......... .......... .......... .......... .......... 99% 737K 2s 2023-11-18T19:13:51.314 INFO:tasks.workunit.client.1.smithi135.stderr:167550K .......... .......... .......... .......... .......... 99% 838K 2s 2023-11-18T19:13:51.373 INFO:tasks.workunit.client.1.smithi135.stderr:167600K .......... .......... .......... .......... .......... 99% 563K 2s 2023-11-18T19:13:51.435 INFO:tasks.workunit.client.1.smithi135.stderr:167650K .......... .......... .......... .......... .......... 99% 805K 2s 2023-11-18T19:13:51.501 INFO:tasks.workunit.client.1.smithi135.stderr:167700K .......... .......... .......... .......... .......... 99% 753K 2s 2023-11-18T19:13:51.571 INFO:tasks.workunit.client.1.smithi135.stderr:167750K .......... .......... .......... .......... .......... 99% 722K 2s 2023-11-18T19:13:51.630 INFO:tasks.workunit.client.1.smithi135.stderr:167800K .......... .......... .......... .......... .......... 99% 848K 1s 2023-11-18T19:13:51.694 INFO:tasks.workunit.client.1.smithi135.stderr:167850K .......... .......... .......... .......... .......... 99% 784K 1s 2023-11-18T19:13:51.752 INFO:tasks.workunit.client.1.smithi135.stderr:167900K .......... .......... .......... .......... .......... 99% 851K 1s 2023-11-18T19:13:51.815 INFO:tasks.workunit.client.1.smithi135.stderr:167950K .......... .......... .......... .......... .......... 99% 796K 1s 2023-11-18T19:13:51.877 INFO:tasks.workunit.client.1.smithi135.stderr:168000K .......... .......... .......... .......... .......... 99% 807K 1s 2023-11-18T19:13:51.937 INFO:tasks.workunit.client.1.smithi135.stderr:168050K .......... .......... .......... .......... .......... 99% 829K 1s 2023-11-18T19:13:51.998 INFO:tasks.workunit.client.1.smithi135.stderr:168100K .......... .......... .......... .......... .......... 99% 823K 1s 2023-11-18T19:13:52.066 INFO:tasks.workunit.client.1.smithi135.stderr:168150K .......... .......... .......... .......... .......... 99% 739K 1s 2023-11-18T19:13:52.118 INFO:tasks.workunit.client.1.smithi135.stderr:168200K .......... .......... .......... .......... .......... 99% 960K 1s 2023-11-18T19:13:52.177 INFO:tasks.workunit.client.1.smithi135.stderr:168250K .......... .......... .......... .......... .......... 99% 869K 1s 2023-11-18T19:13:52.224 INFO:tasks.workunit.client.1.smithi135.stderr:168300K .......... .......... .......... .......... .......... 99% 1.00M 0s 2023-11-18T19:13:52.291 INFO:tasks.workunit.client.1.smithi135.stderr:168350K .......... .......... .......... .......... .......... 99% 753K 0s 2023-11-18T19:13:52.343 INFO:tasks.workunit.client.1.smithi135.stderr:168400K .......... .......... .......... .......... .......... 99% 958K 0s 2023-11-18T19:13:52.396 INFO:tasks.workunit.client.1.smithi135.stderr:168450K .......... .......... .......... .......... .......... 99% 937K 0s 2023-11-18T19:13:52.449 INFO:tasks.workunit.client.1.smithi135.stderr:168500K .......... .......... .......... .......... .......... 99% 938K 0s 2023-11-18T19:13:52.485 INFO:tasks.workunit.client.1.smithi135.stderr:168550K .......... .......... . 100% 596K=5m38s 2023-11-18T19:13:52.485 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:13:52.485 INFO:tasks.workunit.client.1.smithi135.stderr:2023-11-18 19:13:52 (499 KB/s) - ‘linux.tar.gz’ saved [172616875/172616875] 2023-11-18T19:13:52.485 INFO:tasks.workunit.client.1.smithi135.stderr: 2023-11-18T19:13:52.487 INFO:tasks.workunit.client.1.smithi135.stderr:+ mkdir t 2023-11-18T19:13:52.496 INFO:tasks.workunit.client.1.smithi135.stderr:+ cd t 2023-11-18T19:13:52.500 INFO:tasks.workunit.client.1.smithi135.stderr:+ tar xzf ../linux.tar.gz 2023-11-18T19:14:08.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:14:08.856 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:14:40.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:14:40.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:15:07.030 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2023-11-18T19:15:07.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-18T19:15:08.050 DEBUG:teuthology.parallel:result is None 2023-11-18T19:15:08.053 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-18T19:15:08.188 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-18T19:15:08.189 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-18T19:15:08.189 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:15:08.189 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:15:08.243 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:15:08.243 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:15:08.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:15:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.561+0000 7f6f3c98f640 1 Processor -- start 2023-11-18T19:15:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.562+0000 7f6f3c98f640 1 -- start start 2023-11-18T19:15:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.563+0000 7f6f3c98f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6f380c8220 0x7f6f38154750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.563+0000 7f6f3c98f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f38158ad0 con 0x7f6f38151a10 2023-11-18T19:15:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.563+0000 7f6f3c98f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f380c4f80 con 0x7f6f380c7d10 2023-11-18T19:15:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.563+0000 7f6f3c98f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380c5ae0 con 0x7f6f380c8220 2023-11-18T19:15:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.563+0000 7f6f2e59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6f380c8220 0x7f6f38154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.563+0000 7f6f36d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f38151a10 0x7f6f380ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37202/0 (socket says 172.21.15.45:37202) 2023-11-18T19:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.563+0000 7f6f36d9d640 1 -- 172.21.15.45:0/929313794 learned_addr learned my addr 172.21.15.45:0/929313794 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.564+0000 7f6f3659c640 1 -- 172.21.15.45:0/929313794 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243732492 0 0) 0x7f6f28001110 con 0x7f6f38151a10 2023-11-18T19:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.564+0000 7f6f3659c640 1 -- 172.21.15.45:0/929313794 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f24003520 con 0x7f6f38151a10 2023-11-18T19:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.564+0000 7f6f2e59c640 1 -- 172.21.15.45:0/929313794 >> v1:172.21.15.135:6789/0 conn(0x7f6f380c7d10 legacy=0x7f6f38154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.564+0000 7f6f2e59c640 1 -- 172.21.15.45:0/929313794 >> v1:172.21.15.45:6789/0 conn(0x7f6f38151a10 legacy=0x7f6f380ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.564+0000 7f6f2e59c640 1 -- 172.21.15.45:0/929313794 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3806caa0 con 0x7f6f380c8220 2023-11-18T19:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.565+0000 7f6f2e59c640 1 --2- 172.21.15.45:0/929313794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f380c8220 0x7f6f38154750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f200097a0 tx=0x7f6f2002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc204658655773d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.566+0000 7f6f3659c640 1 -- 172.21.15.45:0/929313794 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20031830 con 0x7f6f380c8220 2023-11-18T19:15:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.566+0000 7f6f3659c640 1 -- 172.21.15.45:0/929313794 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20031990 con 0x7f6f380c8220 2023-11-18T19:15:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.566+0000 7f6f3659c640 1 -- 172.21.15.45:0/929313794 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20031d20 con 0x7f6f380c8220 2023-11-18T19:15:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.567+0000 7f6f3c98f640 1 -- 172.21.15.45:0/929313794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f380c8220 msgr2=0x7f6f38154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.567+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/929313794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f380c8220 0x7f6f38154750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f200097a0 tx=0x7f6f2002b8d0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.567+0000 7f6f3c98f640 1 -- 172.21.15.45:0/929313794 shutdown_connections 2023-11-18T19:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.567+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/929313794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f380c8220 0x7f6f38154750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.567+0000 7f6f3c98f640 1 -- 172.21.15.45:0/929313794 >> 172.21.15.45:0/929313794 conn(0x7f6f380663d0 msgr2=0x7f6f380667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.567+0000 7f6f3c98f640 1 -- 172.21.15.45:0/929313794 shutdown_connections 2023-11-18T19:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.567+0000 7f6f3c98f640 1 -- 172.21.15.45:0/929313794 wait complete. 2023-11-18T19:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.569+0000 7f6f3c98f640 1 Processor -- start 2023-11-18T19:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.569+0000 7f6f3c98f640 1 -- start start 2023-11-18T19:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f3c98f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f380c7d10 0x7f6f38148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f3c98f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f380c8220 0x7f6f381e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f3c98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f38151a10 0x7f6f381ea410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f3c98f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380ab030 con 0x7f6f380c7d10 2023-11-18T19:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f3c98f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38155c00 con 0x7f6f38151a10 2023-11-18T19:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f3c98f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381ea950 con 0x7f6f380c8220 2023-11-18T19:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f36d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f380c7d10 0x7f6f38148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f36d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f380c7d10 0x7f6f38148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38520/0 (socket says 172.21.15.45:38520) 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f36d9d640 1 -- 172.21.15.45:0/2581332918 learned_addr learned my addr 172.21.15.45:0/2581332918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f2e59c640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f380c8220 0x7f6f381e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.570+0000 7f6f3759e640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f38151a10 0x7f6f381ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f36d9d640 1 -- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f380c8220 msgr2=0x7f6f381e9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f36d9d640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f380c8220 0x7f6f381e9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f36d9d640 1 -- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f38151a10 msgr2=0x7f6f381ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f36d9d640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f38151a10 0x7f6f381ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f36d9d640 1 -- 172.21.15.45:0/2581332918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20009400 con 0x7f6f380c7d10 2023-11-18T19:15:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f2e59c640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f380c8220 0x7f6f381e9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f36d9d640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f380c7d10 0x7f6f38148570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c3c0 tx=0x7f6f2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f2ffff640 1 -- 172.21.15.45:0/2581332918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28005ce0 con 0x7f6f380c7d10 2023-11-18T19:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f2ffff640 1 -- 172.21.15.45:0/2581332918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28005e60 con 0x7f6f380c7d10 2023-11-18T19:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f2ffff640 1 -- 172.21.15.45:0/2581332918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28007310 con 0x7f6f380c7d10 2023-11-18T19:15:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f381e99d0 con 0x7f6f380c7d10 2023-11-18T19:15:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.571+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f380ab210 con 0x7f6f380c7d10 2023-11-18T19:15:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.573+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f381e9b60 con 0x7f6f380c7d10 2023-11-18T19:15:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.573+0000 7f6f2ffff640 1 -- 172.21.15.45:0/2581332918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f28007470 con 0x7f6f380c7d10 2023-11-18T19:15:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.574+0000 7f6f2ffff640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1806ae70 0x7f6f1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.574+0000 7f6f2ffff640 1 -- 172.21.15.45:0/2581332918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6f28088cb0 con 0x7f6f380c7d10 2023-11-18T19:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.575+0000 7f6f2e59c640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1806ae70 0x7f6f1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.575+0000 7f6f2e59c640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1806ae70 0x7f6f1806d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6f20036000 tx=0x7f6f2003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.579+0000 7f6f2ffff640 1 -- 172.21.15.45:0/2581332918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f381e9b60 con 0x7f6f380c7d10 2023-11-18T19:15:08.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.774+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f38158ad0 con 0x7f6f380c7d10 2023-11-18T19:15:08.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.777+0000 7f6f2ffff640 1 -- 172.21.15.45:0/2581332918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18481 (secure 0 0 0) 0x7f6f38158ad0 con 0x7f6f380c7d10 2023-11-18T19:15:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:15:08.779 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:07:25.049601+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:15:08.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1806ae70 msgr2=0x7f6f1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:08.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1806ae70 0x7f6f1806d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6f20036000 tx=0x7f6f2003c040 comp rx=0 tx=0).stop 2023-11-18T19:15:08.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f380c7d10 msgr2=0x7f6f38148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:08.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f380c7d10 0x7f6f38148570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c3c0 tx=0x7f6f2800c880 comp rx=0 tx=0).stop 2023-11-18T19:15:08.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 shutdown_connections 2023-11-18T19:15:08.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f38151a10 0x7f6f381ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f1806ae70 0x7f6f1806d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f380c8220 0x7f6f381e9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 --2- 172.21.15.45:0/2581332918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f380c7d10 0x7f6f38148570 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:08.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.779+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 >> 172.21.15.45:0/2581332918 conn(0x7f6f380663d0 msgr2=0x7f6f380c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:08.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.780+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 shutdown_connections 2023-11-18T19:15:08.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:08.780+0000 7f6f3c98f640 1 -- 172.21.15.45:0/2581332918 wait complete. 2023-11-18T19:15:08.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T19:06:35.454808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T19:06:36.526298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T19:06:39.617712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T19:15:08.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:15:09.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.028+0000 7f957c88a640 1 Processor -- start 2023-11-18T19:15:09.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.028+0000 7f957c88a640 1 -- start start 2023-11-18T19:15:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.030+0000 7f957c88a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f95780c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.030+0000 7f957c88a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f95780c6620 0x7f95781550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.030+0000 7f957c88a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95780c51f0 con 0x7f95780c8330 2023-11-18T19:15:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.030+0000 7f957c88a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957806baf0 con 0x7f95780c6620 2023-11-18T19:15:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.030+0000 7f957c88a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780c5f10 con 0x7f95780c4690 2023-11-18T19:15:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.030+0000 7f956ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95780c8330 0x7f957806bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37210/0 (socket says 172.21.15.45:37210) 2023-11-18T19:15:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.030+0000 7f956ffff640 1 -- 172.21.15.45:0/3045313181 learned_addr learned my addr 172.21.15.45:0/3045313181 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f9577fff640 1 --2- 172.21.15.45:0/3045313181 >> v2:172.21.15.135:3300/0 conn(0x7f95780c6620 0x7f95781550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f95777fe640 1 --2- 172.21.15.45:0/3045313181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f95780c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f9576ffd640 1 -- 172.21.15.45:0/3045313181 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293010740 0 0) 0x7f95780c51f0 con 0x7f95780c8330 2023-11-18T19:15:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f9576ffd640 1 -- 172.21.15.45:0/3045313181 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9564003520 con 0x7f95780c8330 2023-11-18T19:15:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f95777fe640 1 -- 172.21.15.45:0/3045313181 >> v2:172.21.15.135:3300/0 conn(0x7f95780c6620 msgr2=0x7f95781550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f95777fe640 1 --2- 172.21.15.45:0/3045313181 >> v2:172.21.15.135:3300/0 conn(0x7f95780c6620 0x7f95781550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f95777fe640 1 -- 172.21.15.45:0/3045313181 >> v1:172.21.15.45:6789/0 conn(0x7f95780c8330 legacy=0x7f957806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.031+0000 7f95777fe640 1 -- 172.21.15.45:0/3045313181 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95781555f0 con 0x7f95780c4690 2023-11-18T19:15:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.032+0000 7f95777fe640 1 --2- 172.21.15.45:0/3045313181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f95780c4a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95680097a0 tx=0x7f956802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6181677968b35d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.033+0000 7f9576ffd640 1 -- 172.21.15.45:0/3045313181 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568030800 con 0x7f95780c4690 2023-11-18T19:15:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.033+0000 7f9576ffd640 1 -- 172.21.15.45:0/3045313181 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568030960 con 0x7f95780c4690 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.033+0000 7f9576ffd640 1 -- 172.21.15.45:0/3045313181 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568030cf0 con 0x7f95780c4690 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 -- 172.21.15.45:0/3045313181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 msgr2=0x7f95780c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 --2- 172.21.15.45:0/3045313181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f95780c4a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f95680097a0 tx=0x7f956802b940 comp rx=0 tx=0).stop 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 -- 172.21.15.45:0/3045313181 shutdown_connections 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 --2- 172.21.15.45:0/3045313181 >> v2:172.21.15.135:3300/0 conn(0x7f95780c6620 0x7f95781550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 --2- 172.21.15.45:0/3045313181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f95780c4a70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 -- 172.21.15.45:0/3045313181 >> 172.21.15.45:0/3045313181 conn(0x7f95780ab8a0 msgr2=0x7f95780abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 -- 172.21.15.45:0/3045313181 shutdown_connections 2023-11-18T19:15:09.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.034+0000 7f957c88a640 1 -- 172.21.15.45:0/3045313181 wait complete. 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.035+0000 7f957c88a640 1 Processor -- start 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.036+0000 7f957c88a640 1 -- start start 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.036+0000 7f957c88a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f957814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.036+0000 7f957c88a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c6620 0x7f957814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.036+0000 7f957c88a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95780c8330 0x7f95781edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.036+0000 7f957c88a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957814f4a0 con 0x7f95780c6620 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.036+0000 7f957c88a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95781587f0 con 0x7f95780c8330 2023-11-18T19:15:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.036+0000 7f957c88a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957814f740 con 0x7f95780c4690 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c6620 0x7f957814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c6620 0x7f957814b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38536/0 (socket says 172.21.15.45:38536) 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 -- 172.21.15.45:0/2153127235 learned_addr learned my addr 172.21.15.45:0/2153127235 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f95777fe640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f957814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f9577fff640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95780c8330 0x7f95781edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 -- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 msgr2=0x7f957814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f957814b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 -- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95780c8330 msgr2=0x7f95781edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95780c8330 0x7f95781edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f956ffff640 1 -- 172.21.15.45:0/2153127235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009400 con 0x7f95780c6620 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f95777fe640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f957814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.037+0000 7f9577fff640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95780c8330 0x7f95781edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.038+0000 7f956ffff640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c6620 0x7f957814b610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f956000c410 tx=0x7f956000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.038+0000 7f9574ff9640 1 -- 172.21.15.45:0/2153127235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560005ce0 con 0x7f95780c6620 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.038+0000 7f9574ff9640 1 -- 172.21.15.45:0/2153127235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560005e40 con 0x7f95780c6620 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.038+0000 7f9574ff9640 1 -- 172.21.15.45:0/2153127235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600072f0 con 0x7f95780c6620 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.038+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957814fa20 con 0x7f95780c6620 2023-11-18T19:15:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.038+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9578158ad0 con 0x7f95780c6620 2023-11-18T19:15:09.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.039+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95780747c0 con 0x7f95780c6620 2023-11-18T19:15:09.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.040+0000 7f9574ff9640 1 -- 172.21.15.45:0/2153127235 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9560007510 con 0x7f95780c6620 2023-11-18T19:15:09.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.041+0000 7f9574ff9640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f955806ae40 0x7f955806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.041+0000 7f9574ff9640 1 -- 172.21.15.45:0/2153127235 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f95600890b0 con 0x7f95780c6620 2023-11-18T19:15:09.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.042+0000 7f95777fe640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f955806ae40 0x7f955806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.042+0000 7f95777fe640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f955806ae40 0x7f955806d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9568036000 tx=0x7f956803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.046+0000 7f9574ff9640 1 -- 172.21.15.45:0/2153127235 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9560053e30 con 0x7f95780c6620 2023-11-18T19:15:09.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.246+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f957808ba90 con 0x7f95780c6620 2023-11-18T19:15:09.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.247+0000 7f9574ff9640 1 -- 172.21.15.45:0/2153127235 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9560057450 con 0x7f95780c6620 2023-11-18T19:15:09.249 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f955806ae40 msgr2=0x7f955806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f955806ae40 0x7f955806d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9568036000 tx=0x7f956803b040 comp rx=0 tx=0).stop 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c6620 msgr2=0x7f957814b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c6620 0x7f957814b610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f956000c410 tx=0x7f956000c8d0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 shutdown_connections 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95780c8330 0x7f95781edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c6620 0x7f957814b610 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f955806ae40 0x7f955806d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 --2- 172.21.15.45:0/2153127235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95780c4690 0x7f957814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 >> 172.21.15.45:0/2153127235 conn(0x7f95780ab8a0 msgr2=0x7f95780aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 shutdown_connections 2023-11-18T19:15:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.250+0000 7f957c88a640 1 -- 172.21.15.45:0/2153127235 wait complete. 2023-11-18T19:15:09.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T19:15:09.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.492+0000 7fb3732ad640 1 Processor -- start 2023-11-18T19:15:09.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.492+0000 7fb3732ad640 1 -- start start 2023-11-18T19:15:09.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.494+0000 7fb3732ad640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb36c0c39c0 0x7fb36c152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.494+0000 7fb3732ad640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c06a8e0 0x7fb36c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.494+0000 7fb3732ad640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c06ad50 con 0x7fb36c06a500 2023-11-18T19:15:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.494+0000 7fb3732ad640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c0c3fa0 con 0x7fb36c0c39c0 2023-11-18T19:15:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.494+0000 7fb3732ad640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0c4280 con 0x7fb36c06a8e0 2023-11-18T19:15:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.494+0000 7fb371aaa640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb36c0c39c0 0x7fb36c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.494+0000 7fb372aac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c06a8e0 0x7fb36c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.495+0000 7fb371aaa640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb36c0c39c0 0x7fb36c152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:37006/0 (socket says 172.21.15.45:37006) 2023-11-18T19:15:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.495+0000 7fb371aaa640 1 -- 172.21.15.45:0/1801051023 learned_addr learned my addr 172.21.15.45:0/1801051023 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.495+0000 7fb3722ab640 1 --1- 172.21.15.45:0/1801051023 >> v1:172.21.15.135:6789/0 conn(0x7fb36c06a500 0x7fb36c06d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:44532/0 (socket says 172.21.15.45:44532) 2023-11-18T19:15:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.495+0000 7fb371aaa640 1 -- 172.21.15.45:0/1801051023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c06a8e0 msgr2=0x7fb36c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.495+0000 7fb371aaa640 1 --2- 172.21.15.45:0/1801051023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c06a8e0 0x7fb36c06dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.495+0000 7fb371aaa640 1 -- 172.21.15.45:0/1801051023 >> v1:172.21.15.135:6789/0 conn(0x7fb36c06a500 legacy=0x7fb36c06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.495+0000 7fb371aaa640 1 -- 172.21.15.45:0/1801051023 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0c4560 con 0x7fb36c0c39c0 2023-11-18T19:15:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.496+0000 7fb371aaa640 1 --2- 172.21.15.45:0/1801051023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c0c39c0 0x7fb36c152280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009870 tx=0x7fb35c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e10c7eb17274eb24 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3712a9640 1 -- 172.21.15.45:0/1801051023 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c031640 con 0x7fb36c0c39c0 2023-11-18T19:15:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3712a9640 1 -- 172.21.15.45:0/1801051023 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c0317a0 con 0x7fb36c0c39c0 2023-11-18T19:15:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3712a9640 1 -- 172.21.15.45:0/1801051023 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c031b30 con 0x7fb36c0c39c0 2023-11-18T19:15:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3732ad640 1 -- 172.21.15.45:0/1801051023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c0c39c0 msgr2=0x7fb36c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3732ad640 1 --2- 172.21.15.45:0/1801051023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c0c39c0 0x7fb36c152280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009870 tx=0x7fb35c02b8f0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3732ad640 1 -- 172.21.15.45:0/1801051023 shutdown_connections 2023-11-18T19:15:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3732ad640 1 --2- 172.21.15.45:0/1801051023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c06a8e0 0x7fb36c06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3732ad640 1 --2- 172.21.15.45:0/1801051023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c0c39c0 0x7fb36c152280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.497+0000 7fb3732ad640 1 -- 172.21.15.45:0/1801051023 >> 172.21.15.45:0/1801051023 conn(0x7fb36c0a7870 msgr2=0x7fb36c0a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.498+0000 7fb3732ad640 1 -- 172.21.15.45:0/1801051023 shutdown_connections 2023-11-18T19:15:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.498+0000 7fb3732ad640 1 -- 172.21.15.45:0/1801051023 wait complete. 2023-11-18T19:15:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.499+0000 7fb3732ad640 1 Processor -- start 2023-11-18T19:15:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.499+0000 7fb3732ad640 1 -- start start 2023-11-18T19:15:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.500+0000 7fb3732ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb36c06a500 0x7fb36c1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.500+0000 7fb3732ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c06a8e0 0x7fb36c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.500+0000 7fb3732ad640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c0c39c0 0x7fb36c1ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.500+0000 7fb3732ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c152b00 con 0x7fb36c06a500 2023-11-18T19:15:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.500+0000 7fb3732ad640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1dcf20 con 0x7fb36c06a8e0 2023-11-18T19:15:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.500+0000 7fb3732ad640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c153be0 con 0x7fb36c0c39c0 2023-11-18T19:15:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb36c06a500 0x7fb36c1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb36c06a500 0x7fb36c1562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38546/0 (socket says 172.21.15.45:38546) 2023-11-18T19:15:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 -- 172.21.15.45:0/455160571 learned_addr learned my addr 172.21.15.45:0/455160571 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 -- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c0c39c0 msgr2=0x7fb36c1ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb371aaa640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c06a8e0 0x7fb36c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb372aac640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c0c39c0 0x7fb36c1ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c0c39c0 0x7fb36c1ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 -- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c06a8e0 msgr2=0x7fb36c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c06a8e0 0x7fb36c0a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 -- 172.21.15.45:0/455160571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0094d0 con 0x7fb36c06a500 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb371aaa640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c06a8e0 0x7fb36c0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb372aac640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c0c39c0 0x7fb36c1ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.501+0000 7fb3722ab640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb36c06a500 0x7fb36c1562e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c3e0 tx=0x7fb36800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.502+0000 7fb362ffd640 1 -- 172.21.15.45:0/455160571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680074e0 con 0x7fb36c06a500 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.502+0000 7fb362ffd640 1 -- 172.21.15.45:0/455160571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368007640 con 0x7fb36c06a500 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.502+0000 7fb362ffd640 1 -- 172.21.15.45:0/455160571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680049e0 con 0x7fb36c06a500 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.502+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c152d10 con 0x7fb36c06a500 2023-11-18T19:15:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.502+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c0aa250 con 0x7fb36c06a500 2023-11-18T19:15:09.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.503+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c0683a0 con 0x7fb36c06a500 2023-11-18T19:15:09.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.504+0000 7fb362ffd640 1 -- 172.21.15.45:0/455160571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb368004b40 con 0x7fb36c06a500 2023-11-18T19:15:09.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.505+0000 7fb362ffd640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb35006ae70 0x7fb35006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.505+0000 7fb362ffd640 1 -- 172.21.15.45:0/455160571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb3680893c0 con 0x7fb36c06a500 2023-11-18T19:15:09.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.505+0000 7fb371aaa640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb35006ae70 0x7fb35006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.506+0000 7fb371aaa640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb35006ae70 0x7fb35006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb35c036000 tx=0x7fb35c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.510+0000 7fb362ffd640 1 -- 172.21.15.45:0/455160571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb368054080 con 0x7fb36c06a500 2023-11-18T19:15:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.711+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb36c1ed240 con 0x7fb36c06a500 2023-11-18T19:15:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.712+0000 7fb362ffd640 1 -- 172.21.15.45:0/455160571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3680576a0 con 0x7fb36c06a500 2023-11-18T19:15:09.714 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:15:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb35006ae70 msgr2=0x7fb35006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb35006ae70 0x7fb35006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb35c036000 tx=0x7fb35c03c040 comp rx=0 tx=0).stop 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb36c06a500 msgr2=0x7fb36c1562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb36c06a500 0x7fb36c1562e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c3e0 tx=0x7fb36800c8a0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 shutdown_connections 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb35006ae70 0x7fb35006d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb36c0c39c0 0x7fb36c1ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb36c06a8e0 0x7fb36c0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 --2- 172.21.15.45:0/455160571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb36c06a500 0x7fb36c1562e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 >> 172.21.15.45:0/455160571 conn(0x7fb36c0a7870 msgr2=0x7fb36c0a6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 shutdown_connections 2023-11-18T19:15:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.715+0000 7fb3732ad640 1 -- 172.21.15.45:0/455160571 wait complete. 2023-11-18T19:15:09.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T19:15:09.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.967+0000 7ff60271a640 1 Processor -- start 2023-11-18T19:15:09.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.968+0000 7ff60271a640 1 -- start start 2023-11-18T19:15:09.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.969+0000 7ff60271a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff5fc155300 0x7ff5fc0a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.969+0000 7ff60271a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc0c0af0 0x7ff5fc0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.969+0000 7ff60271a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0a9fb0 con 0x7ff5fc0c5010 2023-11-18T19:15:09.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.969+0000 7ff60271a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc1556e0 con 0x7ff5fc155300 2023-11-18T19:15:09.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.969+0000 7ff60271a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0a55a0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.970+0000 7ff601f19640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff5fc0c5010 0x7ff5fc06fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37214/0 (socket says 172.21.15.45:37214) 2023-11-18T19:15:09.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.970+0000 7ff601f19640 1 -- 172.21.15.45:0/3674213778 learned_addr learned my addr 172.21.15.45:0/3674213778 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:09.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.970+0000 7ff600f17640 1 --2- 172.21.15.45:0/3674213778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc0c0af0 0x7ff5fc0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.970+0000 7ff601718640 1 --2- 172.21.15.45:0/3674213778 >> v2:172.21.15.135:3300/0 conn(0x7ff5fc155300 0x7ff5fc0a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.970+0000 7ff5f3fff640 1 -- 172.21.15.45:0/3674213778 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026039400 0 0) 0x7ff5fc0a9fb0 con 0x7ff5fc0c5010 2023-11-18T19:15:09.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.970+0000 7ff5f3fff640 1 -- 172.21.15.45:0/3674213778 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e8003520 con 0x7ff5fc0c5010 2023-11-18T19:15:09.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.971+0000 7ff600f17640 1 -- 172.21.15.45:0/3674213778 >> v2:172.21.15.135:3300/0 conn(0x7ff5fc155300 msgr2=0x7ff5fc0a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:09.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.971+0000 7ff600f17640 1 --2- 172.21.15.45:0/3674213778 >> v2:172.21.15.135:3300/0 conn(0x7ff5fc155300 0x7ff5fc0a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.971+0000 7ff600f17640 1 -- 172.21.15.45:0/3674213778 >> v1:172.21.15.45:6789/0 conn(0x7ff5fc0c5010 legacy=0x7ff5fc06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.971+0000 7ff600f17640 1 -- 172.21.15.45:0/3674213778 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0c11e0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.972+0000 7ff600f17640 1 --2- 172.21.15.45:0/3674213778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc0c0af0 0x7ff5fc0c4ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097a0 tx=0x7ff5ec02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b30f9f6dc11c24a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.972+0000 7ff5f3fff640 1 -- 172.21.15.45:0/3674213778 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec031780 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.972+0000 7ff5f3fff640 1 -- 172.21.15.45:0/3674213778 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0318e0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.972+0000 7ff5f3fff640 1 -- 172.21.15.45:0/3674213778 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec031c70 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 -- 172.21.15.45:0/3674213778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc0c0af0 msgr2=0x7ff5fc0c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 --2- 172.21.15.45:0/3674213778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc0c0af0 0x7ff5fc0c4ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097a0 tx=0x7ff5ec02b820 comp rx=0 tx=0).stop 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 -- 172.21.15.45:0/3674213778 shutdown_connections 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 --2- 172.21.15.45:0/3674213778 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc0c0af0 0x7ff5fc0c4ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 --2- 172.21.15.45:0/3674213778 >> v2:172.21.15.135:3300/0 conn(0x7ff5fc155300 0x7ff5fc0a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 -- 172.21.15.45:0/3674213778 >> 172.21.15.45:0/3674213778 conn(0x7ff5fc0a7870 msgr2=0x7ff5fc0a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 -- 172.21.15.45:0/3674213778 shutdown_connections 2023-11-18T19:15:09.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.973+0000 7ff60271a640 1 -- 172.21.15.45:0/3674213778 wait complete. 2023-11-18T19:15:09.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.975+0000 7ff60271a640 1 Processor -- start 2023-11-18T19:15:09.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.975+0000 7ff60271a640 1 -- start start 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff60271a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5fc0c0af0 0x7ff5fc14c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff60271a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc0c5010 0x7ff5fc0a6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff60271a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc155300 0x7ff5fc1ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff60271a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc143be0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff60271a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc14c6a0 con 0x7ff5fc0c5010 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff60271a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc143990 con 0x7ff5fc155300 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff601718640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5fc0c0af0 0x7ff5fc14c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff601718640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5fc0c0af0 0x7ff5fc14c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38562/0 (socket says 172.21.15.45:38562) 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff601718640 1 -- 172.21.15.45:0/2684103373 learned_addr learned my addr 172.21.15.45:0/2684103373 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff600f17640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc0c5010 0x7ff5fc0a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff601f19640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc155300 0x7ff5fc1ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff601718640 1 -- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc155300 msgr2=0x7ff5fc1ecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.976+0000 7ff601718640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc155300 0x7ff5fc1ecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff601718640 1 -- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc0c5010 msgr2=0x7ff5fc0a6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff601718640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc0c5010 0x7ff5fc0a6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff601718640 1 -- 172.21.15.45:0/2684103373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009400 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff600f17640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc0c5010 0x7ff5fc0a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:15:09.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff601718640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5fc0c0af0 0x7ff5fc14c160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800e8a0 tx=0x7ff5f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff5f1ffb640 1 -- 172.21.15.45:0/2684103373 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80094f0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff5f1ffb640 1 -- 172.21.15.45:0/2684103373 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800c940 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff5f1ffb640 1 -- 172.21.15.45:0/2684103373 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800ccf0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc0a5a40 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.977+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc14cd40 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.978+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc0683a0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.979+0000 7ff5f1ffb640 1 -- 172.21.15.45:0/2684103373 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5f8013470 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.980+0000 7ff5f1ffb640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff5e006ae70 0x7ff5e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:09.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.980+0000 7ff5f1ffb640 1 -- 172.21.15.45:0/2684103373 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff5f80899f0 con 0x7ff5fc0c0af0 2023-11-18T19:15:09.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.981+0000 7ff600f17640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff5e006ae70 0x7ff5e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:09.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.981+0000 7ff600f17640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff5e006ae70 0x7ff5e006d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec036000 tx=0x7ff5ec03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:09.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:09.985+0000 7ff5f1ffb640 1 -- 172.21.15.45:0/2684103373 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5f8054740 con 0x7ff5fc0c0af0 2023-11-18T19:15:10.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.186+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5fc0c08d0 con 0x7ff5fc0c0af0 2023-11-18T19:15:10.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.186+0000 7ff5f1ffb640 1 -- 172.21.15.45:0/2684103373 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5f8057d60 con 0x7ff5fc0c0af0 2023-11-18T19:15:10.188 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-18T19:15:10.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff5e006ae70 msgr2=0x7ff5e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff5e006ae70 0x7ff5e006d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec036000 tx=0x7ff5ec03d040 comp rx=0 tx=0).stop 2023-11-18T19:15:10.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5fc0c0af0 msgr2=0x7ff5fc14c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5fc0c0af0 0x7ff5fc14c160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800e8a0 tx=0x7ff5f800ed60 comp rx=0 tx=0).stop 2023-11-18T19:15:10.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 shutdown_connections 2023-11-18T19:15:10.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff5e006ae70 0x7ff5e006d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5fc155300 0x7ff5fc1ecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc0c5010 0x7ff5fc0a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 --2- 172.21.15.45:0/2684103373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5fc0c0af0 0x7ff5fc14c160 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 >> 172.21.15.45:0/2684103373 conn(0x7ff5fc0a7870 msgr2=0x7ff5fc0a8930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:10.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.189+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 shutdown_connections 2023-11-18T19:15:10.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.190+0000 7ff60271a640 1 -- 172.21.15.45:0/2684103373 wait complete. 2023-11-18T19:15:10.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T19:15:10.343 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:15:10.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:15:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.439+0000 7effc8105640 1 Processor -- start 2023-11-18T19:15:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.440+0000 7effc8105640 1 -- start start 2023-11-18T19:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.441+0000 7effc8105640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effc00c26f0 0x7effc01565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.441+0000 7effc8105640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00c5020 con 0x7effc014fbb0 2023-11-18T19:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.441+0000 7effc8105640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00beae0 con 0x7effc014ff90 2023-11-18T19:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.441+0000 7effc8105640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00bedc0 con 0x7effc00c26f0 2023-11-18T19:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.441+0000 7effc5ea1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7effc014fbb0 0x7effc00c4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37216/0 (socket says 172.21.15.45:37216) 2023-11-18T19:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.441+0000 7effc5ea1640 1 -- 172.21.15.45:0/864918350 learned_addr learned my addr 172.21.15.45:0/864918350 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.441+0000 7effc66a2640 1 --2- 172.21.15.45:0/864918350 >> v2:172.21.15.45:3300/0 conn(0x7effc00c26f0 0x7effc01565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.442+0000 7effc4e9f640 1 -- 172.21.15.45:0/864918350 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418971468 0 0) 0x7effc00c5020 con 0x7effc014fbb0 2023-11-18T19:15:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.442+0000 7effc4e9f640 1 -- 172.21.15.45:0/864918350 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effac003520 con 0x7effc014fbb0 2023-11-18T19:15:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.442+0000 7effc4e9f640 1 -- 172.21.15.45:0/864918350 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416816374 0 0) 0x7effc00beae0 con 0x7effc014ff90 2023-11-18T19:15:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.442+0000 7effc66a2640 1 -- 172.21.15.45:0/864918350 >> v1:172.21.15.135:6789/0 conn(0x7effc014ff90 legacy=0x7effc00a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.442+0000 7effc66a2640 1 -- 172.21.15.45:0/864918350 >> v1:172.21.15.45:6789/0 conn(0x7effc014fbb0 legacy=0x7effc00c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.442+0000 7effc66a2640 1 -- 172.21.15.45:0/864918350 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00c3e30 con 0x7effc00c26f0 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.443+0000 7effc66a2640 1 --2- 172.21.15.45:0/864918350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc00c26f0 0x7effc01565c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7effb8009d90 tx=0x7effb802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a70529e7ec156dd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.443+0000 7effc4e9f640 1 -- 172.21.15.45:0/864918350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb802cd00 con 0x7effc00c26f0 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.443+0000 7effc4e9f640 1 -- 172.21.15.45:0/864918350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb802ce60 con 0x7effc00c26f0 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc4e9f640 1 -- 172.21.15.45:0/864918350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8034660 con 0x7effc00c26f0 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc8105640 1 -- 172.21.15.45:0/864918350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc00c26f0 msgr2=0x7effc01565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc8105640 1 --2- 172.21.15.45:0/864918350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc00c26f0 0x7effc01565c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7effb8009d90 tx=0x7effb802bf50 comp rx=0 tx=0).stop 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc8105640 1 -- 172.21.15.45:0/864918350 shutdown_connections 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc8105640 1 --2- 172.21.15.45:0/864918350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc00c26f0 0x7effc01565c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc8105640 1 -- 172.21.15.45:0/864918350 >> 172.21.15.45:0/864918350 conn(0x7effc00a9a80 msgr2=0x7effc00a9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc8105640 1 -- 172.21.15.45:0/864918350 shutdown_connections 2023-11-18T19:15:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.444+0000 7effc8105640 1 -- 172.21.15.45:0/864918350 wait complete. 2023-11-18T19:15:10.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.446+0000 7effc8105640 1 Processor -- start 2023-11-18T19:15:10.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.446+0000 7effc8105640 1 -- start start 2023-11-18T19:15:10.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc8105640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effc00c26f0 0x7effc00ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc8105640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc014fbb0 0x7effc014bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc8105640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc014ff90 0x7effc014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc8105640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc01e8770 con 0x7effc014fbb0 2023-11-18T19:15:10.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc8105640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0154db0 con 0x7effc014ff90 2023-11-18T19:15:10.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc8105640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc0155090 con 0x7effc00c26f0 2023-11-18T19:15:10.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc56a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc014fbb0 0x7effc014bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc56a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc014fbb0 0x7effc014bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38590/0 (socket says 172.21.15.45:38590) 2023-11-18T19:15:10.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc56a0640 1 -- 172.21.15.45:0/4226448179 learned_addr learned my addr 172.21.15.45:0/4226448179 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:10.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc5ea1640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effc00c26f0 0x7effc00ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.447+0000 7effc66a2640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc014ff90 0x7effc014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effc56a0640 1 -- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effc00c26f0 msgr2=0x7effc00ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effc56a0640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effc00c26f0 0x7effc00ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effc56a0640 1 -- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc014ff90 msgr2=0x7effc014c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effc56a0640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc014ff90 0x7effc014c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effc56a0640 1 -- 172.21.15.45:0/4226448179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8009a70 con 0x7effc014fbb0 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effc56a0640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc014fbb0 0x7effc014bf50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7effb000c3e0 tx=0x7effb000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effb67fc640 1 -- 172.21.15.45:0/4226448179 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00035f0 con 0x7effc014fbb0 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effb67fc640 1 -- 172.21.15.45:0/4226448179 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0003750 con 0x7effc014fbb0 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effb67fc640 1 -- 172.21.15.45:0/4226448179 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0003b20 con 0x7effc014fbb0 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.448+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc0155370 con 0x7effc014fbb0 2023-11-18T19:15:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.449+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc00ac580 con 0x7effc014fbb0 2023-11-18T19:15:10.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.450+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc01eaff0 con 0x7effc014fbb0 2023-11-18T19:15:10.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.451+0000 7effb67fc640 1 -- 172.21.15.45:0/4226448179 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effb0003c80 con 0x7effc014fbb0 2023-11-18T19:15:10.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.451+0000 7effb67fc640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa406ae40 0x7effa406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.452+0000 7effb67fc640 1 -- 172.21.15.45:0/4226448179 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7effb0088ee0 con 0x7effc014fbb0 2023-11-18T19:15:10.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.452+0000 7effc5ea1640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa406ae40 0x7effa406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.452+0000 7effc5ea1640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa406ae40 0x7effa406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7effbc005880 tx=0x7effbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:10.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.455+0000 7effb67fc640 1 -- 172.21.15.45:0/4226448179 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effb0053ce0 con 0x7effc014fbb0 2023-11-18T19:15:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.654+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7effc00747c0 con 0x7effc014fbb0 2023-11-18T19:15:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.655+0000 7effb67fc640 1 -- 172.21.15.45:0/4226448179 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7effb0017020 con 0x7effc014fbb0 2023-11-18T19:15:10.657 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.657+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa406ae40 msgr2=0x7effa406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.657+0000 7effc8105640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa406ae40 0x7effa406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7effbc005880 tx=0x7effbc009040 comp rx=0 tx=0).stop 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.657+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc014fbb0 msgr2=0x7effc014bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.657+0000 7effc8105640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc014fbb0 0x7effc014bf50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7effb000c3e0 tx=0x7effb000c8a0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 shutdown_connections 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effc014ff90 0x7effc014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc014fbb0 0x7effc014bf50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa406ae40 0x7effa406d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 --2- 172.21.15.45:0/4226448179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effc00c26f0 0x7effc00ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 >> 172.21.15.45:0/4226448179 conn(0x7effc00a9a80 msgr2=0x7effc00a9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:10.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 shutdown_connections 2023-11-18T19:15:10.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.658+0000 7effc8105640 1 -- 172.21.15.45:0/4226448179 wait complete. 2023-11-18T19:15:10.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T19:15:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.881+0000 7fda84701640 1 Processor -- start 2023-11-18T19:15:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.881+0000 7fda84701640 1 -- start start 2023-11-18T19:15:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.883+0000 7fda84701640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 0x7fda7c152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.883+0000 7fda84701640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0c07d0 con 0x7fda7c14fc40 2023-11-18T19:15:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.883+0000 7fda84701640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c06e3b0 con 0x7fda7c0c1d50 2023-11-18T19:15:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.883+0000 7fda84701640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0c21e0 con 0x7fda7c0ab740 2023-11-18T19:15:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.883+0000 7fda8249d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fda7c14fc40 0x7fda7c06dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37232/0 (socket says 172.21.15.45:37232) 2023-11-18T19:15:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.883+0000 7fda8249d640 1 -- 172.21.15.45:0/3919077071 learned_addr learned my addr 172.21.15.45:0/3919077071 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.883+0000 7fda81c9c640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 0x7fda7c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789913276 0 0) 0x7fda7c0c07d0 con 0x7fda7c14fc40 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003520 con 0x7fda7c14fc40 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2412894289 0 0) 0x7fda68003520 con 0x7fda7c14fc40 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 msgr2=0x7fda7c152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 0x7fda7c152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 >> v1:172.21.15.135:6789/0 conn(0x7fda7c0c1d50 legacy=0x7fda7c0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c072070 con 0x7fda7c14fc40 2023-11-18T19:15:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fda78001670 con 0x7fda7c14fc40 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda81c9c640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 0x7fda7c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 >> v1:172.21.15.45:6789/0 conn(0x7fda7c14fc40 legacy=0x7fda7c06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 0x7fda680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68004d00 0x7fda68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0c21e0 con 0x7fda680039a0 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800bb60 con 0x7fda68004d00 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800bd20 con 0x7fda7c0ab740 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.884+0000 7fda8249d640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.885+0000 7fda81c9c640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 0x7fda680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.885+0000 7fda82c9e640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68004d00 0x7fda68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.885+0000 7fda8249d640 1 -- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 msgr2=0x7fda680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.885+0000 7fda8249d640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda7c0ab740 0x7fda680047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.885+0000 7fda8249d640 1 -- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68004d00 msgr2=0x7fda68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.885+0000 7fda8249d640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68004d00 0x7fda68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.885+0000 7fda8249d640 1 -- 172.21.15.45:0/3919077071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c009400 con 0x7fda680039a0 2023-11-18T19:15:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.886+0000 7fda8249d640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c0e0 tx=0x7fda680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c8b24eb347835 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.886+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78005ad0 con 0x7fda680039a0 2023-11-18T19:15:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.886+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda78005c30 con 0x7fda680039a0 2023-11-18T19:15:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.886+0000 7fda8149b640 1 -- 172.21.15.45:0/3919077071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7802c810 con 0x7fda680039a0 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.887+0000 7fda84701640 1 -- 172.21.15.45:0/3919077071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680039a0 msgr2=0x7fda68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.887+0000 7fda84701640 1 --2- 172.21.15.45:0/3919077071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680039a0 0x7fda68003dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c0e0 tx=0x7fda680057f0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.887+0000 7fda82c9e640 1 -- 172.21.15.45:0/3919077071 reap_dead start 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.887+0000 7fda84701640 1 -- 172.21.15.45:0/3919077071 shutdown_connections 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.887+0000 7fda84701640 1 -- 172.21.15.45:0/3919077071 >> 172.21.15.45:0/3919077071 conn(0x7fda7c0a7980 msgr2=0x7fda7c0a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.887+0000 7fda84701640 1 -- 172.21.15.45:0/3919077071 shutdown_connections 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.887+0000 7fda84701640 1 -- 172.21.15.45:0/3919077071 wait complete. 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.889+0000 7fda84701640 1 Processor -- start 2023-11-18T19:15:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.889+0000 7fda84701640 1 -- start start 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda84701640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680039a0 0x7fda7c155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda84701640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c14e190 0x7fda7c1eb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda84701640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c1eb9b0 0x7fda7c1ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda84701640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1eb020 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda84701640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c154740 con 0x7fda7c14e190 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda84701640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c154a20 con 0x7fda680039a0 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c1eb9b0 0x7fda7c1ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c1eb9b0 0x7fda7c1ed0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38608/0 (socket says 172.21.15.45:38608) 2023-11-18T19:15:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 -- 172.21.15.45:0/1874448817 learned_addr learned my addr 172.21.15.45:0/1874448817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda8249d640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680039a0 0x7fda7c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda81c9c640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c14e190 0x7fda7c1eb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 -- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680039a0 msgr2=0x7fda7c155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680039a0 0x7fda7c155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 -- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c14e190 msgr2=0x7fda7c1eb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c14e190 0x7fda7c1eb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.890+0000 7fda82c9e640 1 -- 172.21.15.45:0/1874448817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c154d00 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.891+0000 7fda82c9e640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c1eb9b0 0x7fda7c1ed0b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda74007fd0 tx=0x7fda7400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.891+0000 7fda72ffd640 1 -- 172.21.15.45:0/1874448817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74003970 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.891+0000 7fda72ffd640 1 -- 172.21.15.45:0/1874448817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74003af0 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.891+0000 7fda72ffd640 1 -- 172.21.15.45:0/1874448817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74003ea0 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.891+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c154fe0 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.891+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c156710 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.893+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c066b80 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.893+0000 7fda72ffd640 1 -- 172.21.15.45:0/1874448817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda740050d0 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.894+0000 7fda72ffd640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fda6006ae40 0x7fda6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.894+0000 7fda72ffd640 1 -- 172.21.15.45:0/1874448817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fda740896f0 con 0x7fda7c1eb9b0 2023-11-18T19:15:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.895+0000 7fda8249d640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fda6006ae40 0x7fda6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.895+0000 7fda8249d640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fda6006ae40 0x7fda6006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda78034000 tx=0x7fda78009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:10.899+0000 7fda72ffd640 1 -- 172.21.15.45:0/1874448817 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda74054440 con 0x7fda7c1eb9b0 2023-11-18T19:15:11.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.206+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fda7c1551d0 con 0x7fda7c1eb9b0 2023-11-18T19:15:11.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.207+0000 7fda72ffd640 1 -- 172.21.15.45:0/1874448817 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fda7c1551d0 con 0x7fda7c1eb9b0 2023-11-18T19:15:11.209 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-18T19:15:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fda6006ae40 msgr2=0x7fda6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fda6006ae40 0x7fda6006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda78034000 tx=0x7fda78009030 comp rx=0 tx=0).stop 2023-11-18T19:15:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c1eb9b0 msgr2=0x7fda7c1ed0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c1eb9b0 0x7fda7c1ed0b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda74007fd0 tx=0x7fda7400ec10 comp rx=0 tx=0).stop 2023-11-18T19:15:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 shutdown_connections 2023-11-18T19:15:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c1eb9b0 0x7fda7c1ed0b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda7c14e190 0x7fda7c1eb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fda6006ae40 0x7fda6006d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 --2- 172.21.15.45:0/1874448817 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680039a0 0x7fda7c155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 >> 172.21.15.45:0/1874448817 conn(0x7fda7c0a7980 msgr2=0x7fda7c0a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:11.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.213+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 shutdown_connections 2023-11-18T19:15:11.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.215+0000 7fda84701640 1 -- 172.21.15.45:0/1874448817 wait complete. 2023-11-18T19:15:11.251 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-18T19:15:11.251 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:15:11.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:15:11.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.676+0000 7fb307a15640 1 Processor -- start 2023-11-18T19:15:11.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.677+0000 7fb307a15640 1 -- start start 2023-11-18T19:15:11.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.678+0000 7fb307a15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4880 0x7fb300159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:11.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.678+0000 7fb307a15640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3000bd510 0x7fb3000c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:11.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.678+0000 7fb307a15640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000c50d0 con 0x7fb3000c4c60 2023-11-18T19:15:11.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.678+0000 7fb307a15640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30015c7f0 con 0x7fb3000bd510 2023-11-18T19:15:11.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.678+0000 7fb307a15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c8450 con 0x7fb3000c4880 2023-11-18T19:15:11.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.679+0000 7fb305fb2640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb3000c4c60 0x7fb30015c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:44576/0 (socket says 172.21.15.45:44576) 2023-11-18T19:15:11.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.679+0000 7fb305fb2640 1 -- 172.21.15.45:0/965478802 learned_addr learned my addr 172.21.15.45:0/965478802 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.679+0000 7fb304fb0640 1 --2- 172.21.15.45:0/965478802 >> v2:172.21.15.135:3300/0 conn(0x7fb3000bd510 0x7fb3000c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.679+0000 7fb3057b1640 1 --2- 172.21.15.45:0/965478802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4880 0x7fb300159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.680+0000 7fb2f7fff640 1 -- 172.21.15.45:0/965478802 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662297639 0 0) 0x7fb3000c50d0 con 0x7fb3000c4c60 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.680+0000 7fb2f7fff640 1 -- 172.21.15.45:0/965478802 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec003520 con 0x7fb3000c4c60 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.680+0000 7fb3057b1640 1 -- 172.21.15.45:0/965478802 >> v2:172.21.15.135:3300/0 conn(0x7fb3000bd510 msgr2=0x7fb3000c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.680+0000 7fb3057b1640 1 --2- 172.21.15.45:0/965478802 >> v2:172.21.15.135:3300/0 conn(0x7fb3000bd510 0x7fb3000c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.680+0000 7fb3057b1640 1 -- 172.21.15.45:0/965478802 >> v1:172.21.15.135:6789/0 conn(0x7fb3000c4c60 legacy=0x7fb30015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.680+0000 7fb3057b1640 1 -- 172.21.15.45:0/965478802 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300158c40 con 0x7fb3000c4880 2023-11-18T19:15:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.682+0000 7fb3057b1640 1 --2- 172.21.15.45:0/965478802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4880 0x7fb300159720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0097a0 tx=0x7fb2fc02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e924df05c2cc095f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.684+0000 7fb2f7fff640 1 -- 172.21.15.45:0/965478802 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc031780 con 0x7fb3000c4880 2023-11-18T19:15:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.684+0000 7fb2f7fff640 1 -- 172.21.15.45:0/965478802 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0318e0 con 0x7fb3000c4880 2023-11-18T19:15:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.684+0000 7fb2f7fff640 1 -- 172.21.15.45:0/965478802 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc031c70 con 0x7fb3000c4880 2023-11-18T19:15:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 -- 172.21.15.45:0/965478802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4880 msgr2=0x7fb300159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 --2- 172.21.15.45:0/965478802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4880 0x7fb300159720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0097a0 tx=0x7fb2fc02b820 comp rx=0 tx=0).stop 2023-11-18T19:15:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 -- 172.21.15.45:0/965478802 shutdown_connections 2023-11-18T19:15:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 --2- 172.21.15.45:0/965478802 >> v2:172.21.15.135:3300/0 conn(0x7fb3000bd510 0x7fb3000c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 --2- 172.21.15.45:0/965478802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4880 0x7fb300159720 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 -- 172.21.15.45:0/965478802 >> 172.21.15.45:0/965478802 conn(0x7fb3000663d0 msgr2=0x7fb3000667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 -- 172.21.15.45:0/965478802 shutdown_connections 2023-11-18T19:15:11.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.685+0000 7fb307a15640 1 -- 172.21.15.45:0/965478802 wait complete. 2023-11-18T19:15:11.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.688+0000 7fb307a15640 1 Processor -- start 2023-11-18T19:15:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.696+0000 7fb307a15640 1 -- start start 2023-11-18T19:15:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.697+0000 7fb307a15640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3000bd510 0x7fb3000c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.697+0000 7fb307a15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3000c4880 0x7fb300152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.697+0000 7fb307a15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4c60 0x7fb3001527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.697+0000 7fb307a15640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c3c20 con 0x7fb3000c4880 2023-11-18T19:15:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.697+0000 7fb307a15640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c2b30 con 0x7fb3000bd510 2023-11-18T19:15:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.697+0000 7fb307a15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000bfcd0 con 0x7fb3000c4c60 2023-11-18T19:15:11.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.698+0000 7fb304fb0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3000c4880 0x7fb300152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:11.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.698+0000 7fb304fb0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3000c4880 0x7fb300152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38616/0 (socket says 172.21.15.45:38616) 2023-11-18T19:15:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.698+0000 7fb304fb0640 1 -- 172.21.15.45:0/3750524469 learned_addr learned my addr 172.21.15.45:0/3750524469 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.698+0000 7fb3057b1640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3000bd510 0x7fb3000c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.699+0000 7fb304fb0640 1 -- 172.21.15.45:0/3750524469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4c60 msgr2=0x7fb3001527d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-18T19:15:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.699+0000 7fb304fb0640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4c60 0x7fb3001527d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.699+0000 7fb304fb0640 1 -- 172.21.15.45:0/3750524469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3000bd510 msgr2=0x7fb3000c0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.699+0000 7fb304fb0640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3000bd510 0x7fb3000c0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.699+0000 7fb304fb0640 1 -- 172.21.15.45:0/3750524469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009400 con 0x7fb3000c4880 2023-11-18T19:15:11.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.699+0000 7fb304fb0640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3000c4880 0x7fb300152290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000e9b0 tx=0x7fb2f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:11.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.700+0000 7fb2f5ffb640 1 -- 172.21.15.45:0/3750524469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000c9a0 con 0x7fb3000c4880 2023-11-18T19:15:11.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.700+0000 7fb2f5ffb640 1 -- 172.21.15.45:0/3750524469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000cb00 con 0x7fb3000c4880 2023-11-18T19:15:11.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.700+0000 7fb2f5ffb640 1 -- 172.21.15.45:0/3750524469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0013470 con 0x7fb3000c4880 2023-11-18T19:15:11.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.701+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3000c3660 con 0x7fb3000c4880 2023-11-18T19:15:11.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.701+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000c27c0 con 0x7fb3000c4880 2023-11-18T19:15:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.703+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e0005250 con 0x7fb3000c4880 2023-11-18T19:15:11.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.706+0000 7fb2f5ffb640 1 -- 172.21.15.45:0/3750524469 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2f00135d0 con 0x7fb3000c4880 2023-11-18T19:15:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.708+0000 7fb2f5ffb640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb2e406ae40 0x7fb2e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.708+0000 7fb2f5ffb640 1 -- 172.21.15.45:0/3750524469 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fb2f0089bd0 con 0x7fb3000c4880 2023-11-18T19:15:11.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.709+0000 7fb3057b1640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb2e406ae40 0x7fb2e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:11.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.711+0000 7fb3057b1640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb2e406ae40 0x7fb2e406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc036000 tx=0x7fb2fc03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:11.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:11.720+0000 7fb2f5ffb640 1 -- 172.21.15.45:0/3750524469 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2f0054920 con 0x7fb3000c4880 2023-11-18T19:15:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.034+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2e0005500 con 0x7fb3000c4880 2023-11-18T19:15:12.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.036+0000 7fb2f5ffb640 1 -- 172.21.15.45:0/3750524469 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18481 (secure 0 0 0) 0x7fb2f0017090 con 0x7fb3000c4880 2023-11-18T19:15:12.038 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:15:12.038 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:07:25.049601+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:15:12.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.038+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb2e406ae40 msgr2=0x7fb2e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.038+0000 7fb307a15640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb2e406ae40 0x7fb2e406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc036000 tx=0x7fb2fc03d040 comp rx=0 tx=0).stop 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.038+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3000c4880 msgr2=0x7fb300152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.038+0000 7fb307a15640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3000c4880 0x7fb300152290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000e9b0 tx=0x7fb2f000ee70 comp rx=0 tx=0).stop 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 shutdown_connections 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fb2e406ae40 0x7fb2e406d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb3000c4c60 0x7fb3001527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3000c4880 0x7fb300152290 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 --2- 172.21.15.45:0/3750524469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3000bd510 0x7fb3000c0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 >> 172.21.15.45:0/3750524469 conn(0x7fb3000663d0 msgr2=0x7fb3000aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 shutdown_connections 2023-11-18T19:15:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.039+0000 7fb307a15640 1 -- 172.21.15.45:0/3750524469 wait complete. 2023-11-18T19:15:12.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T19:06:35.454808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T19:06:36.526298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T19:06:39.617712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T19:15:12.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:15:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.245+0000 7fa575fef640 1 Processor -- start 2023-11-18T19:15:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.245+0000 7fa575fef640 1 -- start start 2023-11-18T19:15:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa575fef640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa570155560 0x7fa5700713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa575fef640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa570157fc0 con 0x7fa5700c22d0 2023-11-18T19:15:12.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa575fef640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5701582a0 con 0x7fa570072260 2023-11-18T19:15:12.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa575fef640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700c1e80 con 0x7fa570155560 2023-11-18T19:15:12.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa56ffff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa570155560 0x7fa5700713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa5757ee640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa5700c22d0 0x7fa5700c2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37248/0 (socket says 172.21.15.45:37248) 2023-11-18T19:15:12.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa574fed640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa570072260 0x7fa570154e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:44584/0 (socket says 172.21.15.45:44584) 2023-11-18T19:15:12.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.247+0000 7fa5757ee640 1 -- 172.21.15.45:0/2202241035 learned_addr learned my addr 172.21.15.45:0/2202241035 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:12.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.248+0000 7fa56ffff640 1 -- 172.21.15.45:0/2202241035 >> v1:172.21.15.135:6789/0 conn(0x7fa570072260 legacy=0x7fa570154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.248+0000 7fa56ffff640 1 -- 172.21.15.45:0/2202241035 >> v1:172.21.15.45:6789/0 conn(0x7fa5700c22d0 legacy=0x7fa5700c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.248+0000 7fa56f7fe640 1 -- 172.21.15.45:0/2202241035 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191557225 0 0) 0x7fa570157fc0 con 0x7fa5700c22d0 2023-11-18T19:15:12.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.248+0000 7fa56ffff640 1 -- 172.21.15.45:0/2202241035 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570158580 con 0x7fa570155560 2023-11-18T19:15:12.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.249+0000 7fa56ffff640 1 --2- 172.21.15.45:0/2202241035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 0x7fa5700713d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0097a0 tx=0x7fa55c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a360255d6cec18a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.249+0000 7fa56f7fe640 1 -- 172.21.15.45:0/2202241035 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c030610 con 0x7fa570155560 2023-11-18T19:15:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa56f7fe640 1 -- 172.21.15.45:0/2202241035 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c030770 con 0x7fa570155560 2023-11-18T19:15:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa56f7fe640 1 -- 172.21.15.45:0/2202241035 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c030b00 con 0x7fa570155560 2023-11-18T19:15:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa575fef640 1 -- 172.21.15.45:0/2202241035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 msgr2=0x7fa5700713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa575fef640 1 --2- 172.21.15.45:0/2202241035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 0x7fa5700713d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0097a0 tx=0x7fa55c02b960 comp rx=0 tx=0).stop 2023-11-18T19:15:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa575fef640 1 -- 172.21.15.45:0/2202241035 shutdown_connections 2023-11-18T19:15:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa575fef640 1 --2- 172.21.15.45:0/2202241035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 0x7fa5700713d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa575fef640 1 -- 172.21.15.45:0/2202241035 >> 172.21.15.45:0/2202241035 conn(0x7fa5700a8920 msgr2=0x7fa5700a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa575fef640 1 -- 172.21.15.45:0/2202241035 shutdown_connections 2023-11-18T19:15:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.250+0000 7fa575fef640 1 -- 172.21.15.45:0/2202241035 wait complete. 2023-11-18T19:15:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.252+0000 7fa575fef640 1 Processor -- start 2023-11-18T19:15:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.252+0000 7fa575fef640 1 -- start start 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.253+0000 7fa575fef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa570072260 0x7fa57014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.253+0000 7fa575fef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700c22d0 0x7fa57014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.253+0000 7fa575fef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 0x7fa5701481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.253+0000 7fa575fef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57014e680 con 0x7fa570072260 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.253+0000 7fa575fef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570156500 con 0x7fa570155560 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.253+0000 7fa575fef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5701567e0 con 0x7fa5700c22d0 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa570072260 0x7fa57014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa570072260 0x7fa57014dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38626/0 (socket says 172.21.15.45:38626) 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 -- 172.21.15.45:0/3297423523 learned_addr learned my addr 172.21.15.45:0/3297423523 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa56ffff640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700c22d0 0x7fa57014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa5757ee640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 0x7fa5701481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 -- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700c22d0 msgr2=0x7fa57014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700c22d0 0x7fa57014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 -- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 msgr2=0x7fa5701481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 0x7fa5701481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 -- 172.21.15.45:0/3297423523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009400 con 0x7fa570072260 2023-11-18T19:15:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.254+0000 7fa574fed640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa570072260 0x7fa57014dc00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa56400c4d0 tx=0x7fa56400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.255+0000 7fa56d7fa640 1 -- 172.21.15.45:0/3297423523 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564007480 con 0x7fa570072260 2023-11-18T19:15:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.255+0000 7fa56d7fa640 1 -- 172.21.15.45:0/3297423523 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5640075e0 con 0x7fa570072260 2023-11-18T19:15:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.255+0000 7fa56d7fa640 1 -- 172.21.15.45:0/3297423523 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640049e0 con 0x7fa570072260 2023-11-18T19:15:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.255+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5700c2ff0 con 0x7fa570072260 2023-11-18T19:15:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.255+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa570156da0 con 0x7fa570072260 2023-11-18T19:15:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.256+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5700683a0 con 0x7fa570072260 2023-11-18T19:15:12.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.257+0000 7fa56d7fa640 1 -- 172.21.15.45:0/3297423523 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa564004b40 con 0x7fa570072260 2023-11-18T19:15:12.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.258+0000 7fa56d7fa640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55406ae70 0x7fa55406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.258+0000 7fa56d7fa640 1 -- 172.21.15.45:0/3297423523 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fa564088a20 con 0x7fa570072260 2023-11-18T19:15:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.258+0000 7fa56ffff640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55406ae70 0x7fa55406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.259+0000 7fa56ffff640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55406ae70 0x7fa55406d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa55c036000 tx=0x7fa55c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.266+0000 7fa56d7fa640 1 -- 172.21.15.45:0/3297423523 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa564053820 con 0x7fa570072260 2023-11-18T19:15:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.452+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa57006d620 con 0x7fa570072260 2023-11-18T19:15:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.452+0000 7fa56d7fa640 1 -- 172.21.15.45:0/3297423523 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5640180a0 con 0x7fa570072260 2023-11-18T19:15:12.454 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:15:12.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.454+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55406ae70 msgr2=0x7fa55406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.454+0000 7fa575fef640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55406ae70 0x7fa55406d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa55c036000 tx=0x7fa55c008030 comp rx=0 tx=0).stop 2023-11-18T19:15:12.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.454+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa570072260 msgr2=0x7fa57014dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.454+0000 7fa575fef640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa570072260 0x7fa57014dc00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa56400c4d0 tx=0x7fa56400c990 comp rx=0 tx=0).stop 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 shutdown_connections 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa570155560 0x7fa5701481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fa55406ae70 0x7fa55406d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5700c22d0 0x7fa57014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 --2- 172.21.15.45:0/3297423523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa570072260 0x7fa57014dc00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 >> 172.21.15.45:0/3297423523 conn(0x7fa5700a8920 msgr2=0x7fa5700a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 shutdown_connections 2023-11-18T19:15:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.455+0000 7fa575fef640 1 -- 172.21.15.45:0/3297423523 wait complete. 2023-11-18T19:15:12.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T19:15:12.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.684+0000 7f7c713bf640 1 Processor -- start 2023-11-18T19:15:12.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.684+0000 7f7c713bf640 1 -- start start 2023-11-18T19:15:12.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.685+0000 7f7c713bf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c6c0c39c0 0x7f7c6c152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.685+0000 7f7c713bf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c06ad10 con 0x7f7c6c06a500 2023-11-18T19:15:12.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.685+0000 7f7c713bf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c0c3fa0 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.685+0000 7f7c713bf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0c4280 con 0x7f7c6c0c39c0 2023-11-18T19:15:12.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.686+0000 7f7c6bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7c6c06a500 0x7f7c6c06d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37262/0 (socket says 172.21.15.45:37262) 2023-11-18T19:15:12.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.686+0000 7f7c6bfff640 1 -- 172.21.15.45:0/1504456913 learned_addr learned my addr 172.21.15.45:0/1504456913 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:12.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.686+0000 7f7c6b7fe640 1 --2- 172.21.15.45:0/1504456913 >> v2:172.21.15.45:3300/0 conn(0x7f7c6c0c39c0 0x7f7c6c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.686+0000 7f7c6b7fe640 1 -- 172.21.15.45:0/1504456913 >> v1:172.21.15.135:6789/0 conn(0x7f7c6c06a8e0 legacy=0x7f7c6c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:12.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.686+0000 7f7c6b7fe640 1 -- 172.21.15.45:0/1504456913 >> v1:172.21.15.45:6789/0 conn(0x7f7c6c06a500 legacy=0x7f7c6c06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.686+0000 7f7c6b7fe640 1 -- 172.21.15.45:0/1504456913 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0c4560 con 0x7f7c6c0c39c0 2023-11-18T19:15:12.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.687+0000 7f7c6b7fe640 1 --2- 172.21.15.45:0/1504456913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c0c39c0 0x7f7c6c152280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c600097a0 tx=0x7f7c6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da55a508f039c6b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.687+0000 7f7c6affd640 1 -- 172.21.15.45:0/1504456913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6002e070 con 0x7f7c6c0c39c0 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c6affd640 1 -- 172.21.15.45:0/1504456913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600315a0 con 0x7f7c6c0c39c0 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c6affd640 1 -- 172.21.15.45:0/1504456913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60031930 con 0x7f7c6c0c39c0 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c713bf640 1 -- 172.21.15.45:0/1504456913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c0c39c0 msgr2=0x7f7c6c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c713bf640 1 --2- 172.21.15.45:0/1504456913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c0c39c0 0x7f7c6c152280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c600097a0 tx=0x7f7c6002b840 comp rx=0 tx=0).stop 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c713bf640 1 -- 172.21.15.45:0/1504456913 shutdown_connections 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c713bf640 1 --2- 172.21.15.45:0/1504456913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c0c39c0 0x7f7c6c152280 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c713bf640 1 -- 172.21.15.45:0/1504456913 >> 172.21.15.45:0/1504456913 conn(0x7f7c6c0a7870 msgr2=0x7f7c6c0a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:12.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c713bf640 1 -- 172.21.15.45:0/1504456913 shutdown_connections 2023-11-18T19:15:12.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.688+0000 7f7c713bf640 1 -- 172.21.15.45:0/1504456913 wait complete. 2023-11-18T19:15:12.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.690+0000 7f7c713bf640 1 Processor -- start 2023-11-18T19:15:12.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.690+0000 7f7c713bf640 1 -- start start 2023-11-18T19:15:12.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c713bf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c6c06a500 0x7f7c6c144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c713bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c06a8e0 0x7f7c6c1ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c713bf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c6c0c39c0 0x7f7c6c0beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c713bf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c145510 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c713bf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0c01b0 con 0x7f7c6c0c39c0 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c713bf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c1ee5f0 con 0x7f7c6c06a500 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c06a8e0 0x7f7c6c1ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c06a8e0 0x7f7c6c1ee0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38636/0 (socket says 172.21.15.45:38636) 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 -- 172.21.15.45:0/4122861200 learned_addr learned my addr 172.21.15.45:0/4122861200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6bfff640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c6c06a500 0x7f7c6c144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c70bbe640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c6c0c39c0 0x7f7c6c0beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 -- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c6c06a500 msgr2=0x7f7c6c144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c6c06a500 0x7f7c6c144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 -- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c6c0c39c0 msgr2=0x7f7c6c0beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c6c0c39c0 0x7f7c6c0beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.691+0000 7f7c6b7fe640 1 -- 172.21.15.45:0/4122861200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009400 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.692+0000 7f7c6bfff640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c6c06a500 0x7f7c6c144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.692+0000 7f7c6b7fe640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c06a8e0 0x7f7c6c1ee0b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034040 tx=0x7f7c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.692+0000 7f7c68ff9640 1 -- 172.21.15.45:0/4122861200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60032640 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.692+0000 7f7c68ff9640 1 -- 172.21.15.45:0/4122861200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600327e0 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.692+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c0bfd10 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.692+0000 7f7c68ff9640 1 -- 172.21.15.45:0/4122861200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60032b90 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.692+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0aaa40 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.694+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c0aac30 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.694+0000 7f7c68ff9640 1 -- 172.21.15.45:0/4122861200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c60032cf0 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.696+0000 7f7c68ff9640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7c5806ae40 0x7f7c5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:12.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.696+0000 7f7c68ff9640 1 -- 172.21.15.45:0/4122861200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7c600ab630 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.696+0000 7f7c6bfff640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7c5806ae40 0x7f7c5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:12.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.696+0000 7f7c6bfff640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7c5806ae40 0x7f7c5806d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c007fd0 tx=0x7f7c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:12.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.700+0000 7f7c68ff9640 1 -- 172.21.15.45:0/4122861200 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c60076540 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.885+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c6c0683a0 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.886+0000 7f7c68ff9640 1 -- 172.21.15.45:0/4122861200 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c60079b60 con 0x7f7c6c06a8e0 2023-11-18T19:15:12.888 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:15:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7c5806ae40 msgr2=0x7f7c5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7c5806ae40 0x7f7c5806d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c007fd0 tx=0x7f7c5c009040 comp rx=0 tx=0).stop 2023-11-18T19:15:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c06a8e0 msgr2=0x7f7c6c1ee0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c06a8e0 0x7f7c6c1ee0b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034040 tx=0x7f7c600046c0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 shutdown_connections 2023-11-18T19:15:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c6c0c39c0 0x7f7c6c0beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c6c06a8e0 0x7f7c6c1ee0b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f7c5806ae40 0x7f7c5806d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 --2- 172.21.15.45:0/4122861200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c6c06a500 0x7f7c6c144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 >> 172.21.15.45:0/4122861200 conn(0x7f7c6c0a7870 msgr2=0x7f7c6c14bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 shutdown_connections 2023-11-18T19:15:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:12.889+0000 7f7c713bf640 1 -- 172.21.15.45:0/4122861200 wait complete. 2023-11-18T19:15:12.909 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T19:15:13.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.121+0000 7fe88f59e640 1 Processor -- start 2023-11-18T19:15:13.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.121+0000 7fe88f59e640 1 -- start start 2023-11-18T19:15:13.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88f59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe89006a500 0x7fe8900c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe890152280 0x7fe89006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89006d5c0 0x7fe89006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88f59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900c3fa0 con 0x7fe890152280 2023-11-18T19:15:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88f59e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900c4280 con 0x7fe89006a500 2023-11-18T19:15:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900c4560 con 0x7fe89006d5c0 2023-11-18T19:15:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe887fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe890152280 0x7fe89006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe887fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe890152280 0x7fe89006a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58478/0 (socket says 172.21.15.45:58478) 2023-11-18T19:15:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe887fff640 1 -- 172.21.15.45:0/3767571630 learned_addr learned my addr 172.21.15.45:0/3767571630 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:13.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88e59c640 1 --2- 172.21.15.45:0/3767571630 >> v2:172.21.15.135:3300/0 conn(0x7fe89006a500 0x7fe8900c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe88ed9d640 1 --2- 172.21.15.45:0/3767571630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89006d5c0 0x7fe89006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe887fff640 1 -- 172.21.15.45:0/3767571630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89006d5c0 msgr2=0x7fe89006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:13.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.123+0000 7fe887fff640 1 --2- 172.21.15.45:0/3767571630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89006d5c0 0x7fe89006da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.124+0000 7fe887fff640 1 -- 172.21.15.45:0/3767571630 >> v2:172.21.15.135:3300/0 conn(0x7fe89006a500 msgr2=0x7fe8900c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:13.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.124+0000 7fe887fff640 1 --2- 172.21.15.45:0/3767571630 >> v2:172.21.15.135:3300/0 conn(0x7fe89006a500 0x7fe8900c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.124+0000 7fe887fff640 1 -- 172.21.15.45:0/3767571630 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900c4840 con 0x7fe890152280 2023-11-18T19:15:13.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.125+0000 7fe887fff640 1 --2- 172.21.15.45:0/3767571630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe890152280 0x7fe89006a8e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe8900c6980 tx=0x7fe87802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40031ff01a4053a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.125+0000 7fe88dd9b640 1 -- 172.21.15.45:0/3767571630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8780317f0 con 0x7fe890152280 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.125+0000 7fe88dd9b640 1 -- 172.21.15.45:0/3767571630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe878031950 con 0x7fe890152280 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.125+0000 7fe88dd9b640 1 -- 172.21.15.45:0/3767571630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878031ce0 con 0x7fe890152280 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 -- 172.21.15.45:0/3767571630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe890152280 msgr2=0x7fe89006a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 --2- 172.21.15.45:0/3767571630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe890152280 0x7fe89006a8e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe8900c6980 tx=0x7fe87802b890 comp rx=0 tx=0).stop 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 -- 172.21.15.45:0/3767571630 shutdown_connections 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 --2- 172.21.15.45:0/3767571630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89006d5c0 0x7fe89006da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 --2- 172.21.15.45:0/3767571630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe890152280 0x7fe89006a8e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 --2- 172.21.15.45:0/3767571630 >> v2:172.21.15.135:3300/0 conn(0x7fe89006a500 0x7fe8900c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 -- 172.21.15.45:0/3767571630 >> 172.21.15.45:0/3767571630 conn(0x7fe8900a7870 msgr2=0x7fe8900a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:13.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 -- 172.21.15.45:0/3767571630 shutdown_connections 2023-11-18T19:15:13.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.126+0000 7fe88f59e640 1 -- 172.21.15.45:0/3767571630 wait complete. 2023-11-18T19:15:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.128+0000 7fe88f59e640 1 Processor -- start 2023-11-18T19:15:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.128+0000 7fe88f59e640 1 -- start start 2023-11-18T19:15:13.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.129+0000 7fe88f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe89006a500 0x7fe8900bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.129+0000 7fe88f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe89006d5c0 0x7fe8900a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.129+0000 7fe88f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe890152280 0x7fe8900a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.129+0000 7fe88f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900aa4e0 con 0x7fe89006a500 2023-11-18T19:15:13.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.129+0000 7fe88f59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900a96f0 con 0x7fe89006d5c0 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.129+0000 7fe88f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89014eba0 con 0x7fe890152280 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe89006a500 0x7fe8900bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe89006a500 0x7fe8900bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58482/0 (socket says 172.21.15.45:58482) 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 -- 172.21.15.45:0/717633073 learned_addr learned my addr 172.21.15.45:0/717633073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe887fff640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe89006d5c0 0x7fe8900a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88ed9d640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe890152280 0x7fe8900a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 -- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe890152280 msgr2=0x7fe8900a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe890152280 0x7fe8900a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 -- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe89006d5c0 msgr2=0x7fe8900a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe89006d5c0 0x7fe8900a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88e59c640 1 -- 172.21.15.45:0/717633073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8780094d0 con 0x7fe89006a500 2023-11-18T19:15:13.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.130+0000 7fe88ed9d640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe890152280 0x7fe8900a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:15:13.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.131+0000 7fe88e59c640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe89006a500 0x7fe8900bf160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d830 tx=0x7fe88000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:13.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.131+0000 7fe886ffd640 1 -- 172.21.15.45:0/717633073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000be10 con 0x7fe89006a500 2023-11-18T19:15:13.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.131+0000 7fe886ffd640 1 -- 172.21.15.45:0/717633073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8800098b0 con 0x7fe89006a500 2023-11-18T19:15:13.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.131+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8901ea640 con 0x7fe89006a500 2023-11-18T19:15:13.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.131+0000 7fe886ffd640 1 -- 172.21.15.45:0/717633073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880009a40 con 0x7fe89006a500 2023-11-18T19:15:13.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.131+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8900aa6c0 con 0x7fe89006a500 2023-11-18T19:15:13.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.132+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8901eab20 con 0x7fe89006a500 2023-11-18T19:15:13.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.133+0000 7fe886ffd640 1 -- 172.21.15.45:0/717633073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe880009ba0 con 0x7fe89006a500 2023-11-18T19:15:13.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.134+0000 7fe886ffd640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe87006ae40 0x7fe87006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.134+0000 7fe886ffd640 1 -- 172.21.15.45:0/717633073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe880089bb0 con 0x7fe89006a500 2023-11-18T19:15:13.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.134+0000 7fe887fff640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe87006ae40 0x7fe87006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.135+0000 7fe887fff640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe87006ae40 0x7fe87006d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe878036000 tx=0x7fe87803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:13.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.139+0000 7fe886ffd640 1 -- 172.21.15.45:0/717633073 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe8901eab20 con 0x7fe89006a500 2023-11-18T19:15:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.335+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8901eab20 con 0x7fe89006a500 2023-11-18T19:15:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.336+0000 7fe886ffd640 1 -- 172.21.15.45:0/717633073 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8901eab20 con 0x7fe89006a500 2023-11-18T19:15:13.338 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-18T19:15:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe87006ae40 msgr2=0x7fe87006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe87006ae40 0x7fe87006d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe878036000 tx=0x7fe87803d040 comp rx=0 tx=0).stop 2023-11-18T19:15:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe89006a500 msgr2=0x7fe8900bf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe89006a500 0x7fe8900bf160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d830 tx=0x7fe88000dcf0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 shutdown_connections 2023-11-18T19:15:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe87006ae40 0x7fe87006d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe890152280 0x7fe8900a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe89006d5c0 0x7fe8900a8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 --2- 172.21.15.45:0/717633073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe89006a500 0x7fe8900bf160 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 >> 172.21.15.45:0/717633073 conn(0x7fe8900a7870 msgr2=0x7fe890071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 shutdown_connections 2023-11-18T19:15:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.339+0000 7fe88f59e640 1 -- 172.21.15.45:0/717633073 wait complete. 2023-11-18T19:15:13.358 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T19:15:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.578+0000 7fd7ad5a9640 1 Processor -- start 2023-11-18T19:15:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.578+0000 7fd7ad5a9640 1 -- start start 2023-11-18T19:15:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7ad5a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a814fc40 0x7fd7a8152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7ad5a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7a80c1d50 0x7fd7a80c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7ad5a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80c07d0 con 0x7fd7a80ab740 2023-11-18T19:15:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7ad5a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a806e3b0 con 0x7fd7a80c1d50 2023-11-18T19:15:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7ad5a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80c21e0 con 0x7fd7a814fc40 2023-11-18T19:15:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7a80c1d50 0x7fd7a80c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7a80c1d50 0x7fd7a80c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58494/0 (socket says 172.21.15.45:58494) 2023-11-18T19:15:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.580+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3940074208 learned_addr learned my addr 172.21.15.45:0/3940074208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.581+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/3940074208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a814fc40 0x7fd7a8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.581+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3940074208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a814fc40 msgr2=0x7fd7a8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:15:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.581+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/3940074208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a814fc40 0x7fd7a8152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.581+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3940074208 >> v1:172.21.15.135:6789/0 conn(0x7fd7a80ab740 legacy=0x7fd7a806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.581+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3940074208 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8072070 con 0x7fd7a80c1d50 2023-11-18T19:15:13.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.582+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/3940074208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a80c1d50 0x7fd7a80c4f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009e50 tx=0x7fd7a002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e916a985fc01e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:13.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.582+0000 7fd7a5ffb640 1 -- 172.21.15.45:0/3940074208 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a002c9e0 con 0x7fd7a80c1d50 2023-11-18T19:15:13.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.582+0000 7fd7a5ffb640 1 -- 172.21.15.45:0/3940074208 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a002cb40 con 0x7fd7a80c1d50 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.582+0000 7fd7a5ffb640 1 -- 172.21.15.45:0/3940074208 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00343f0 con 0x7fd7a80c1d50 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/3940074208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a80c1d50 msgr2=0x7fd7a80c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/3940074208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a80c1d50 0x7fd7a80c4f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009e50 tx=0x7fd7a002be40 comp rx=0 tx=0).stop 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/3940074208 shutdown_connections 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/3940074208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a80c1d50 0x7fd7a80c4f40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/3940074208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a814fc40 0x7fd7a8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/3940074208 >> 172.21.15.45:0/3940074208 conn(0x7fd7a80a7980 msgr2=0x7fd7a80a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/3940074208 shutdown_connections 2023-11-18T19:15:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.583+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/3940074208 wait complete. 2023-11-18T19:15:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.585+0000 7fd7ad5a9640 1 Processor -- start 2023-11-18T19:15:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.585+0000 7fd7ad5a9640 1 -- start start 2023-11-18T19:15:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7ad5a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a80ab740 0x7fd7a80bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7ad5a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a80c1d50 0x7fd7a814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7ad5a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a814fc40 0x7fd7a814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7ad5a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8154900 con 0x7fd7a814fc40 2023-11-18T19:15:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7ad5a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a814cdb0 con 0x7fd7a80ab740 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7ad5a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8156480 con 0x7fd7a80c1d50 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a814fc40 0x7fd7a814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a814fc40 0x7fd7a814c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58504/0 (socket says 172.21.15.45:58504) 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7a77fe640 1 -- 172.21.15.45:0/2402912042 learned_addr learned my addr 172.21.15.45:0/2402912042 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a80ab740 0x7fd7a80bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7a67fc640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a80c1d50 0x7fd7a814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.587+0000 7fd7a77fe640 1 -- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a80c1d50 msgr2=0x7fd7a814c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a80c1d50 0x7fd7a814c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7a77fe640 1 -- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a80ab740 msgr2=0x7fd7a80bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a80ab740 0x7fd7a80bf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7a77fe640 1 -- 172.21.15.45:0/2402912042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0009b30 con 0x7fd7a814fc40 2023-11-18T19:15:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7a67fc640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a80c1d50 0x7fd7a814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:15:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a814fc40 0x7fd7a814c870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009e50 tx=0x7fd7a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd78f7fe640 1 -- 172.21.15.45:0/2402912042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a003e450 con 0x7fd7a814fc40 2023-11-18T19:15:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd78f7fe640 1 -- 172.21.15.45:0/2402912042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a003e5b0 con 0x7fd7a814fc40 2023-11-18T19:15:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd78f7fe640 1 -- 172.21.15.45:0/2402912042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a003e960 con 0x7fd7a814fc40 2023-11-18T19:15:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a81566d0 con 0x7fd7a814fc40 2023-11-18T19:15:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.588+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8154340 con 0x7fd7a814fc40 2023-11-18T19:15:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.589+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a8066b80 con 0x7fd7a814fc40 2023-11-18T19:15:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.590+0000 7fd78f7fe640 1 -- 172.21.15.45:0/2402912042 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7a003eac0 con 0x7fd7a814fc40 2023-11-18T19:15:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.591+0000 7fd78f7fe640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd79406ae40 0x7fd79406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.592+0000 7fd78f7fe640 1 -- 172.21.15.45:0/2402912042 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd7a00ac6d0 con 0x7fd7a814fc40 2023-11-18T19:15:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.592+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd79406ae40 0x7fd79406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.592+0000 7fd7a6ffd640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd79406ae40 0x7fd79406d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd798008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.597+0000 7fd78f7fe640 1 -- 172.21.15.45:0/2402912042 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7a0077420 con 0x7fd7a814fc40 2023-11-18T19:15:13.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.800+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7a8153390 con 0x7fd7a814fc40 2023-11-18T19:15:13.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.801+0000 7fd78f7fe640 1 -- 172.21.15.45:0/2402912042 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd7a007aa40 con 0x7fd7a814fc40 2023-11-18T19:15:13.803 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd79406ae40 msgr2=0x7fd79406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd79406ae40 0x7fd79406d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd798008040 comp rx=0 tx=0).stop 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a814fc40 msgr2=0x7fd7a814c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a814fc40 0x7fd7a814c870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009e50 tx=0x7fd7a0004a40 comp rx=0 tx=0).stop 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 shutdown_connections 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a814fc40 0x7fd7a814c870 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd79406ae40 0x7fd79406d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7a80c1d50 0x7fd7a814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 --2- 172.21.15.45:0/2402912042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a80ab740 0x7fd7a80bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 >> 172.21.15.45:0/2402912042 conn(0x7fd7a80a7980 msgr2=0x7fd7a8151b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 shutdown_connections 2023-11-18T19:15:13.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:13.804+0000 7fd7ad5a9640 1 -- 172.21.15.45:0/2402912042 wait complete. 2023-11-18T19:15:13.827 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T19:15:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.049+0000 7fe628fac640 1 Processor -- start 2023-11-18T19:15:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.049+0000 7fe628fac640 1 -- start start 2023-11-18T19:15:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.050+0000 7fe628fac640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe62406d9d0 0x7fe6240c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.051+0000 7fe628fac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6241579b0 con 0x7fe624151b80 2023-11-18T19:15:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.051+0000 7fe628fac640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe624072ba0 con 0x7fe624154870 2023-11-18T19:15:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.051+0000 7fe628fac640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe624151f60 con 0x7fe62406d9d0 2023-11-18T19:15:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.051+0000 7fe6237fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe624151b80 0x7fe6240bef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51758/0 (socket says 172.21.15.45:51758) 2023-11-18T19:15:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.051+0000 7fe6237fe640 1 -- 172.21.15.45:0/2572764963 learned_addr learned my addr 172.21.15.45:0/2572764963 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:15:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.051+0000 7fe622ffd640 1 --2- 172.21.15.45:0/2572764963 >> v2:172.21.15.135:3300/0 conn(0x7fe62406d9d0 0x7fe6240c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.052+0000 7fe6227fc640 1 -- 172.21.15.45:0/2572764963 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437704913 0 0) 0x7fe6241579b0 con 0x7fe624151b80 2023-11-18T19:15:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.052+0000 7fe6227fc640 1 -- 172.21.15.45:0/2572764963 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe610003520 con 0x7fe624151b80 2023-11-18T19:15:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.052+0000 7fe622ffd640 1 -- 172.21.15.45:0/2572764963 >> v1:172.21.15.135:6789/0 conn(0x7fe624154870 legacy=0x7fe624154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.052+0000 7fe622ffd640 1 -- 172.21.15.45:0/2572764963 >> v1:172.21.15.45:6789/0 conn(0x7fe624151b80 legacy=0x7fe6240bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.052+0000 7fe622ffd640 1 -- 172.21.15.45:0/2572764963 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6241553b0 con 0x7fe62406d9d0 2023-11-18T19:15:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.053+0000 7fe622ffd640 1 --2- 172.21.15.45:0/2572764963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe62406d9d0 0x7fe6240c4f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097a0 tx=0x7fe60c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc9db3f338bf18c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe6227fc640 1 -- 172.21.15.45:0/2572764963 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c031830 con 0x7fe62406d9d0 2023-11-18T19:15:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe6227fc640 1 -- 172.21.15.45:0/2572764963 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c031990 con 0x7fe62406d9d0 2023-11-18T19:15:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe6227fc640 1 -- 172.21.15.45:0/2572764963 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c031d00 con 0x7fe62406d9d0 2023-11-18T19:15:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe628fac640 1 -- 172.21.15.45:0/2572764963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe62406d9d0 msgr2=0x7fe6240c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe628fac640 1 --2- 172.21.15.45:0/2572764963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe62406d9d0 0x7fe6240c4f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097a0 tx=0x7fe60c02b8d0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe628fac640 1 -- 172.21.15.45:0/2572764963 shutdown_connections 2023-11-18T19:15:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe628fac640 1 --2- 172.21.15.45:0/2572764963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe62406d9d0 0x7fe6240c4f30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe628fac640 1 -- 172.21.15.45:0/2572764963 >> 172.21.15.45:0/2572764963 conn(0x7fe6240a78a0 msgr2=0x7fe6240a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.054+0000 7fe628fac640 1 -- 172.21.15.45:0/2572764963 shutdown_connections 2023-11-18T19:15:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.055+0000 7fe628fac640 1 -- 172.21.15.45:0/2572764963 wait complete. 2023-11-18T19:15:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.056+0000 7fe628fac640 1 Processor -- start 2023-11-18T19:15:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.056+0000 7fe628fac640 1 -- start start 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.057+0000 7fe628fac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62406d9d0 0x7fe6241ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.057+0000 7fe628fac640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe624151b80 0x7fe62414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.057+0000 7fe628fac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe624154870 0x7fe62414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.057+0000 7fe628fac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240a55d0 con 0x7fe62406d9d0 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.057+0000 7fe628fac640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240ab650 con 0x7fe624154870 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.057+0000 7fe628fac640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6241eb010 con 0x7fe624151b80 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62406d9d0 0x7fe6241ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62406d9d0 0x7fe6241ed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58508/0 (socket says 172.21.15.45:58508) 2023-11-18T19:15:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 -- 172.21.15.45:0/3720394899 learned_addr learned my addr 172.21.15.45:0/3720394899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:15:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe623fff640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe624154870 0x7fe62414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe622ffd640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe624151b80 0x7fe62414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 -- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe624151b80 msgr2=0x7fe62414ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe624151b80 0x7fe62414ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 -- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe624154870 msgr2=0x7fe62414cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe624154870 0x7fe62414cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 -- 172.21.15.45:0/3720394899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c009400 con 0x7fe62406d9d0 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe622ffd640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe624151b80 0x7fe62414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.058+0000 7fe6237fe640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62406d9d0 0x7fe6241ed2e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe61400cbc0 tx=0x7fe61400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.059+0000 7fe61bfff640 1 -- 172.21.15.45:0/3720394899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400ad40 con 0x7fe62406d9d0 2023-11-18T19:15:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.059+0000 7fe61bfff640 1 -- 172.21.15.45:0/3720394899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614012400 con 0x7fe62406d9d0 2023-11-18T19:15:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.059+0000 7fe61bfff640 1 -- 172.21.15.45:0/3720394899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400aea0 con 0x7fe62406d9d0 2023-11-18T19:15:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.059+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62414d4e0 con 0x7fe62406d9d0 2023-11-18T19:15:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.059+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6241ede30 con 0x7fe62406d9d0 2023-11-18T19:15:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.060+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624067940 con 0x7fe62406d9d0 2023-11-18T19:15:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.061+0000 7fe61bfff640 1 -- 172.21.15.45:0/3720394899 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe614007070 con 0x7fe62406d9d0 2023-11-18T19:15:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.062+0000 7fe61bfff640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe60406ae70 0x7fe60406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:15:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.062+0000 7fe61bfff640 1 -- 172.21.15.45:0/3720394899 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe6140898c0 con 0x7fe62406d9d0 2023-11-18T19:15:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.062+0000 7fe622ffd640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe60406ae70 0x7fe60406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:15:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.063+0000 7fe622ffd640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe60406ae70 0x7fe60406d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe60c036000 tx=0x7fe60c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:15:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.067+0000 7fe61bfff640 1 -- 172.21.15.45:0/3720394899 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6140546d0 con 0x7fe62406d9d0 2023-11-18T19:15:14.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.276+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe6240683a0 con 0x7fe62406d9d0 2023-11-18T19:15:14.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.277+0000 7fe61bfff640 1 -- 172.21.15.45:0/3720394899 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe614017080 con 0x7fe62406d9d0 2023-11-18T19:15:14.278 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-18T19:15:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.279+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe60406ae70 msgr2=0x7fe60406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.279+0000 7fe628fac640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe60406ae70 0x7fe60406d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe60c036000 tx=0x7fe60c008030 comp rx=0 tx=0).stop 2023-11-18T19:15:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.279+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62406d9d0 msgr2=0x7fe6241ed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:15:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.279+0000 7fe628fac640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62406d9d0 0x7fe6241ed2e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe61400cbc0 tx=0x7fe61400a430 comp rx=0 tx=0).stop 2023-11-18T19:15:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 shutdown_connections 2023-11-18T19:15:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe624154870 0x7fe62414cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe60406ae70 0x7fe60406d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe624151b80 0x7fe62414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 --2- 172.21.15.45:0/3720394899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62406d9d0 0x7fe6241ed2e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:15:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 >> 172.21.15.45:0/3720394899 conn(0x7fe6240a78a0 msgr2=0x7fe6240a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:15:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 shutdown_connections 2023-11-18T19:15:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:15:14.280+0000 7fe628fac640 1 -- 172.21.15.45:0/3720394899 wait complete. 2023-11-18T19:15:14.301 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-18T19:15:14.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:15:14.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-18T19:15:14.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[95384]: fuse finished with error 0 and tester_r 0 2023-11-18T19:15:14.404 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:15:20.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:15:20.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:15:20.506 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-18T19:15:20.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:15:20.565 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-18T19:15:20.619 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-18T19:15:20.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:15:20.621 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-18T19:15:20.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:15:20.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-18T19:15:20.846 DEBUG:teuthology.parallel:result is None 2023-11-18T19:15:40.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:15:40.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:15:40.623 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-11-18T19:15:40.621+0000 7ff9bcddb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 91790) UID: 0 2023-11-18T19:15:40.623 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-11-18T19:15:40.621+0000 7fcb7b29f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 91790) UID: 0 2023-11-18T19:17:46.282 INFO:tasks.workunit.client.1.smithi135.stderr:+ cd linux-5.4 2023-11-18T19:17:46.283 INFO:tasks.workunit.client.1.smithi135.stderr:+ make defconfig 2023-11-18T19:17:47.268 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/basic/fixdep 2023-11-18T19:17:47.696 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kconfig/conf.o 2023-11-18T19:17:47.962 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kconfig/confdata.o 2023-11-18T19:17:49.085 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kconfig/expr.o 2023-11-18T19:18:03.856 INFO:tasks.workunit.client.1.smithi135.stdout: LEX scripts/kconfig/lexer.lex.c 2023-11-18T19:18:03.905 INFO:tasks.workunit.client.1.smithi135.stdout: YACC scripts/kconfig/parser.tab.[ch] 2023-11-18T19:18:04.282 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kconfig/lexer.lex.o 2023-11-18T19:18:04.632 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kconfig/parser.tab.o 2023-11-18T19:18:05.115 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kconfig/preprocess.o 2023-11-18T19:18:05.302 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kconfig/symbol.o 2023-11-18T19:18:05.692 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTLD scripts/kconfig/conf 2023-11-18T19:18:05.739 INFO:tasks.workunit.client.1.smithi135.stdout:*** Default configuration is based on 'x86_64_defconfig' 2023-11-18T19:18:12.100 INFO:tasks.workunit.client.1.smithi135.stdout:# 2023-11-18T19:18:12.100 INFO:tasks.workunit.client.1.smithi135.stdout:# configuration written to .config 2023-11-18T19:18:12.100 INFO:tasks.workunit.client.1.smithi135.stdout:# 2023-11-18T19:18:12.108 INFO:tasks.workunit.client.1.smithi135.stderr:++ grep -c processor /proc/cpuinfo 2023-11-18T19:18:12.114 INFO:tasks.workunit.client.1.smithi135.stderr:+ make -j8 2023-11-18T19:18:14.734 INFO:tasks.workunit.client.1.smithi135.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_32.h 2023-11-18T19:18:14.734 INFO:tasks.workunit.client.1.smithi135.stdout: SYSHDR arch/x86/include/generated/asm/unistd_32_ia32.h 2023-11-18T19:18:14.736 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/bpf_perf_event.h 2023-11-18T19:18:14.740 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/errno.h 2023-11-18T19:18:14.743 INFO:tasks.workunit.client.1.smithi135.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_64.h 2023-11-18T19:18:14.747 INFO:tasks.workunit.client.1.smithi135.stdout: SYSHDR arch/x86/include/generated/asm/unistd_64_x32.h 2023-11-18T19:18:14.747 INFO:tasks.workunit.client.1.smithi135.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_32.h 2023-11-18T19:18:14.747 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/fcntl.h 2023-11-18T19:18:14.749 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctl.h 2023-11-18T19:18:14.753 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctls.h 2023-11-18T19:18:14.756 INFO:tasks.workunit.client.1.smithi135.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_64.h 2023-11-18T19:18:14.760 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/ipcbuf.h 2023-11-18T19:18:14.763 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC arch/x86/tools/relocs_32.o 2023-11-18T19:18:14.768 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/param.h 2023-11-18T19:18:14.776 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/poll.h 2023-11-18T19:18:14.783 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/resource.h 2023-11-18T19:18:14.792 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/socket.h 2023-11-18T19:18:14.799 INFO:tasks.workunit.client.1.smithi135.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_x32.h 2023-11-18T19:18:14.802 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/sockios.h 2023-11-18T19:18:14.808 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/termbits.h 2023-11-18T19:18:14.814 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/termios.h 2023-11-18T19:18:14.819 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/uapi/asm/types.h 2023-11-18T19:18:14.853 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC arch/x86/tools/relocs_common.o 2023-11-18T19:18:14.855 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC arch/x86/tools/relocs_64.o 2023-11-18T19:18:14.937 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/asm/dma-contiguous.h 2023-11-18T19:18:14.944 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/asm/early_ioremap.h 2023-11-18T19:18:14.949 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/asm/export.h 2023-11-18T19:18:14.954 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/asm/mcs_spinlock.h 2023-11-18T19:18:14.960 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/asm/mm-arch-hooks.h 2023-11-18T19:18:14.960 INFO:tasks.workunit.client.1.smithi135.stdout: UPD include/config/kernel.release 2023-11-18T19:18:14.964 INFO:tasks.workunit.client.1.smithi135.stdout: WRAP arch/x86/include/generated/asm/mmiowb.h 2023-11-18T19:18:14.981 INFO:tasks.workunit.client.1.smithi135.stdout: UPD include/generated/uapi/linux/version.h 2023-11-18T19:18:15.045 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/kallsyms 2023-11-18T19:18:15.049 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/pnmtologo 2023-11-18T19:18:15.071 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/selinux/genheaders/genheaders 2023-11-18T19:18:15.103 INFO:tasks.workunit.client.1.smithi135.stdout: UPD include/generated/utsrelease.h 2023-11-18T19:18:15.225 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTLD arch/x86/tools/relocs 2023-11-18T19:18:15.255 INFO:tasks.workunit.client.1.smithi135.stdout: DESCEND objtool 2023-11-18T19:18:15.281 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/conmakehash 2023-11-18T19:18:15.317 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/selinux/mdp/mdp 2023-11-18T19:18:15.411 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/sortextable 2023-11-18T19:18:15.436 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/asn1_compiler 2023-11-18T19:18:15.628 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/fixdep.o 2023-11-18T19:18:15.779 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTLD /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/fixdep-in.o 2023-11-18T19:18:15.789 INFO:tasks.workunit.client.1.smithi135.stdout: LINK /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/fixdep 2023-11-18T19:18:16.014 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/extract-cert 2023-11-18T19:18:16.563 INFO:tasks.workunit.client.1.smithi135.stdout: MKDIR /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/arch/x86/lib/ 2023-11-18T19:18:16.575 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/exec-cmd.o 2023-11-18T19:18:16.588 INFO:tasks.workunit.client.1.smithi135.stdout: GEN /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/arch/x86/lib/inat-tables.c 2023-11-18T19:18:16.592 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/builtin-check.o 2023-11-18T19:18:16.599 INFO:tasks.workunit.client.1.smithi135.stderr:awk: ../arch/x86/tools/gen-insn-attr-x86.awk:260: warning: regexp escape sequence `\:' is not a known regexp operator 2023-11-18T19:18:16.600 INFO:tasks.workunit.client.1.smithi135.stderr:awk: ../arch/x86/tools/gen-insn-attr-x86.awk:350: (FILENAME=../arch/x86/lib/x86-opcode-map.txt FNR=41) warning: regexp escape sequence `\&' is not a known regexp operator 2023-11-18T19:18:16.645 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/arch/x86/decode.o 2023-11-18T19:18:16.976 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c: In function ‘display_openssl_errors’: 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c:46:9: warning: ‘ERR_get_error_line’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations] 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr: 46 | while ((e = ERR_get_error_line(&file, &line))) { 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~ 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from scripts/extract-cert.c:23: 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr:/usr/include/openssl/err.h:423:15: note: declared here 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr: 423 | unsigned long ERR_get_error_line(const char **file, int *line); 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c: In function ‘drain_openssl_errors’: 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c:59:9: warning: ‘ERR_get_error_line’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations] 2023-11-18T19:18:16.977 INFO:tasks.workunit.client.1.smithi135.stderr: 59 | while (ERR_get_error_line(&file, &line)) {} 2023-11-18T19:18:16.978 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~ 2023-11-18T19:18:16.978 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from scripts/extract-cert.c:23: 2023-11-18T19:18:16.978 INFO:tasks.workunit.client.1.smithi135.stderr:/usr/include/openssl/err.h:423:15: note: declared here 2023-11-18T19:18:16.978 INFO:tasks.workunit.client.1.smithi135.stderr: 423 | unsigned long ERR_get_error_line(const char **file, int *line); 2023-11-18T19:18:16.978 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:16.979 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c: In function ‘main’: 2023-11-18T19:18:16.979 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c:124:17: warning: ‘ENGINE_load_builtin_engines’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations] 2023-11-18T19:18:16.979 INFO:tasks.workunit.client.1.smithi135.stderr: 124 | ENGINE_load_builtin_engines(); 2023-11-18T19:18:16.979 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:16.979 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from scripts/extract-cert.c:24: 2023-11-18T19:18:16.979 INFO:tasks.workunit.client.1.smithi135.stderr:/usr/include/openssl/engine.h:358:28: note: declared here 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr: 358 | OSSL_DEPRECATEDIN_3_0 void ENGINE_load_builtin_engines(void); 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c:126:17: warning: ‘ENGINE_by_id’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations] 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr: 126 | e = ENGINE_by_id("pkcs11"); 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr: | ^ 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from scripts/extract-cert.c:24: 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr:/usr/include/openssl/engine.h:336:31: note: declared here 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr: 336 | OSSL_DEPRECATEDIN_3_0 ENGINE *ENGINE_by_id(const char *id); 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~ 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c:128:17: warning: ‘ENGINE_init’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations] 2023-11-18T19:18:16.980 INFO:tasks.workunit.client.1.smithi135.stderr: 128 | if (ENGINE_init(e)) 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~ 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from scripts/extract-cert.c:24: 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr:/usr/include/openssl/engine.h:620:27: note: declared here 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr: 620 | OSSL_DEPRECATEDIN_3_0 int ENGINE_init(ENGINE *e); 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c:133:25: warning: ‘ENGINE_ctrl_cmd_string’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations] 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr: 133 | ERR(!ENGINE_ctrl_cmd_string(e, "PIN", key_pass, 0), "Set PKCS#11 PIN"); 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~ 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from scripts/extract-cert.c:24: 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr:/usr/include/openssl/engine.h:479:5: note: declared here 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr: 479 | int ENGINE_ctrl_cmd_string(ENGINE *e, const char *cmd_name, const char *arg, 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:16.981 INFO:tasks.workunit.client.1.smithi135.stderr:scripts/extract-cert.c:134:17: warning: ‘ENGINE_ctrl_cmd’ is deprecated: Since OpenSSL 3.0 [-Wdeprecated-declarations] 2023-11-18T19:18:16.982 INFO:tasks.workunit.client.1.smithi135.stderr: 134 | ENGINE_ctrl_cmd(e, "LOAD_CERT_CTRL", 0, &parms, NULL, 1); 2023-11-18T19:18:16.982 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~ 2023-11-18T19:18:16.982 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from scripts/extract-cert.c:24: 2023-11-18T19:18:16.982 INFO:tasks.workunit.client.1.smithi135.stderr:/usr/include/openssl/engine.h:450:27: note: declared here 2023-11-18T19:18:16.982 INFO:tasks.workunit.client.1.smithi135.stderr: 450 | OSSL_DEPRECATEDIN_3_0 int ENGINE_ctrl_cmd(ENGINE *e, const char *cmd_name, 2023-11-18T19:18:16.982 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~ 2023-11-18T19:18:17.154 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/help.o 2023-11-18T19:18:17.228 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/builtin-orc.o 2023-11-18T19:18:17.271 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/check.o 2023-11-18T19:18:17.521 INFO:tasks.workunit.client.1.smithi135.stdout: LD /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/arch/x86/objtool-in.o 2023-11-18T19:18:17.556 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/pager.o 2023-11-18T19:18:17.622 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/orc_gen.o 2023-11-18T19:18:17.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/parse-options.o 2023-11-18T19:18:17.736 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/orc_dump.o 2023-11-18T19:18:18.042 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/run-command.o 2023-11-18T19:18:18.321 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/sigchain.o 2023-11-18T19:18:18.332 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/elf.o 2023-11-18T19:18:18.525 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/subcmd-config.o 2023-11-18T19:18:18.623 INFO:tasks.workunit.client.1.smithi135.stdout: LD /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/libsubcmd-in.o 2023-11-18T19:18:18.644 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/special.o 2023-11-18T19:18:18.683 INFO:tasks.workunit.client.1.smithi135.stdout: AR /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/libsubcmd.a 2023-11-18T19:18:18.876 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/objtool.o 2023-11-18T19:18:19.039 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/libstring.o 2023-11-18T19:18:19.152 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/libctype.o 2023-11-18T19:18:19.156 INFO:tasks.workunit.client.1.smithi135.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/str_error_r.o 2023-11-18T19:18:19.265 INFO:tasks.workunit.client.1.smithi135.stdout: LD /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/objtool-in.o 2023-11-18T19:18:19.548 INFO:tasks.workunit.client.1.smithi135.stdout: CC scripts/mod/empty.o 2023-11-18T19:18:19.636 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/mod/mk_elfconfig 2023-11-18T19:18:19.711 INFO:tasks.workunit.client.1.smithi135.stdout: CC scripts/mod/devicetable-offsets.s 2023-11-18T19:18:19.784 INFO:tasks.workunit.client.1.smithi135.stdout: MKELF scripts/mod/elfconfig.h 2023-11-18T19:18:19.795 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/mod/modpost.o 2023-11-18T19:18:19.807 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/mod/sumversion.o 2023-11-18T19:18:19.963 INFO:tasks.workunit.client.1.smithi135.stdout: UPD scripts/mod/devicetable-offsets.h 2023-11-18T19:18:19.977 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC scripts/mod/file2alias.o 2023-11-18T19:18:20.253 INFO:tasks.workunit.client.1.smithi135.stdout:/home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool 2023-11-18T19:18:20.259 INFO:tasks.workunit.client.1.smithi135.stdout: LINK /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-5.4/tools/objtool/objtool 2023-11-18T19:18:20.668 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTLD scripts/mod/modpost 2023-11-18T19:18:20.786 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/bounds.s 2023-11-18T19:18:20.800 INFO:tasks.workunit.client.1.smithi135.stdout: CALL scripts/atomic/check-atomics.sh 2023-11-18T19:18:20.810 INFO:tasks.workunit.client.1.smithi135.stdout: UPD include/generated/timeconst.h 2023-11-18T19:18:22.406 INFO:tasks.workunit.client.1.smithi135.stdout: UPD include/generated/bounds.h 2023-11-18T19:18:22.441 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/asm-offsets.s 2023-11-18T19:18:23.527 INFO:tasks.workunit.client.1.smithi135.stdout: UPD include/generated/asm-offsets.h 2023-11-18T19:18:23.537 INFO:tasks.workunit.client.1.smithi135.stdout: CALL scripts/checksyscalls.sh 2023-11-18T19:18:23.656 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/main.o 2023-11-18T19:18:23.659 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/do_mounts.o 2023-11-18T19:18:23.661 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/do_mounts_initrd.o 2023-11-18T19:18:23.663 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/initramfs.o 2023-11-18T19:18:23.664 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC usr/gen_init_cpio 2023-11-18T19:18:23.665 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/do_mounts_md.o 2023-11-18T19:18:23.668 INFO:tasks.workunit.client.1.smithi135.stdout: CHK include/generated/compile.h 2023-11-18T19:18:23.764 INFO:tasks.workunit.client.1.smithi135.stdout: UPD include/generated/compile.h 2023-11-18T19:18:23.873 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/crypto/built-in.a 2023-11-18T19:18:23.977 INFO:tasks.workunit.client.1.smithi135.stdout: GEN usr/initramfs_data.cpio 2023-11-18T19:18:24.079 INFO:tasks.workunit.client.1.smithi135.stdout: AS usr/initramfs_data.o 2023-11-18T19:18:24.089 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/bpf/core.o 2023-11-18T19:18:24.117 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vdso/vma.o 2023-11-18T19:18:24.194 INFO:tasks.workunit.client.1.smithi135.stdout: AR usr/built-in.a 2023-11-18T19:18:24.267 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vsyscall/vsyscall_64.o 2023-11-18T19:18:24.392 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vdso/vdso32-setup.o 2023-11-18T19:18:24.461 INFO:tasks.workunit.client.1.smithi135.stdout: LDS arch/x86/entry/vdso/vdso.lds 2023-11-18T19:18:24.516 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/vdso/vdso-note.o 2023-11-18T19:18:24.603 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/calibrate.o 2023-11-18T19:18:24.630 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/amd/core.o 2023-11-18T19:18:24.704 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/core.o 2023-11-18T19:18:24.849 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vdso/vclock_gettime.o 2023-11-18T19:18:24.995 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/bts.o 2023-11-18T19:18:25.036 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/core.o 2023-11-18T19:18:25.062 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/vsyscall/vsyscall_emu_64.o 2023-11-18T19:18:25.127 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/init_task.o 2023-11-18T19:18:25.172 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/entry/vsyscall/built-in.a 2023-11-18T19:18:25.281 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/ia32/sys_ia32.o 2023-11-18T19:18:25.305 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vdso/vgetcpu.o 2023-11-18T19:18:25.473 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/amd/uncore.o 2023-11-18T19:18:25.545 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC arch/x86/entry/vdso/vdso2c 2023-11-18T19:18:25.809 INFO:tasks.workunit.client.1.smithi135.stdout: CC init/version.o 2023-11-18T19:18:25.863 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/acpi/boot.o 2023-11-18T19:18:26.277 INFO:tasks.workunit.client.1.smithi135.stdout: LDS arch/x86/entry/vdso/vdso32/vdso32.lds 2023-11-18T19:18:26.398 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vdso/vdso32/vclock_gettime.o 2023-11-18T19:18:26.399 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/bpf/built-in.a 2023-11-18T19:18:26.434 INFO:tasks.workunit.client.1.smithi135.stdout: AR init/built-in.a 2023-11-18T19:18:26.467 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/ds.o 2023-11-18T19:18:26.468 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/amd/ibs.o 2023-11-18T19:18:26.478 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/ia32/ia32_signal.o 2023-11-18T19:18:26.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cgroup/cgroup.o 2023-11-18T19:18:26.497 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/acpi/sleep.o 2023-11-18T19:18:26.716 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/vdso/vdso32/note.o 2023-11-18T19:18:26.795 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cgroup/rstat.o 2023-11-18T19:18:26.906 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/vdso/vdso32/system_call.o 2023-11-18T19:18:26.987 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/vdso/vdso32/sigreturn.o 2023-11-18T19:18:27.076 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cgroup/namespace.o 2023-11-18T19:18:27.125 INFO:tasks.workunit.client.1.smithi135.stdout: VDSO arch/x86/entry/vdso/vdso64.so.dbg 2023-11-18T19:18:27.159 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/kernel/acpi/wakeup_64.o 2023-11-18T19:18:27.246 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/acpi/cppc_msr.o 2023-11-18T19:18:27.246 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/ia32/audit.o 2023-11-18T19:18:27.274 INFO:tasks.workunit.client.1.smithi135.stdout: VDSO arch/x86/entry/vdso/vdso32.so.dbg 2023-11-18T19:18:27.369 INFO:tasks.workunit.client.1.smithi135.stdout: OBJCOPY arch/x86/entry/vdso/vdso64.so 2023-11-18T19:18:27.376 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/ia32/built-in.a 2023-11-18T19:18:27.378 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/amd/iommu.o 2023-11-18T19:18:27.381 INFO:tasks.workunit.client.1.smithi135.stdout: OBJCOPY arch/x86/entry/vdso/vdso32.so 2023-11-18T19:18:27.394 INFO:tasks.workunit.client.1.smithi135.stdout: VDSO2C arch/x86/entry/vdso/vdso-image-64.c 2023-11-18T19:18:27.402 INFO:tasks.workunit.client.1.smithi135.stdout: VDSO2C arch/x86/entry/vdso/vdso-image-32.c 2023-11-18T19:18:27.420 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vdso/vdso-image-64.o 2023-11-18T19:18:27.504 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/apic.o 2023-11-18T19:18:27.504 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/acpi/cstate.o 2023-11-18T19:18:27.706 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/vdso/vdso-image-32.o 2023-11-18T19:18:27.792 INFO:tasks.workunit.client.1.smithi135.stdout: CC certs/system_keyring.o 2023-11-18T19:18:27.802 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/knc.o 2023-11-18T19:18:27.905 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/init.o 2023-11-18T19:18:27.964 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/entry/vdso/built-in.a 2023-11-18T19:18:28.024 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/entry_64.o 2023-11-18T19:18:28.152 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/acpi/built-in.a 2023-11-18T19:18:28.169 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/events/amd/built-in.a 2023-11-18T19:18:28.205 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/thunk_64.o 2023-11-18T19:18:28.242 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cgroup/cgroup-v1.o 2023-11-18T19:18:28.252 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/apic_common.o 2023-11-18T19:18:28.270 INFO:tasks.workunit.client.1.smithi135.stdout: EXTRACT_CERTS 2023-11-18T19:18:28.312 INFO:tasks.workunit.client.1.smithi135.stdout: AS certs/system_certificates.o 2023-11-18T19:18:28.409 INFO:tasks.workunit.client.1.smithi135.stdout: AR certs/built-in.a 2023-11-18T19:18:28.424 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/syscall_64.o 2023-11-18T19:18:28.480 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cgroup/freezer.o 2023-11-18T19:18:28.554 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/lbr.o 2023-11-18T19:18:28.697 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/dma/mapping.o 2023-11-18T19:18:28.772 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/common.o 2023-11-18T19:18:29.006 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/apic_noop.o 2023-11-18T19:18:29.014 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/init_64.o 2023-11-18T19:18:29.323 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/events/core.o 2023-11-18T19:18:29.332 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mce/core.o 2023-11-18T19:18:29.358 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/ipi.o 2023-11-18T19:18:29.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/dma/direct.o 2023-11-18T19:18:29.510 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/p4.o 2023-11-18T19:18:29.653 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cgroup/legacy_freezer.o 2023-11-18T19:18:29.766 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/vector.o 2023-11-18T19:18:29.778 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/entry/entry_64_compat.o 2023-11-18T19:18:29.972 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/entry/syscall_32.o 2023-11-18T19:18:30.229 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/dma/dummy.o 2023-11-18T19:18:30.284 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cgroup/cpuset.o 2023-11-18T19:18:30.289 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/fault.o 2023-11-18T19:18:30.339 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/entry/built-in.a 2023-11-18T19:18:30.403 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/p6.o 2023-11-18T19:18:30.449 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/microcode/core.o 2023-11-18T19:18:30.764 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/dma/swiotlb.o 2023-11-18T19:18:30.826 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mce/severity.o 2023-11-18T19:18:31.075 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/hw_nmi.o 2023-11-18T19:18:31.142 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/pt.o 2023-11-18T19:18:31.288 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/microcode/intel.o 2023-11-18T19:18:31.441 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mce/genpool.o 2023-11-18T19:18:31.595 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/ioremap.o 2023-11-18T19:18:31.670 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/io_apic.o 2023-11-18T19:18:31.754 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/dma/built-in.a 2023-11-18T19:18:31.871 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/filemap.o 2023-11-18T19:18:31.900 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/cgroup/built-in.a 2023-11-18T19:18:32.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/autofs/init.o 2023-11-18T19:18:32.078 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mce/intel.o 2023-11-18T19:18:32.162 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/microcode/amd.o 2023-11-18T19:18:32.242 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/rapl.o 2023-11-18T19:18:32.533 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/extable.o 2023-11-18T19:18:32.543 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/autofs/inode.o 2023-11-18T19:18:32.669 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mce/amd.o 2023-11-18T19:18:32.999 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/cpu/microcode/built-in.a 2023-11-18T19:18:33.070 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/uncore.o 2023-11-18T19:18:33.115 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/compat.o 2023-11-18T19:18:33.136 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/msi.o 2023-11-18T19:18:33.234 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/autofs/root.o 2023-11-18T19:18:33.295 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/pageattr.o 2023-11-18T19:18:33.564 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/events/ring_buffer.o 2023-11-18T19:18:33.800 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/util.o 2023-11-18T19:18:33.860 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/apic_flat_64.o 2023-11-18T19:18:33.922 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mce/threshold.o 2023-11-18T19:18:33.997 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/autofs/symlink.o 2023-11-18T19:18:34.116 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mempool.o 2023-11-18T19:18:34.308 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/uncore_nhmex.o 2023-11-18T19:18:34.460 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/apic/probe_64.o 2023-11-18T19:18:34.492 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/autofs/waitq.o 2023-11-18T19:18:34.547 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/events/callchain.o 2023-11-18T19:18:34.671 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mce/therm_throt.o 2023-11-18T19:18:34.712 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/mmap.o 2023-11-18T19:18:34.749 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/msgutil.o 2023-11-18T19:18:34.780 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/apic/built-in.a 2023-11-18T19:18:34.914 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/pat.o 2023-11-18T19:18:34.978 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/oom_kill.o 2023-11-18T19:18:35.143 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/autofs/expire.o 2023-11-18T19:18:35.296 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/events/hw_breakpoint.o 2023-11-18T19:18:35.327 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/uncore_snb.o 2023-11-18T19:18:35.348 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/msg.o 2023-11-18T19:18:35.366 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/debugfs/inode.o 2023-11-18T19:18:35.628 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/cpu/mce/built-in.a 2023-11-18T19:18:35.715 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mtrr/mtrr.o 2023-11-18T19:18:35.761 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/autofs/dev-ioctl.o 2023-11-18T19:18:35.813 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/pgtable.o 2023-11-18T19:18:36.128 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/uncore_snbep.o 2023-11-18T19:18:36.130 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/events/uprobes.o 2023-11-18T19:18:36.283 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/debugfs/file.o 2023-11-18T19:18:36.393 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/fadvise.o 2023-11-18T19:18:36.401 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/sem.o 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/mm/pgtable.c: In function ‘pgd_alloc’: 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/mm/pgtable.c:430:13: warning: ‘preallocate_pmds.constprop’ accessing 8 bytes in a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr: 430 | if (preallocate_pmds(mm, pmds, PREALLOCATED_PMDS) != 0) 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/mm/pgtable.c:430:13: note: referencing argument 2 of type ‘pmd_t **’ 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/mm/pgtable.c:218:12: note: in a call to function ‘preallocate_pmds.constprop’ 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr: 218 | static int preallocate_pmds(struct mm_struct *mm, pmd_t *pmds[], int count) 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/mm/pgtable.c:433:13: warning: ‘preallocate_pmds.constprop’ accessing 8 bytes in a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:18:36.474 INFO:tasks.workunit.client.1.smithi135.stderr: 433 | if (preallocate_pmds(mm, u_pmds, PREALLOCATED_USER_PMDS) != 0) 2023-11-18T19:18:36.475 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:36.475 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/mm/pgtable.c:433:13: note: referencing argument 2 of type ‘pmd_t **’ 2023-11-18T19:18:36.475 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/mm/pgtable.c:218:12: note: in a call to function ‘preallocate_pmds.constprop’ 2023-11-18T19:18:36.475 INFO:tasks.workunit.client.1.smithi135.stderr: 218 | static int preallocate_pmds(struct mm_struct *mm, pmd_t *pmds[], int count) 2023-11-18T19:18:36.475 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:18:36.544 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mtrr/if.o 2023-11-18T19:18:36.589 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/autofs/built-in.a 2023-11-18T19:18:36.683 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/physaddr.o 2023-11-18T19:18:36.730 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/fpu/init.o 2023-11-18T19:18:37.151 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/maccess.o 2023-11-18T19:18:37.226 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/setup_nx.o 2023-11-18T19:18:37.234 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mtrr/generic.o 2023-11-18T19:18:37.272 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/debugfs/built-in.a 2023-11-18T19:18:37.421 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/devpts/inode.o 2023-11-18T19:18:37.923 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/events/built-in.a 2023-11-18T19:18:38.046 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/intel/cstate.o 2023-11-18T19:18:38.051 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/fpu/bugs.o 2023-11-18T19:18:38.054 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/tlb.o 2023-11-18T19:18:38.432 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/page-writeback.o 2023-11-18T19:18:38.480 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/mtrr/cleanup.o 2023-11-18T19:18:38.491 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/shm.o 2023-11-18T19:18:38.530 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/irqdesc.o 2023-11-18T19:18:38.673 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/devpts/built-in.a 2023-11-18T19:18:38.699 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/fpu/core.o 2023-11-18T19:18:38.756 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] fs/efivarfs/inode.o 2023-11-18T19:18:38.961 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/events/intel/built-in.a 2023-11-18T19:18:39.040 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/probe.o 2023-11-18T19:18:39.259 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/cpu_entry_area.o 2023-11-18T19:18:39.311 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/cpu/mtrr/built-in.a 2023-11-18T19:18:39.506 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/handle.o 2023-11-18T19:18:39.532 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/cacheinfo.o 2023-11-18T19:18:39.563 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] fs/efivarfs/file.o 2023-11-18T19:18:39.637 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/events/msr.o 2023-11-18T19:18:39.864 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/syscall.o 2023-11-18T19:18:39.870 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/fpu/regset.o 2023-11-18T19:18:39.995 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/pat_rbtree.o 2023-11-18T19:18:40.092 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/manage.o 2023-11-18T19:18:40.141 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] fs/efivarfs/super.o 2023-11-18T19:18:40.278 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/readahead.o 2023-11-18T19:18:40.363 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/events/built-in.a 2023-11-18T19:18:40.490 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/scattered.o 2023-11-18T19:18:40.508 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/integrity/iint.o 2023-11-18T19:18:40.589 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/ipc_sysctl.o 2023-11-18T19:18:40.610 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/fpu/signal.o 2023-11-18T19:18:40.658 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/hugetlbpage.o 2023-11-18T19:18:40.861 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] fs/efivarfs/efivarfs.o 2023-11-18T19:18:40.903 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/exportfs/expfs.o 2023-11-18T19:18:41.018 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/topology.o 2023-11-18T19:18:41.170 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/integrity/integrity_audit.o 2023-11-18T19:18:41.200 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/swap.o 2023-11-18T19:18:41.226 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/mqueue.o 2023-11-18T19:18:41.330 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/spurious.o 2023-11-18T19:18:41.479 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/common.o 2023-11-18T19:18:41.516 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/numa.o 2023-11-18T19:18:41.520 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/fpu/xstate.o 2023-11-18T19:18:41.617 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/exportfs/built-in.a 2023-11-18T19:18:41.726 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/balloc.o 2023-11-18T19:18:41.741 INFO:tasks.workunit.client.1.smithi135.stdout: AR security/integrity/built-in.a 2023-11-18T19:18:41.820 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/gc.o 2023-11-18T19:18:41.909 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/resend.o 2023-11-18T19:18:42.394 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/chip.o 2023-11-18T19:18:42.489 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/numa_64.o 2023-11-18T19:18:42.497 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/key.o 2023-11-18T19:18:42.540 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/fpu/built-in.a 2023-11-18T19:18:42.614 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/livepatch/built-in.a 2023-11-18T19:18:42.732 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/truncate.o 2023-11-18T19:18:42.740 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/rdrand.o 2023-11-18T19:18:42.795 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/namespace.o 2023-11-18T19:18:42.890 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/asymmetric_type.o 2023-11-18T19:18:42.992 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/match.o 2023-11-18T19:18:42.997 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/amdtopology.o 2023-11-18T19:18:43.270 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/bitmap.o 2023-11-18T19:18:43.357 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/dummychip.o 2023-11-18T19:18:43.371 INFO:tasks.workunit.client.1.smithi135.stdout: CC ipc/mq_sysctl.o 2023-11-18T19:18:43.411 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/keyring.o 2023-11-18T19:18:43.463 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/bugs.o 2023-11-18T19:18:43.601 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/restrict.o 2023-11-18T19:18:43.666 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/vmscan.o 2023-11-18T19:18:43.873 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/srat.o 2023-11-18T19:18:43.944 INFO:tasks.workunit.client.1.smithi135.stdout: AR ipc/built-in.a 2023-11-18T19:18:44.016 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/pkeys.o 2023-11-18T19:18:44.132 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/devres.o 2023-11-18T19:18:44.137 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/signature.o 2023-11-18T19:18:44.296 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/block_validity.o 2023-11-18T19:18:44.610 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/aperfmperf.o 2023-11-18T19:18:44.612 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/keyctl.o 2023-11-18T19:18:44.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/autoprobe.o 2023-11-18T19:18:44.625 INFO:tasks.workunit.client.1.smithi135.stdout: ASN.1 crypto/asymmetric_keys/x509.asn1.[ch] 2023-11-18T19:18:44.626 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/public_key.o 2023-11-18T19:18:44.645 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/irqdomain.o 2023-11-18T19:18:45.160 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/cpuid-deps.o 2023-11-18T19:18:45.163 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/kaslr.o 2023-11-18T19:18:45.483 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/dir.o 2023-11-18T19:18:45.486 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/proc.o 2023-11-18T19:18:45.609 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/umwait.o 2023-11-18T19:18:45.610 INFO:tasks.workunit.client.1.smithi135.stdout: ASN.1 crypto/asymmetric_keys/x509_akid.asn1.[ch] 2023-11-18T19:18:45.618 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/x509_public_key.o 2023-11-18T19:18:45.628 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/migration.o 2023-11-18T19:18:45.838 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/mm/pti.o 2023-11-18T19:18:45.855 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/permission.o 2023-11-18T19:18:45.857 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/shmem.o 2023-11-18T19:18:47.223 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/util.o 2023-11-18T19:18:47.937 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/proc.o 2023-11-18T19:18:47.953 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/mm/built-in.a 2023-11-18T19:18:47.967 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/cpuhotplug.o 2023-11-18T19:18:47.969 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/process_keys.o 2023-11-18T19:18:47.995 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mmzone.o 2023-11-18T19:18:48.009 INFO:tasks.workunit.client.1.smithi135.stdout: ASN.1 crypto/asymmetric_keys/pkcs7.asn1.[ch] 2023-11-18T19:18:48.017 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/ext4_jbd2.o 2023-11-18T19:18:48.026 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/pkcs7_trust.o 2023-11-18T19:18:48.047 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/cache.o 2023-11-18T19:18:48.058 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/dir.o 2023-11-18T19:18:48.435 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/pkcs7_verify.o 2023-11-18T19:18:48.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/pm.o 2023-11-18T19:18:48.488 INFO:tasks.workunit.client.1.smithi135.stdout: MKCAP arch/x86/kernel/cpu/capflags.c 2023-11-18T19:18:48.559 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/vmstat.o 2023-11-18T19:18:48.713 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/net/built-in.a 2023-11-18T19:18:48.774 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/kprobes/core.o 2023-11-18T19:18:48.881 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/request_key.o 2023-11-18T19:18:48.994 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/x509.asn1.o 2023-11-18T19:18:49.116 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/x509_akid.asn1.o 2023-11-18T19:18:49.217 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/msi.o 2023-11-18T19:18:49.233 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/x509_cert_parser.o 2023-11-18T19:18:49.263 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/fatent.o 2023-11-18T19:18:49.287 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/extents.o 2023-11-18T19:18:49.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:18:49.418 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:18:49.665 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/kprobes/opt.o 2023-11-18T19:18:49.724 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/request_key_auth.o 2023-11-18T19:18:49.788 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/pkcs7.asn1.o 2023-11-18T19:18:49.874 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/affinity.o 2023-11-18T19:18:49.897 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/asymmetric_keys/pkcs7_parser.o 2023-11-18T19:18:49.908 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/backing-dev.o 2023-11-18T19:18:50.277 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/file.o 2023-11-18T19:18:50.334 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/user_defined.o 2023-11-18T19:18:50.427 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/kprobes/built-in.a 2023-11-18T19:18:50.431 INFO:tasks.workunit.client.1.smithi135.stdout: AR crypto/asymmetric_keys/built-in.a 2023-11-18T19:18:50.478 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq/matrix.o 2023-11-18T19:18:50.524 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/api.o 2023-11-18T19:18:50.530 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/extents_status.o 2023-11-18T19:18:50.993 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/compat.o 2023-11-18T19:18:51.155 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mm_init.o 2023-11-18T19:18:51.341 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/inode.o 2023-11-18T19:18:51.513 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/cipher.o 2023-11-18T19:18:51.652 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/irq/built-in.a 2023-11-18T19:18:51.740 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/mutex.o 2023-11-18T19:18:51.769 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mmu_context.o 2023-11-18T19:18:51.774 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/proc.o 2023-11-18T19:18:51.949 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from fs/ext4/extents.c:32: 2023-11-18T19:18:51.949 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/extents.c: In function ‘ext4_ext_map_blocks’: 2023-11-18T19:18:51.949 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/ext4_extents.h:226:15: warning: ‘zero_ex2.ee_start_lo’ may be used uninitialized [-Wmaybe-uninitialized] 2023-11-18T19:18:51.950 INFO:tasks.workunit.client.1.smithi135.stderr: 226 | block = le32_to_cpu(ex->ee_start_lo); 2023-11-18T19:18:51.951 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/extents.c:3539:38: note: ‘zero_ex2.ee_start_lo’ was declared here 2023-11-18T19:18:51.951 INFO:tasks.workunit.client.1.smithi135.stderr: 3539 | struct ext4_extent zero_ex1, zero_ex2; 2023-11-18T19:18:51.951 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~ 2023-11-18T19:18:51.952 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from fs/ext4/extents.c:32: 2023-11-18T19:18:51.952 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/ext4_extents.h:227:19: warning: ‘zero_ex2.ee_start_hi’ may be used uninitialized [-Wmaybe-uninitialized] 2023-11-18T19:18:51.952 INFO:tasks.workunit.client.1.smithi135.stderr: 227 | block |= ((ext4_fsblk_t) le16_to_cpu(ex->ee_start_hi) << 31) << 1; 2023-11-18T19:18:51.952 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/extents.c:3539:38: note: ‘zero_ex2.ee_start_hi’ was declared here 2023-11-18T19:18:51.952 INFO:tasks.workunit.client.1.smithi135.stderr: 3539 | struct ext4_extent zero_ex1, zero_ex2; 2023-11-18T19:18:51.952 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~ 2023-11-18T19:18:51.952 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from fs/ext4/extents.c:32: 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/ext4_extents.h:226:15: warning: ‘zero_ex1.ee_start_lo’ may be used uninitialized in this function [-Wmaybe-uninitialized] 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr: 226 | block = le32_to_cpu(ex->ee_start_lo); 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/extents.c:3539:28: note: ‘zero_ex1.ee_start_lo’ was declared here 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr: 3539 | struct ext4_extent zero_ex1, zero_ex2; 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~ 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from fs/ext4/extents.c:32: 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/ext4_extents.h:227:19: warning: ‘zero_ex1.ee_start_hi’ may be used uninitialized in this function [-Wmaybe-uninitialized] 2023-11-18T19:18:51.953 INFO:tasks.workunit.client.1.smithi135.stderr: 227 | block |= ((ext4_fsblk_t) le16_to_cpu(ex->ee_start_hi) << 31) << 1; 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/extents.c:3539:28: note: ‘zero_ex1.ee_start_hi’ was declared here 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: 3539 | struct ext4_extent zero_ex1, zero_ex2; 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~ 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/extents.c:3258:16: warning: ‘zero_ex1.ee_block’ may be used uninitialized in this function [-Wmaybe-uninitialized] 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: 3258 | return ext4_es_insert_extent(inode, ee_block, ee_len, ee_pblock, 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: 3259 | EXTENT_STATUS_WRITTEN); 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr:fs/ext4/extents.c:3539:28: note: ‘zero_ex1.ee_block’ was declared here 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: 3539 | struct ext4_extent zero_ex1, zero_ex2; 2023-11-18T19:18:51.954 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~ 2023-11-18T19:18:52.231 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/compress.o 2023-11-18T19:18:52.376 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/sysctl.o 2023-11-18T19:18:52.379 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/partitions/check.o 2023-11-18T19:18:52.399 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/percpu.o 2023-11-18T19:18:52.467 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/semaphore.o 2023-11-18T19:18:52.589 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/misc.o 2023-11-18T19:18:52.613 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/file.o 2023-11-18T19:18:53.041 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/memneq.o 2023-11-18T19:18:53.369 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/keys/keyctl_pkey.o 2023-11-18T19:18:53.452 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/partitions/msdos.o 2023-11-18T19:18:53.528 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/rwsem.o 2023-11-18T19:18:53.739 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/fsmap.o 2023-11-18T19:18:53.811 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/nfs.o 2023-11-18T19:18:53.827 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/algapi.o 2023-11-18T19:18:54.044 INFO:tasks.workunit.client.1.smithi135.stdout: AR security/keys/built-in.a 2023-11-18T19:18:54.367 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/partitions/efi.o 2023-11-18T19:18:54.370 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/percpu-rwsem.o 2023-11-18T19:18:54.395 INFO:tasks.workunit.client.1.smithi135.stdout: GEN security/selinux/flask.h security/selinux/av_permissions.h 2023-11-18T19:18:54.437 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/avc.o 2023-11-18T19:18:54.504 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/namei_vfat.o 2023-11-18T19:18:54.682 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/slab_common.o 2023-11-18T19:18:54.784 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/spinlock.o 2023-11-18T19:18:55.157 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/scatterwalk.o 2023-11-18T19:18:55.205 INFO:tasks.workunit.client.1.smithi135.stdout: AR block/partitions/built-in.a 2023-11-18T19:18:55.277 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/fsync.o 2023-11-18T19:18:55.369 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/bio.o 2023-11-18T19:18:55.377 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/osq_lock.o 2023-11-18T19:18:55.564 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fat/namei_msdos.o 2023-11-18T19:18:55.758 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/qspinlock.o 2023-11-18T19:18:55.952 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/proc.o 2023-11-18T19:18:56.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/hooks.o 2023-11-18T19:18:56.127 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/rtmutex.o 2023-11-18T19:18:56.166 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/compaction.o 2023-11-18T19:18:56.364 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/fat/built-in.a 2023-11-18T19:18:56.438 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/elevator.o 2023-11-18T19:18:56.488 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/hash.o 2023-11-18T19:18:56.627 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/aead.o 2023-11-18T19:18:56.838 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/locking/qrwlock.o 2023-11-18T19:18:57.002 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/powerflags.o 2023-11-18T19:18:57.201 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/locking/built-in.a 2023-11-18T19:18:57.254 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/atom/built-in.a 2023-11-18T19:18:57.262 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/ialloc.o 2023-11-18T19:18:57.303 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/qos.o 2023-11-18T19:18:57.306 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/ce4100/built-in.a 2023-11-18T19:18:57.359 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/platform/efi/quirks.o 2023-11-18T19:18:57.546 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-core.o 2023-11-18T19:18:57.631 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/ablkcipher.o 2023-11-18T19:18:58.139 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/vmacache.o 2023-11-18T19:18:58.302 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/platform/efi/efi.o 2023-11-18T19:18:58.374 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/main.o 2023-11-18T19:18:58.478 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/blkcipher.o 2023-11-18T19:18:58.714 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/interval_tree.o 2023-11-18T19:18:59.013 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/indirect.o 2023-11-18T19:18:59.224 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/selinuxfs.o 2023-11-18T19:18:59.291 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/console.o 2023-11-18T19:18:59.331 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/platform/efi/efi_64.o 2023-11-18T19:18:59.373 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/skcipher.o 2023-11-18T19:18:59.536 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-sysfs.o 2023-11-18T19:18:59.540 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/list_lru.o 2023-11-18T19:19:00.023 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/process.o 2023-11-18T19:19:00.328 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/workingset.o 2023-11-18T19:19:00.464 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/intel.o 2023-11-18T19:19:00.503 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-flush.o 2023-11-18T19:19:00.553 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/platform/efi/efi_stub_64.o 2023-11-18T19:19:00.564 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/inline.o 2023-11-18T19:19:00.568 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/seqiv.o 2023-11-18T19:19:00.633 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/platform/efi/efi_thunk_64.o 2023-11-18T19:19:00.729 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/efi/built-in.a 2023-11-18T19:19:00.865 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/netlink.o 2023-11-18T19:19:00.883 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/geode/built-in.a 2023-11-18T19:19:00.988 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/goldfish/built-in.a 2023-11-18T19:19:01.125 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/suspend.o 2023-11-18T19:19:01.217 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/platform/intel/iosf_mbi.o 2023-11-18T19:19:01.449 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/debug.o 2023-11-18T19:19:01.747 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/intel_pconfig.o 2023-11-18T19:19:01.806 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-settings.o 2023-11-18T19:19:01.914 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/echainiv.o 2023-11-18T19:19:02.009 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/tsx.o 2023-11-18T19:19:02.099 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/nlmsgtab.o 2023-11-18T19:19:02.280 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/intel_epb.o 2023-11-18T19:19:02.330 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/intel/built-in.a 2023-11-18T19:19:02.400 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/intel-mid/built-in.a 2023-11-18T19:19:02.418 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/gup.o 2023-11-18T19:19:02.445 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/intel-quark/built-in.a 2023-11-18T19:19:02.469 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/inode.o 2023-11-18T19:19:02.490 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/iris/built-in.a 2023-11-18T19:19:02.550 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/olpc/built-in.a 2023-11-18T19:19:02.578 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/hibernate.o 2023-11-18T19:19:02.592 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/scx200/built-in.a 2023-11-18T19:19:02.647 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/sfi/built-in.a 2023-11-18T19:19:02.648 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/ahash.o 2023-11-18T19:19:02.690 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/ts5500/built-in.a 2023-11-18T19:19:02.737 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/uv/built-in.a 2023-11-18T19:19:02.743 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-ioc.o 2023-11-18T19:19:02.759 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/amd.o 2023-11-18T19:19:02.769 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/platform/built-in.a 2023-11-18T19:19:02.893 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-map.o 2023-11-18T19:19:03.082 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/netif.o 2023-11-18T19:19:03.496 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/highmem.o 2023-11-18T19:19:03.565 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/shash.o 2023-11-18T19:19:03.580 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/hygon.o 2023-11-18T19:19:03.621 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-exec.o 2023-11-18T19:19:03.661 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/snapshot.o 2023-11-18T19:19:03.797 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/hugetlbfs/inode.o 2023-11-18T19:19:04.121 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/centaur.o 2023-11-18T19:19:04.136 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/memory.o 2023-11-18T19:19:04.200 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/netnode.o 2023-11-18T19:19:04.305 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-merge.o 2023-11-18T19:19:04.518 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/akcipher.o 2023-11-18T19:19:04.658 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/zhaoxin.o 2023-11-18T19:19:04.931 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/hugetlbfs/built-in.a 2023-11-18T19:19:05.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/swap.o 2023-11-18T19:19:05.011 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/perfctr-watchdog.o 2023-11-18T19:19:05.074 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/netport.o 2023-11-18T19:19:05.255 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/kpp.o 2023-11-18T19:19:05.333 INFO:tasks.workunit.client.1.smithi135.stdout: ASN.1 crypto/rsapubkey.asn1.[ch] 2023-11-18T19:19:05.351 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/ioctl.o 2023-11-18T19:19:05.442 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-softirq.o 2023-11-18T19:19:05.671 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpu/capflags.o 2023-11-18T19:19:05.784 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/cpu/built-in.a 2023-11-18T19:19:05.910 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/process_64.o 2023-11-18T19:19:05.945 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/iomap/apply.o 2023-11-18T19:19:05.987 INFO:tasks.workunit.client.1.smithi135.stdout: ASN.1 crypto/rsaprivkey.asn1.[ch] 2023-11-18T19:19:06.005 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/rsa.o 2023-11-18T19:19:06.149 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-timeout.o 2023-11-18T19:19:06.199 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/user.o 2023-11-18T19:19:06.206 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ibpkey.o 2023-11-18T19:19:06.559 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mincore.o 2023-11-18T19:19:06.583 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/iomap/buffered-io.o 2023-11-18T19:19:06.711 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/rsa_helper.o 2023-11-18T19:19:06.785 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-lib.o 2023-11-18T19:19:06.913 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/rsa-pkcs1pad.o 2023-11-18T19:19:06.941 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/mballoc.o 2023-11-18T19:19:06.970 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/signal.o 2023-11-18T19:19:07.003 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/power/poweroff.o 2023-11-18T19:19:07.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/ebitmap.o 2023-11-18T19:19:07.333 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/power/built-in.a 2023-11-18T19:19:07.454 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mlock.o 2023-11-18T19:19:07.463 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/printk/printk.o 2023-11-18T19:19:07.550 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-mq.o 2023-11-18T19:19:07.768 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/iomap/direct-io.o 2023-11-18T19:19:07.780 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/acompress.o 2023-11-18T19:19:07.955 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/signal_compat.o 2023-11-18T19:19:08.444 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/hashtab.o 2023-11-18T19:19:08.523 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mmap.o 2023-11-18T19:19:08.531 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/traps.o 2023-11-18T19:19:08.552 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/scompress.o 2023-11-18T19:19:08.635 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/iomap/fiemap.o 2023-11-18T19:19:08.910 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/symtab.o 2023-11-18T19:19:09.084 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/sidtab.o 2023-11-18T19:19:09.108 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/printk/printk_safe.o 2023-11-18T19:19:09.309 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/iomap/seek.o 2023-11-18T19:19:09.357 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/algboss.o 2023-11-18T19:19:09.441 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/idt.o 2023-11-18T19:19:09.531 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/printk/built-in.a 2023-11-18T19:19:09.677 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/rcu/update.o 2023-11-18T19:19:09.728 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-mq-tag.o 2023-11-18T19:19:09.954 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/migrate.o 2023-11-18T19:19:10.028 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/iomap/swapfile.o 2023-11-18T19:19:10.110 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/irq.o 2023-11-18T19:19:10.266 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/testmgr.o 2023-11-18T19:19:10.297 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/avtab.o 2023-11-18T19:19:10.385 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mmu_gather.o 2023-11-18T19:19:10.568 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-stat.o 2023-11-18T19:19:10.745 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/iomap/built-in.a 2023-11-18T19:19:10.826 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/commoncap.o 2023-11-18T19:19:10.855 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/mmp.o 2023-11-18T19:19:10.941 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/cmac.o 2023-11-18T19:19:11.080 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/rcu/sync.o 2023-11-18T19:19:11.148 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mprotect.o 2023-11-18T19:19:11.348 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-mq-sysfs.o 2023-11-18T19:19:11.378 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/irq_64.o 2023-11-18T19:19:11.456 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/policydb.o 2023-11-18T19:19:11.483 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/rcu/srcutree.o 2023-11-18T19:19:11.653 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/hmac.o 2023-11-18T19:19:11.695 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/move_extent.o 2023-11-18T19:19:11.971 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/dumpstack_64.o 2023-11-18T19:19:12.002 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/core.o 2023-11-18T19:19:12.127 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-mq-cpumap.o 2023-11-18T19:19:12.199 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mremap.o 2023-11-18T19:19:12.375 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/rcu/tree.o 2023-11-18T19:19:12.402 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/crypto_null.o 2023-11-18T19:19:12.631 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/time.o 2023-11-18T19:19:12.656 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/namei.o 2023-11-18T19:19:12.763 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-mq-sched.o 2023-11-18T19:19:13.083 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/ioport.o 2023-11-18T19:19:13.103 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/md5.o 2023-11-18T19:19:13.230 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/msync.o 2023-11-18T19:19:13.469 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/services.o 2023-11-18T19:19:13.711 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/ioctl.o 2023-11-18T19:19:13.821 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/dumpstack.o 2023-11-18T19:19:13.886 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/sha1_generic.o 2023-11-18T19:19:13.942 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/page_vma_mapped.o 2023-11-18T19:19:14.586 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/sha256_generic.o 2023-11-18T19:19:14.588 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/nmi.o 2023-11-18T19:19:14.601 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/genhd.o 2023-11-18T19:19:14.717 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/pagewalk.o 2023-11-18T19:19:14.763 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/rcu/rcu_segcblist.o 2023-11-18T19:19:15.147 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/page-io.o 2023-11-18T19:19:15.217 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/rcu/built-in.a 2023-11-18T19:19:15.257 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/gf128mul.o 2023-11-18T19:19:15.284 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/ldt.o 2023-11-18T19:19:15.374 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/loadavg.o 2023-11-18T19:19:15.430 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/pgtable-generic.o 2023-11-18T19:19:15.462 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/partition-generic.o 2023-11-18T19:19:15.700 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/conditional.o 2023-11-18T19:19:15.866 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/cbc.o 2023-11-18T19:19:16.132 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/ctr.o 2023-11-18T19:19:16.364 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/rmap.o 2023-11-18T19:19:16.746 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/readpage.o 2023-11-18T19:19:16.782 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/setup.o 2023-11-18T19:19:16.849 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/ioprio.o 2023-11-18T19:19:16.897 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/clock.o 2023-11-18T19:19:16.968 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/cputime.o 2023-11-18T19:19:17.189 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/mls.o 2023-11-18T19:19:17.307 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/gcm.o 2023-11-18T19:19:17.658 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/badblocks.o 2023-11-18T19:19:17.668 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/resize.o 2023-11-18T19:19:17.808 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/vmalloc.o 2023-11-18T19:19:17.886 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/x86_init.o 2023-11-18T19:19:18.046 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsargs.o 2023-11-18T19:19:18.051 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/idle.o 2023-11-18T19:19:18.308 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-rq-qos.o 2023-11-18T19:19:19.018 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/i8259.o 2023-11-18T19:19:19.372 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dscontrol.o 2023-11-18T19:19:19.448 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/ccm.o 2023-11-18T19:19:19.550 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/ss/status.o 2023-11-18T19:19:19.654 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/bounce.o 2023-11-18T19:19:19.692 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/fair.o 2023-11-18T19:19:19.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:19:19.803 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:19:20.043 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/super.o 2023-11-18T19:19:20.656 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsdebug.o 2023-11-18T19:19:20.688 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/irqinit.o 2023-11-18T19:19:21.039 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/selinux/netlabel.o 2023-11-18T19:19:21.063 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/scsi_ioctl.o 2023-11-18T19:19:21.107 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsfield.o 2023-11-18T19:19:21.127 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/des_generic.o 2023-11-18T19:19:21.136 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/process_vm_access.o 2023-11-18T19:19:21.742 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/jump_label.o 2023-11-18T19:19:21.826 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/aes_generic.o 2023-11-18T19:19:21.873 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsinit.o 2023-11-18T19:19:22.174 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/bsg.o 2023-11-18T19:19:22.322 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/page_alloc.o 2023-11-18T19:19:22.328 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsmethod.o 2023-11-18T19:19:22.441 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/irq_work.o 2023-11-18T19:19:22.492 INFO:tasks.workunit.client.1.smithi135.stdout: AR security/selinux/built-in.a 2023-11-18T19:19:22.635 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/rt.o 2023-11-18T19:19:22.639 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/min_addr.o 2023-11-18T19:19:22.709 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/crc32c_generic.o 2023-11-18T19:19:22.866 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsmthdat.o 2023-11-18T19:19:22.939 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/probe_roms.o 2023-11-18T19:19:22.988 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/mq-deadline.o 2023-11-18T19:19:23.191 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/security.o 2023-11-18T19:19:23.336 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsobject.o 2023-11-18T19:19:23.395 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/authenc.o 2023-11-18T19:19:23.623 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/sys_x86_64.o 2023-11-18T19:19:23.819 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/kyber-iosched.o 2023-11-18T19:19:23.853 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsopcode.o 2023-11-18T19:19:24.082 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/deadline.o 2023-11-18T19:19:24.359 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dspkginit.o 2023-11-18T19:19:24.382 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/authencesn.o 2023-11-18T19:19:24.419 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/espfix_64.o 2023-11-18T19:19:24.848 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dsutils.o 2023-11-18T19:19:25.052 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/compat_ioctl.o 2023-11-18T19:19:25.279 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/ksysfs.o 2023-11-18T19:19:25.347 INFO:tasks.workunit.client.1.smithi135.stdout: CC security/lsm_audit.o 2023-11-18T19:19:25.352 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dswexec.o 2023-11-18T19:19:25.368 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/rng.o 2023-11-18T19:19:25.382 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/init-mm.o 2023-11-18T19:19:25.757 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/symlink.o 2023-11-18T19:19:25.793 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/wait.o 2023-11-18T19:19:25.858 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dswload.o 2023-11-18T19:19:25.898 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-mq-pci.o 2023-11-18T19:19:25.908 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/bootflag.o 2023-11-18T19:19:25.922 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/memblock.o 2023-11-18T19:19:26.645 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/drbg.o 2023-11-18T19:19:26.818 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dswload2.o 2023-11-18T19:19:26.975 INFO:tasks.workunit.client.1.smithi135.stdout: AR security/built-in.a 2023-11-18T19:19:27.007 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/e820.o 2023-11-18T19:19:27.063 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/madvise.o 2023-11-18T19:19:27.090 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-mq-debugfs.o 2023-11-18T19:19:27.106 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/sysfs.o 2023-11-18T19:19:27.314 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dswscope.o 2023-11-18T19:19:27.441 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/wait_bit.o 2023-11-18T19:19:27.580 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/swait.o 2023-11-18T19:19:27.748 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/dswstate.o 2023-11-18T19:19:27.752 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/jitterentropy.o 2023-11-18T19:19:27.898 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/jitterentropy-kcapi.o 2023-11-18T19:19:27.919 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/xattr.o 2023-11-18T19:19:27.995 INFO:tasks.workunit.client.1.smithi135.stdout: CC block/blk-pm.o 2023-11-18T19:19:28.071 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/pci-dma.o 2023-11-18T19:19:28.117 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/page_io.o 2023-11-18T19:19:28.244 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evevent.o 2023-11-18T19:19:28.561 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/dptf/int340x_thermal.o 2023-11-18T19:19:28.601 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/completion.o 2023-11-18T19:19:28.608 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/ghash-generic.o 2023-11-18T19:19:28.664 INFO:tasks.workunit.client.1.smithi135.stdout: AR block/built-in.a 2023-11-18T19:19:28.723 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evgpe.o 2023-11-18T19:19:28.750 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/hash_info.o 2023-11-18T19:19:28.778 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/quirks.o 2023-11-18T19:19:28.879 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/topology.o 2023-11-18T19:19:28.963 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/swap_state.o 2023-11-18T19:19:29.092 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/acpi/dptf/built-in.a 2023-11-18T19:19:29.151 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/kdebugfs.o 2023-11-18T19:19:29.272 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evgpeblk.o 2023-11-18T19:19:29.343 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/rsapubkey.asn1.o 2023-11-18T19:19:29.365 INFO:tasks.workunit.client.1.smithi135.stdout: CC crypto/rsaprivkey.asn1.o 2023-11-18T19:19:29.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/realmode/init.o 2023-11-18T19:19:29.481 INFO:tasks.workunit.client.1.smithi135.stdout: AR crypto/built-in.a 2023-11-18T19:19:29.577 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/arm/built-in.a 2023-11-18T19:19:29.577 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/swapfile.o 2023-11-18T19:19:29.617 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/atmel/built-in.a 2023-11-18T19:19:29.688 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq.o 2023-11-18T19:19:29.691 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/xattr_trusted.o 2023-11-18T19:19:29.730 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/alternative.o 2023-11-18T19:19:29.743 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/cpupri.o 2023-11-18T19:19:29.783 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evgpeinit.o 2023-11-18T19:19:29.990 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evgpeutil.o 2023-11-18T19:19:30.046 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rm/header.o 2023-11-18T19:19:30.127 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rm/trampoline_64.o 2023-11-18T19:19:30.214 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rm/stack.o 2023-11-18T19:19:30.240 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/xattr_user.o 2023-11-18T19:19:30.250 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_lock.o 2023-11-18T19:19:30.288 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rm/reboot.o 2023-11-18T19:19:30.372 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rm/wakeup_asm.o 2023-11-18T19:19:30.433 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/namei.o 2023-11-18T19:19:30.466 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/realmode/rm/wakemain.o 2023-11-18T19:19:30.466 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evglock.o 2023-11-18T19:19:30.633 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/realmode/rm/video-mode.o 2023-11-18T19:19:30.680 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_clientmgr.o 2023-11-18T19:19:30.712 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/i8253.o 2023-11-18T19:19:30.790 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/cpudeadline.o 2023-11-18T19:19:30.817 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rm/copy.o 2023-11-18T19:19:30.894 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rm/bioscall.o 2023-11-18T19:19:30.928 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evhandler.o 2023-11-18T19:19:30.951 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/acl.o 2023-11-18T19:19:30.996 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/realmode/rm/regs.o 2023-11-18T19:19:31.104 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/inode.o 2023-11-18T19:19:31.105 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/hw_breakpoint.o 2023-11-18T19:19:31.123 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/realmode/rm/video-vga.o 2023-11-18T19:19:31.292 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/realmode/rm/video-vesa.o 2023-11-18T19:19:31.400 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evmisc.o 2023-11-18T19:19:31.452 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/realmode/rm/video-bios.o 2023-11-18T19:19:31.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/swap_slots.o 2023-11-18T19:19:31.600 INFO:tasks.workunit.client.1.smithi135.stdout: PASYMS arch/x86/realmode/rm/pasyms.h 2023-11-18T19:19:31.664 INFO:tasks.workunit.client.1.smithi135.stdout: LDS arch/x86/realmode/rm/realmode.lds 2023-11-18T19:19:31.712 INFO:tasks.workunit.client.1.smithi135.stdout: LD arch/x86/realmode/rm/realmode.elf 2023-11-18T19:19:31.735 INFO:tasks.workunit.client.1.smithi135.stdout: RELOCS arch/x86/realmode/rm/realmode.relocs 2023-11-18T19:19:31.749 INFO:tasks.workunit.client.1.smithi135.stdout: OBJCOPY arch/x86/realmode/rm/realmode.bin 2023-11-18T19:19:31.779 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ext4/xattr_security.o 2023-11-18T19:19:31.803 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/realmode/rmpiggy.o 2023-11-18T19:19:31.868 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evregion.o 2023-11-18T19:19:31.875 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/tsc.o 2023-11-18T19:19:31.877 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/topology.o 2023-11-18T19:19:31.884 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/realmode/built-in.a 2023-11-18T19:19:31.909 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_memory.o 2023-11-18T19:19:31.990 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/i386.o 2023-11-18T19:19:32.208 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/dmapool.o 2023-11-18T19:19:32.226 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/dir.o 2023-11-18T19:19:32.392 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evrgnini.o 2023-11-18T19:19:32.479 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/ext4/built-in.a 2023-11-18T19:19:32.684 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/power/cpu.o 2023-11-18T19:19:32.684 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_queue.o 2023-11-18T19:19:32.707 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/init.o 2023-11-18T19:19:32.845 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/util.o 2023-11-18T19:19:32.854 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/tsc_msr.o 2023-11-18T19:19:32.887 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evsci.o 2023-11-18T19:19:32.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/hugetlb.o 2023-11-18T19:19:33.184 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/io_delay.o 2023-11-18T19:19:33.317 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/mmconfig_64.o 2023-11-18T19:19:33.330 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evxface.o 2023-11-18T19:19:33.375 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/rock.o 2023-11-18T19:19:33.381 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/stop_task.o 2023-11-18T19:19:33.416 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_fifo.o 2023-11-18T19:19:33.558 INFO:tasks.workunit.client.1.smithi135.stderr:mm/hugetlb.c: In function ‘hugetlb_fault_mutex_hash’: 2023-11-18T19:19:33.558 INFO:tasks.workunit.client.1.smithi135.stderr:mm/hugetlb.c:4054:47: warning: expression does not compute the number of elements in this array; element type is ‘long unsigned int’, not ‘u32’ {aka ‘unsigned int’} [-Wsizeof-array-div] 2023-11-18T19:19:33.558 INFO:tasks.workunit.client.1.smithi135.stderr: 4054 | hash = jhash2((u32 *)&key, sizeof(key)/sizeof(u32), 0); 2023-11-18T19:19:33.558 INFO:tasks.workunit.client.1.smithi135.stderr: | ^ 2023-11-18T19:19:33.559 INFO:tasks.workunit.client.1.smithi135.stderr:mm/hugetlb.c:4054:47: note: add parentheses around the second ‘sizeof’ to silence this warning 2023-11-18T19:19:33.559 INFO:tasks.workunit.client.1.smithi135.stderr:mm/hugetlb.c:4048:23: note: array ‘key’ declared here 2023-11-18T19:19:33.559 INFO:tasks.workunit.client.1.smithi135.stderr: 4048 | unsigned long key[2]; 2023-11-18T19:19:33.559 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~ 2023-11-18T19:19:33.590 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/rtc.o 2023-11-18T19:19:33.644 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/power/hibernate_64.o 2023-11-18T19:19:33.939 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evxfevnt.o 2023-11-18T19:19:33.972 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/direct.o 2023-11-18T19:19:34.010 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_prioq.o 2023-11-18T19:19:34.123 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/list.h:9, 2023-11-18T19:19:34.123 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/kobject.h:19, 2023-11-18T19:19:34.123 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/device.h:16, 2023-11-18T19:19:34.123 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/platform_device.h:13, 2023-11-18T19:19:34.123 INFO:tasks.workunit.client.1.smithi135.stderr: from arch/x86/kernel/rtc.c:5: 2023-11-18T19:19:34.123 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/kernel/rtc.c: In function ‘add_rtc_cmos’: 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/kernel.h:997:10: warning: array subscript -45 is outside array bounds of ‘struct list_head[1]’ [-Warray-bounds] 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr: 997 | ((type *)(__mptr - offsetof(type, member))); }) 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr: | ~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/list.h:479:9: note: in expansion of macro ‘container_of’ 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr: 479 | container_of(ptr, type, member) 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~ 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:275:30: note: in expansion of macro ‘list_entry’ 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr: 275 | #define global_to_pnp_dev(n) list_entry(n, struct pnp_dev, global_list) 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:281:18: note: in expansion of macro ‘global_to_pnp_dev’ 2023-11-18T19:19:34.124 INFO:tasks.workunit.client.1.smithi135.stderr: 281 | (dev) != global_to_pnp_dev(&pnp_global); \ 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/kernel/rtc.c:189:9: note: in expansion of macro ‘pnp_for_each_dev’ 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr: 189 | pnp_for_each_dev(dev) { 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from arch/x86/kernel/rtc.c:10: 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:456:25: note: while referencing ‘pnp_global’ 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr: 456 | extern struct list_head pnp_global; 2023-11-18T19:19:34.125 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:19:34.150 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/export.o 2023-11-18T19:19:34.318 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/pci-iommu_table.o 2023-11-18T19:19:34.394 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/power/hibernate_asm_64.o 2023-11-18T19:19:34.413 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/pelt.o 2023-11-18T19:19:34.431 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evxfgpe.o 2023-11-18T19:19:34.484 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/power/hibernate.o 2023-11-18T19:19:34.611 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_timer.o 2023-11-18T19:19:34.651 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/mmconfig-shared.o 2023-11-18T19:19:34.722 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/joliet.o 2023-11-18T19:19:34.933 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/resource.o 2023-11-18T19:19:35.020 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/evxfregn.o 2023-11-18T19:19:35.072 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/kernel/irqflags.o 2023-11-18T19:19:35.182 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/process.o 2023-11-18T19:19:35.268 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/isofs/compress.o 2023-11-18T19:19:35.311 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/power/built-in.a 2023-11-18T19:19:35.311 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_system.o 2023-11-18T19:19:35.323 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mempolicy.o 2023-11-18T19:19:35.393 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/ptrace.o 2023-11-18T19:19:35.468 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exconcat.o 2023-11-18T19:19:35.605 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/fixup.o 2023-11-18T19:19:35.650 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/stats.o 2023-11-18T19:19:35.856 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_ports.o 2023-11-18T19:19:35.990 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exconfig.o 2023-11-18T19:19:36.335 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/isofs/built-in.a 2023-11-18T19:19:36.821 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/jbd2/transaction.o 2023-11-18T19:19:36.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exconvrt.o 2023-11-18T19:19:36.987 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/acpi.o 2023-11-18T19:19:37.001 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/tls.o 2023-11-18T19:19:37.089 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/sparse.o 2023-11-18T19:19:37.100 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c: In function ‘mpol_parse_str’: 2023-11-18T19:19:37.100 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2907:26: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:19:37.100 INFO:tasks.workunit.client.1.smithi135.stderr: 2907 | *--flags = '='; 2023-11-18T19:19:37.100 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~^~~~~ 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2796:26: note: destination object ‘str’ of size [0, 9223372036854775807] 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: 2796 | int mpol_parse_str(char *str, struct mempolicy **mpol) 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2907:26: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: 2907 | *--flags = '='; 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~^~~~~ 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2796:26: note: destination object ‘str’ of size [0, 9223372036854775807] 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: 2796 | int mpol_parse_str(char *str, struct mempolicy **mpol) 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2907:26: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: 2907 | *--flags = '='; 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~^~~~~ 2023-11-18T19:19:37.101 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2796:26: note: destination object ‘str’ of size [0, 9223372036854775807] 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr: 2796 | int mpol_parse_str(char *str, struct mempolicy **mpol) 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2907:26: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr: 2907 | *--flags = '='; 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~^~~~~ 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2796:26: note: destination object ‘str’ of size [0, 9223372036854775807] 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr: 2796 | int mpol_parse_str(char *str, struct mempolicy **mpol) 2023-11-18T19:19:37.102 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2907:26: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr: 2907 | *--flags = '='; 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~^~~~~ 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2796:26: note: destination object ‘str’ of size [0, 9223372036854775807] 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr: 2796 | int mpol_parse_str(char *str, struct mempolicy **mpol) 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2907:26: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr: 2907 | *--flags = '='; 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~^~~~~ 2023-11-18T19:19:37.103 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2796:26: note: destination object ‘str’ of size [0, 9223372036854775807] 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr: 2796 | int mpol_parse_str(char *str, struct mempolicy **mpol) 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2907:26: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr: 2907 | *--flags = '='; 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~^~~~~ 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr:mm/mempolicy.c:2796:26: note: destination object ‘str’ of size [0, 9223372036854775807] 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr: 2796 | int mpol_parse_str(char *str, struct mempolicy **mpol) 2023-11-18T19:19:37.104 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:19:37.134 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/cpuacct.o 2023-11-18T19:19:37.212 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_info.o 2023-11-18T19:19:37.313 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq/seq_dummy.o 2023-11-18T19:19:37.418 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/excreate.o 2023-11-18T19:19:37.717 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/tables.o 2023-11-18T19:19:37.732 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/legacy.o 2023-11-18T19:19:37.787 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/step.o 2023-11-18T19:19:37.879 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exdebug.o 2023-11-18T19:19:37.883 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/sparse-vmemmap.o 2023-11-18T19:19:37.899 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/core/seq/built-in.a 2023-11-18T19:19:38.020 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/sound.o 2023-11-18T19:19:38.189 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/cpufreq.o 2023-11-18T19:19:38.271 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/jbd2/commit.o 2023-11-18T19:19:38.335 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/irq.o 2023-11-18T19:19:38.343 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exdump.o 2023-11-18T19:19:38.452 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/i8237.o 2023-11-18T19:19:38.522 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/amba/built-in.a 2023-11-18T19:19:38.588 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/time.o 2023-11-18T19:19:38.589 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/mmu_notifier.o 2023-11-18T19:19:38.685 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/init.o 2023-11-18T19:19:38.751 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exfield.o 2023-11-18T19:19:38.921 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/stacktrace.o 2023-11-18T19:19:39.161 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/membarrier.o 2023-11-18T19:19:39.237 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exfldio.o 2023-11-18T19:19:39.315 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/slub.o 2023-11-18T19:19:39.342 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/common.o 2023-11-18T19:19:39.400 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/jbd2/recovery.o 2023-11-18T19:19:39.489 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/memory.o 2023-11-18T19:19:39.548 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/reboot.o 2023-11-18T19:19:39.631 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/timer.o 2023-11-18T19:19:39.771 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exmisc.o 2023-11-18T19:19:39.925 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/control.o 2023-11-18T19:19:40.115 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/early.o 2023-11-18T19:19:40.204 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sched/isolation.o 2023-11-18T19:19:40.218 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exmutex.o 2023-11-18T19:19:40.269 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/jbd2/checkpoint.o 2023-11-18T19:19:40.435 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/msr.o 2023-11-18T19:19:40.674 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exnames.o 2023-11-18T19:19:40.709 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/bus_numa.o 2023-11-18T19:19:41.104 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/cpuid.o 2023-11-18T19:19:41.127 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/jbd2/revoke.o 2023-11-18T19:19:41.166 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exoparg1.o 2023-11-18T19:19:41.273 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/hrtimer.o 2023-11-18T19:19:41.299 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/misc.o 2023-11-18T19:19:41.307 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/sched/built-in.a 2023-11-18T19:19:41.375 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/pci/amd_bus.o 2023-11-18T19:19:41.402 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exoparg2.o 2023-11-18T19:19:41.644 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/early-quirks.o 2023-11-18T19:19:41.721 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/drivers/mpu401/built-in.a 2023-11-18T19:19:41.764 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/drivers/opl3/built-in.a 2023-11-18T19:19:41.806 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/drivers/opl4/built-in.a 2023-11-18T19:19:41.848 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/drivers/pcsp/built-in.a 2023-11-18T19:19:41.892 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/drivers/vx/built-in.a 2023-11-18T19:19:41.897 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/migrate.o 2023-11-18T19:19:41.899 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exoparg3.o 2023-11-18T19:19:41.909 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/jbd2/journal.o 2023-11-18T19:19:41.925 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/drivers/built-in.a 2023-11-18T19:19:41.943 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/device.o 2023-11-18T19:19:41.988 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/early_ioremap.o 2023-11-18T19:19:42.095 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/pci/built-in.a 2023-11-18T19:19:42.168 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/kernfs/mount.o 2023-11-18T19:19:42.364 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exoparg6.o 2023-11-18T19:19:42.443 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/info.o 2023-11-18T19:19:42.519 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/timekeeping.o 2023-11-18T19:19:42.520 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/smp.o 2023-11-18T19:19:42.621 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/blacklist.o 2023-11-18T19:19:42.798 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exprep.o 2023-11-18T19:19:42.825 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/kernfs/inode.o 2023-11-18T19:19:43.176 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-core.o 2023-11-18T19:19:43.257 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exregion.o 2023-11-18T19:19:43.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/isadma.o 2023-11-18T19:19:43.453 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/smpboot.o 2023-11-18T19:19:43.527 INFO:tasks.workunit.client.1.smithi135.stdout: CC mm/memfd.o 2023-11-18T19:19:43.560 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/kernfs/dir.o 2023-11-18T19:19:43.736 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exresnte.o 2023-11-18T19:19:43.751 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/vmaster.o 2023-11-18T19:19:43.756 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/ntp.o 2023-11-18T19:19:43.894 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/jbd2/built-in.a 2023-11-18T19:19:43.981 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-scsi.o 2023-11-18T19:19:44.182 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exresolv.o 2023-11-18T19:19:44.353 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/ctljack.o 2023-11-18T19:19:44.595 INFO:tasks.workunit.client.1.smithi135.stdout: AR mm/built-in.a 2023-11-18T19:19:44.895 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exresop.o 2023-11-18T19:19:45.235 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/jack.o 2023-11-18T19:19:45.243 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/kernfs/file.o 2023-11-18T19:19:45.539 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/clocksource.o 2023-11-18T19:19:45.775 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/tsc_sync.o 2023-11-18T19:19:45.920 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exserial.o 2023-11-18T19:19:46.100 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/jiffies.o 2023-11-18T19:19:46.823 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exstore.o 2023-11-18T19:19:47.022 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/firewire/built-in.a 2023-11-18T19:19:47.041 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/setup_percpu.o 2023-11-18T19:19:47.158 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/kernfs/symlink.o 2023-11-18T19:19:47.168 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hda_bus_type.o 2023-11-18T19:19:47.195 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/timer_list.o 2023-11-18T19:19:47.431 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/hwdep.o 2023-11-18T19:19:47.497 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_clock.o 2023-11-18T19:19:47.563 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exstoren.o 2023-11-18T19:19:47.611 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-eh.o 2023-11-18T19:19:47.870 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/kernfs/built-in.a 2023-11-18T19:19:47.874 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_bus.o 2023-11-18T19:19:47.965 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/ring_buffer.o 2023-11-18T19:19:47.967 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/clntlock.o 2023-11-18T19:19:47.984 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/mpparse.o 2023-11-18T19:19:48.018 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exstorob.o 2023-11-18T19:19:48.023 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/timeconv.o 2023-11-18T19:19:48.178 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/timer.o 2023-11-18T19:19:48.454 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/timecounter.o 2023-11-18T19:19:48.465 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exsystem.o 2023-11-18T19:19:48.573 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_device.o 2023-11-18T19:19:48.608 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/alarmtimer.o 2023-11-18T19:19:48.870 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/trace_clock.o 2023-11-18T19:19:48.904 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/extrace.o 2023-11-18T19:19:49.076 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/machine_kexec_64.o 2023-11-18T19:19:49.113 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/clntproc.o 2023-11-18T19:19:49.344 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/exutils.o 2023-11-18T19:19:49.497 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_sysfs.o 2023-11-18T19:19:49.539 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/hrtimer.o 2023-11-18T19:19:49.571 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-transport.o 2023-11-18T19:19:49.657 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/posix-timers.o 2023-11-18T19:19:49.799 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace.o 2023-11-18T19:19:49.808 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwacpi.o 2023-11-18T19:19:49.997 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/kernel/relocate_kernel_64.o 2023-11-18T19:19:50.061 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/pcm.o 2023-11-18T19:19:50.091 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/crash.o 2023-11-18T19:19:50.245 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwesleep.o 2023-11-18T19:19:50.256 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_regmap.o 2023-11-18T19:19:50.390 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/clntxdr.o 2023-11-18T19:19:50.467 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-trace.o 2023-11-18T19:19:50.680 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwgpe.o 2023-11-18T19:19:50.821 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/crash_dump_64.o 2023-11-18T19:19:50.887 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/posix-cpu-timers.o 2023-11-18T19:19:50.952 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/pcm_native.o 2023-11-18T19:19:50.995 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_controller.o 2023-11-18T19:19:51.171 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwregs.o 2023-11-18T19:19:51.273 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-sff.o 2023-11-18T19:19:51.286 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:19:51.296 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:19:51.498 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/module.o 2023-11-18T19:19:51.542 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/host.o 2023-11-18T19:19:51.706 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwsleep.o 2023-11-18T19:19:51.763 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_stream.o 2023-11-18T19:19:51.845 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/posix-clock.o 2023-11-18T19:19:52.145 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwvalid.o 2023-11-18T19:19:52.165 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/doublefault.o 2023-11-18T19:19:52.586 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/itimer.o 2023-11-18T19:19:52.617 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/array.o 2023-11-18T19:19:52.658 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_output.o 2023-11-18T19:19:52.830 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwxface.o 2023-11-18T19:19:52.845 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-pmp.o 2023-11-18T19:19:52.854 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/svc.o 2023-11-18T19:19:53.070 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdmi_chmap.o 2023-11-18T19:19:53.074 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/early_printk.o 2023-11-18T19:19:53.168 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/pcm_lib.o 2023-11-18T19:19:54.342 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/pcm_misc.o 2023-11-18T19:19:54.484 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_seq.o 2023-11-18T19:19:54.498 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwxfsleep.o 2023-11-18T19:19:54.525 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/hpet.o 2023-11-18T19:19:54.530 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/trace.o 2023-11-18T19:19:54.548 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/clockevents.o 2023-11-18T19:19:54.548 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libata-acpi.o 2023-11-18T19:19:54.581 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/svclock.o 2023-11-18T19:19:54.953 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/hwpci.o 2023-11-18T19:19:54.976 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/pcm_memory.o 2023-11-18T19:19:55.024 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_stat.o 2023-11-18T19:19:55.247 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/tick-common.o 2023-11-18T19:19:55.333 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_component.o 2023-11-18T19:19:55.407 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsaccess.o 2023-11-18T19:19:55.408 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/amd_nb.o 2023-11-18T19:19:55.566 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/ahci.o 2023-11-18T19:19:55.681 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/memalloc.o 2023-11-18T19:19:55.772 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_printk.o 2023-11-18T19:19:55.843 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/svcshare.o 2023-11-18T19:19:55.914 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsalloc.o 2023-11-18T19:19:56.130 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/hdac_i915.o 2023-11-18T19:19:56.788 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/pcm_timer.o 2023-11-18T19:19:56.832 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/pcspeaker.o 2023-11-18T19:19:57.088 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsarguments.o 2023-11-18T19:19:57.311 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/tick-broadcast.o 2023-11-18T19:19:57.516 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_sched_switch.o 2023-11-18T19:19:57.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/libahci.o 2023-11-18T19:19:57.697 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/check.o 2023-11-18T19:19:57.716 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/svcproc.o 2023-11-18T19:19:57.729 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/hda/intel-nhlt.o 2023-11-18T19:19:57.761 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/sgbuf.o 2023-11-18T19:19:57.802 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsconvert.o 2023-11-18T19:19:58.083 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/tick-broadcast-hrtimer.o 2023-11-18T19:19:58.286 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsdump.o 2023-11-18T19:19:58.328 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/pci-swiotlb.o 2023-11-18T19:19:58.330 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/hda/built-in.a 2023-11-18T19:19:58.371 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/core/seq_device.o 2023-11-18T19:19:58.372 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_nop.o 2023-11-18T19:19:58.450 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/svcsubs.o 2023-11-18T19:19:58.529 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/tick-oneshot.o 2023-11-18T19:19:58.701 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nseval.o 2023-11-18T19:19:58.879 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/uprobes.o 2023-11-18T19:19:58.925 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsinit.o 2023-11-18T19:19:58.994 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/tick-sched.o 2023-11-18T19:19:59.029 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/blktrace.o 2023-11-18T19:19:59.037 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/core/built-in.a 2023-11-18T19:19:59.143 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/ata_piix.o 2023-11-18T19:19:59.159 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/i2c/other/built-in.a 2023-11-18T19:19:59.167 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_events.o 2023-11-18T19:19:59.192 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/i2c/built-in.a 2023-11-18T19:19:59.248 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/ad1816a/built-in.a 2023-11-18T19:19:59.290 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/ad1848/built-in.a 2023-11-18T19:19:59.337 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/cs423x/built-in.a 2023-11-18T19:19:59.391 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/es1688/built-in.a 2023-11-18T19:19:59.441 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsload.o 2023-11-18T19:19:59.442 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/galaxy/built-in.a 2023-11-18T19:19:59.488 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/gus/built-in.a 2023-11-18T19:19:59.537 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/msnd/built-in.a 2023-11-18T19:19:59.584 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/opti9xx/built-in.a 2023-11-18T19:19:59.601 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/mon.o 2023-11-18T19:19:59.633 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/sb/built-in.a 2023-11-18T19:19:59.676 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/wavefront/built-in.a 2023-11-18T19:19:59.712 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/sysfb.o 2023-11-18T19:19:59.724 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/wss/built-in.a 2023-11-18T19:19:59.758 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/isa/built-in.a 2023-11-18T19:19:59.847 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/mips/built-in.a 2023-11-18T19:19:59.889 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/parisc/built-in.a 2023-11-18T19:19:59.904 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsnames.o 2023-11-18T19:19:59.947 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/ac97/built-in.a 2023-11-18T19:19:59.957 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/vsyscall.o 2023-11-18T19:19:59.996 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/ali5451/built-in.a 2023-11-18T19:20:00.050 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/asihpi/built-in.a 2023-11-18T19:20:00.097 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/au88x0/built-in.a 2023-11-18T19:20:00.132 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/pata_amd.o 2023-11-18T19:20:00.143 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/aw2/built-in.a 2023-11-18T19:20:00.191 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/ca0106/built-in.a 2023-11-18T19:20:00.244 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/cs46xx/built-in.a 2023-11-18T19:20:00.297 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/cs5535audio/built-in.a 2023-11-18T19:20:00.338 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/ctxfi/built-in.a 2023-11-18T19:20:00.379 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/time/timekeeping_debug.o 2023-11-18T19:20:00.381 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/echoaudio/built-in.a 2023-11-18T19:20:00.387 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/sysfb_efi.o 2023-11-18T19:20:00.419 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsobject.o 2023-11-18T19:20:00.423 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/emu10k1/built-in.a 2023-11-18T19:20:00.466 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pcmcia/pdaudiocf/built-in.a 2023-11-18T19:20:00.483 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_bind.o 2023-11-18T19:20:00.516 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pcmcia/vx/built-in.a 2023-11-18T19:20:00.552 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pcmcia/built-in.a 2023-11-18T19:20:00.605 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/ice1712/built-in.a 2023-11-18T19:20:00.651 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/xdr.o 2023-11-18T19:20:00.750 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_export.o 2023-11-18T19:20:00.810 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/pata_oldpiix.o 2023-11-18T19:20:00.882 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsparse.o 2023-11-18T19:20:01.060 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nspredef.o 2023-11-18T19:20:01.075 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/time/built-in.a 2023-11-18T19:20:01.193 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/video/fbdev.o 2023-11-18T19:20:01.208 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_codec.o 2023-11-18T19:20:01.285 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/perf_regs.o 2023-11-18T19:20:01.416 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/802/fddi.o 2023-11-18T19:20:01.496 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_event_perf.o 2023-11-18T19:20:01.558 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsprepkg.o 2023-11-18T19:20:01.592 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ata/pata_sch.o 2023-11-18T19:20:01.760 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/clnt4xdr.o 2023-11-18T19:20:01.860 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/video/built-in.a 2023-11-18T19:20:01.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/tracepoint.o 2023-11-18T19:20:01.948 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/bpf/built-in.a 2023-11-18T19:20:01.993 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsrepair.o 2023-11-18T19:20:02.058 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/osi.o 2023-11-18T19:20:02.279 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_events_filter.o 2023-11-18T19:20:02.373 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/ata/built-in.a 2023-11-18T19:20:02.403 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/itmt.o 2023-11-18T19:20:02.466 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/802/built-in.a 2023-11-18T19:20:02.480 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/client.o 2023-11-18T19:20:02.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsrepair2.o 2023-11-18T19:20:02.540 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/sock.o 2023-11-18T19:20:02.686 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/dir.o 2023-11-18T19:20:02.886 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/xdr4.o 2023-11-18T19:20:02.949 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/umip.o 2023-11-18T19:20:02.997 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nssearch.o 2023-11-18T19:20:03.227 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_jack.o 2023-11-18T19:20:03.437 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsutils.o 2023-11-18T19:20:03.525 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_events_trigger.o 2023-11-18T19:20:03.577 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/unwind_orc.o 2023-11-18T19:20:03.978 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nswalk.o 2023-11-18T19:20:04.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/svc4proc.o 2023-11-18T19:20:04.036 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsxfeval.o 2023-11-18T19:20:04.080 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_auto_parser.o 2023-11-18T19:20:04.331 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/audit_64.o 2023-11-18T19:20:04.430 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/fork.o 2023-11-18T19:20:04.553 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_kprobe.o 2023-11-18T19:20:04.597 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsxfname.o 2023-11-18T19:20:04.859 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/file.o 2023-11-18T19:20:04.879 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/pci-calgary_64.o 2023-11-18T19:20:05.029 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/request_sock.o 2023-11-18T19:20:05.506 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/nsxfobj.o 2023-11-18T19:20:05.714 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_sysfs.o 2023-11-18T19:20:06.637 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/lockd/procfs.o 2023-11-18T19:20:06.850 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psargs.o 2023-11-18T19:20:06.877 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/skbuff.o 2023-11-18T19:20:06.886 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/tce_64.o 2023-11-18T19:20:06.963 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_controller.o 2023-11-18T19:20:07.000 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/power-traces.o 2023-11-18T19:20:07.420 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psloop.o 2023-11-18T19:20:07.633 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/mmconf-fam10h_64.o 2023-11-18T19:20:07.697 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/lockd/built-in.a 2023-11-18T19:20:07.742 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/getroot.o 2023-11-18T19:20:08.014 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psobject.o 2023-11-18T19:20:08.079 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/datagram.o 2023-11-18T19:20:08.261 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/osl.o 2023-11-18T19:20:08.382 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_proc.o 2023-11-18T19:20:08.491 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/vsmp_64.o 2023-11-18T19:20:08.550 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/rpm-traces.o 2023-11-18T19:20:08.558 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psopcode.o 2023-11-18T19:20:08.870 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/inode.o 2023-11-18T19:20:08.917 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/kernel/head_64.o 2023-11-18T19:20:08.974 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psopinfo.o 2023-11-18T19:20:09.069 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/head64.o 2023-11-18T19:20:09.320 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_hwdep.o 2023-11-18T19:20:09.328 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psparse.o 2023-11-18T19:20:09.363 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_dynevent.o 2023-11-18T19:20:09.381 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/ebda.o 2023-11-18T19:20:09.401 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/super.o 2023-11-18T19:20:09.747 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/auxdisplay/built-in.a 2023-11-18T19:20:09.830 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/exec_domain.o 2023-11-18T19:20:09.869 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psscope.o 2023-11-18T19:20:09.922 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/kernel/platform-quirks.o 2023-11-18T19:20:09.986 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/pci/hda/hda_intel.o 2023-11-18T19:20:10.081 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_probe.o 2023-11-18T19:20:10.190 INFO:tasks.workunit.client.1.smithi135.stdout: LDS arch/x86/kernel/vmlinux.lds 2023-11-18T19:20:10.281 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/kernel/built-in.a 2023-11-18T19:20:10.323 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/pstree.o 2023-11-18T19:20:10.472 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/korg1212/built-in.a 2023-11-18T19:20:10.530 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/built-in.a 2023-11-18T19:20:10.567 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/base/firmware_loader/builtin/built-in.a 2023-11-18T19:20:10.612 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/firmware_loader/main.o 2023-11-18T19:20:10.767 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psutils.o 2023-11-18T19:20:10.822 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/utils.o 2023-11-18T19:20:10.827 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/stream.o 2023-11-18T19:20:11.026 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/ppc/built-in.a 2023-11-18T19:20:11.132 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/io.o 2023-11-18T19:20:11.838 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/pswalk.o 2023-11-18T19:20:11.845 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/trace/trace_uprobe.o 2023-11-18T19:20:11.907 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/hda/built-in.a 2023-11-18T19:20:11.925 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/dns_resolver/dns_key.o 2023-11-18T19:20:11.935 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/base/firmware_loader/built-in.a 2023-11-18T19:20:11.986 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/lola/built-in.a 2023-11-18T19:20:12.025 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/sysfs.o 2023-11-18T19:20:12.026 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/lx6464es/built-in.a 2023-11-18T19:20:12.052 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/block/loop.o 2023-11-18T19:20:12.075 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/mixart/built-in.a 2023-11-18T19:20:12.115 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/nm256/built-in.a 2023-11-18T19:20:12.166 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/oxygen/built-in.a 2023-11-18T19:20:12.213 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/pcxhr/built-in.a 2023-11-18T19:20:12.263 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/riptide/built-in.a 2023-11-18T19:20:12.310 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/rme9652/built-in.a 2023-11-18T19:20:12.319 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/psxface.o 2023-11-18T19:20:12.349 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/trident/built-in.a 2023-11-18T19:20:12.406 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/vx222/built-in.a 2023-11-18T19:20:12.454 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/ymfpci/built-in.a 2023-11-18T19:20:12.485 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/scm.o 2023-11-18T19:20:12.488 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/pci/built-in.a 2023-11-18T19:20:12.489 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/direct.o 2023-11-18T19:20:12.574 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/dns_resolver/dns_query.o 2023-11-18T19:20:12.636 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/generic_ops.o 2023-11-18T19:20:12.682 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/sh/built-in.a 2023-11-18T19:20:12.739 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/soc/built-in.a 2023-11-18T19:20:12.779 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/sparc/built-in.a 2023-11-18T19:20:12.787 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsaddr.o 2023-11-18T19:20:12.823 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/spi/built-in.a 2023-11-18T19:20:12.878 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/synth/emux/built-in.a 2023-11-18T19:20:12.911 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/synth/built-in.a 2023-11-18T19:20:12.964 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/usb/6fire/built-in.a 2023-11-18T19:20:13.008 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/usb/bcd2000/built-in.a 2023-11-18T19:20:13.058 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/usb/caiaq/built-in.a 2023-11-18T19:20:13.102 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/usb/hiface/built-in.a 2023-11-18T19:20:13.147 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/usb/misc/built-in.a 2023-11-18T19:20:13.188 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/trace/built-in.a 2023-11-18T19:20:13.199 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/common.o 2023-11-18T19:20:13.200 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/usb/usx2y/built-in.a 2023-11-18T19:20:13.232 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/usb/built-in.a 2023-11-18T19:20:13.258 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rscalc.o 2023-11-18T19:20:13.278 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/panic.o 2023-11-18T19:20:13.305 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/x86/built-in.a 2023-11-18T19:20:13.328 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/dns_resolver/built-in.a 2023-11-18T19:20:13.351 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/xen/built-in.a 2023-11-18T19:20:13.387 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/gen_stats.o 2023-11-18T19:20:13.402 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/sound_core.o 2023-11-18T19:20:13.550 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/block/built-in.a 2023-11-18T19:20:13.691 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs_common/nfsacl.o 2023-11-18T19:20:13.752 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/crypto/aes.o 2023-11-18T19:20:13.778 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rscreate.o 2023-11-18T19:20:13.836 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/pagelist.o 2023-11-18T19:20:13.842 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/qos.o 2023-11-18T19:20:13.858 INFO:tasks.workunit.client.1.smithi135.stdout: CC sound/last.o 2023-11-18T19:20:14.103 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cpu.o 2023-11-18T19:20:14.265 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsdumpinfo.o 2023-11-18T19:20:14.276 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/gen_estimator.o 2023-11-18T19:20:14.338 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs_common/grace.o 2023-11-18T19:20:14.365 INFO:tasks.workunit.client.1.smithi135.stdout: AR sound/built-in.a 2023-11-18T19:20:14.388 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/crypto/arc4.o 2023-11-18T19:20:14.485 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/exit.o 2023-11-18T19:20:14.679 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsinfo.o 2023-11-18T19:20:14.819 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/crypto/des.o 2023-11-18T19:20:14.853 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/runtime.o 2023-11-18T19:20:15.089 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsio.o 2023-11-18T19:20:15.091 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/nfs_common/built-in.a 2023-11-18T19:20:15.166 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ethernet/eth.o 2023-11-18T19:20:15.285 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/net_namespace.o 2023-11-18T19:20:15.323 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/read.o 2023-11-18T19:20:15.508 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsirq.o 2023-11-18T19:20:15.682 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/crypto/sha256.o 2023-11-18T19:20:15.751 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/regmap/regmap.o 2023-11-18T19:20:15.882 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/wakeirq.o 2023-11-18T19:20:15.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rslist.o 2023-11-18T19:20:16.365 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/softirq.o 2023-11-18T19:20:16.619 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsmemory.o 2023-11-18T19:20:16.703 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/main.o 2023-11-18T19:20:16.782 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/ethernet/built-in.a 2023-11-18T19:20:16.785 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/crypto/built-in.a 2023-11-18T19:20:16.883 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/secure_seq.o 2023-11-18T19:20:16.892 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/fonts/fonts.o 2023-11-18T19:20:17.002 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/symlink.o 2023-11-18T19:20:17.039 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsmisc.o 2023-11-18T19:20:17.042 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/fonts/font_8x8.o 2023-11-18T19:20:17.164 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/bus/built-in.a 2023-11-18T19:20:17.262 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/msr-smp.o 2023-11-18T19:20:17.309 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/fonts/font_8x16.o 2023-11-18T19:20:17.458 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/lib/msr-smp.c:256:51: warning: argument 2 of type ‘u32 *’ {aka ‘unsigned int *’} declared as a pointer [-Warray-parameter=] 2023-11-18T19:20:17.458 INFO:tasks.workunit.client.1.smithi135.stderr: 256 | int rdmsr_safe_regs_on_cpu(unsigned int cpu, u32 *regs) 2023-11-18T19:20:17.458 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~^~~~ 2023-11-18T19:20:17.458 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./arch/x86/include/asm/processor.h:21, 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: from ./arch/x86/include/asm/cpufeature.h:5, 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: from ./arch/x86/include/asm/thread_info.h:53, 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/thread_info.h:38, 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: from ./arch/x86/include/asm/preempt.h:7, 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/preempt.h:78, 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: from arch/x86/lib/msr-smp.c:3: 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr:./arch/x86/include/asm/msr.h:349:50: note: previously declared as an array ‘u32[8]’ {aka ‘unsigned int[8]’} 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: 349 | int rdmsr_safe_regs_on_cpu(unsigned int cpu, u32 regs[8]); 2023-11-18T19:20:17.459 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~^~~~~~~ 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr:arch/x86/lib/msr-smp.c:269:51: warning: argument 2 of type ‘u32 *’ {aka ‘unsigned int *’} declared as a pointer [-Warray-parameter=] 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: 269 | int wrmsr_safe_regs_on_cpu(unsigned int cpu, u32 *regs) 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~^~~~ 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./arch/x86/include/asm/processor.h:21, 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: from ./arch/x86/include/asm/cpufeature.h:5, 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: from ./arch/x86/include/asm/thread_info.h:53, 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/thread_info.h:38, 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: from ./arch/x86/include/asm/preempt.h:7, 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/preempt.h:78, 2023-11-18T19:20:17.460 INFO:tasks.workunit.client.1.smithi135.stderr: from arch/x86/lib/msr-smp.c:3: 2023-11-18T19:20:17.461 INFO:tasks.workunit.client.1.smithi135.stderr:./arch/x86/include/asm/msr.h:350:50: note: previously declared as an array ‘u32[8]’ {aka ‘unsigned int[8]’} 2023-11-18T19:20:17.461 INFO:tasks.workunit.client.1.smithi135.stderr: 350 | int wrmsr_safe_regs_on_cpu(unsigned int cpu, u32 regs[8]); 2023-11-18T19:20:17.461 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~^~~~~~~ 2023-11-18T19:20:17.498 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/resource.o 2023-11-18T19:20:17.566 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsserial.o 2023-11-18T19:20:17.701 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/fonts/built-in.a 2023-11-18T19:20:17.705 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/cache-smp.o 2023-11-18T19:20:17.787 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/lz4/lz4_decompress.o 2023-11-18T19:20:18.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsutils.o 2023-11-18T19:20:18.034 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/flow_dissector.o 2023-11-18T19:20:18.051 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/msr.o 2023-11-18T19:20:18.096 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/unlink.o 2023-11-18T19:20:18.139 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/regmap/regcache.o 2023-11-18T19:20:18.236 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/wakeup.o 2023-11-18T19:20:18.503 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/rsxface.o 2023-11-18T19:20:18.505 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sysctl.o 2023-11-18T19:20:18.850 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/msr-reg.o 2023-11-18T19:20:18.930 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/lz4/built-in.a 2023-11-18T19:20:18.959 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/msr-reg-export.o 2023-11-18T19:20:18.964 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/regmap/regcache-rbtree.o 2023-11-18T19:20:19.041 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/lzo/lzo1x_compress.o 2023-11-18T19:20:19.041 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbdata.o 2023-11-18T19:20:19.137 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/hweight.o 2023-11-18T19:20:19.238 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/iomem.o 2023-11-18T19:20:19.378 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/wakeup_stats.o 2023-11-18T19:20:19.500 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/write.o 2023-11-18T19:20:19.556 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/lzo/lzo1x_decompress_safe.o 2023-11-18T19:20:19.628 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbfadt.o 2023-11-18T19:20:19.632 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/regmap/regcache-flat.o 2023-11-18T19:20:19.647 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/iomap_copy_64.o 2023-11-18T19:20:19.713 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/sysctl_net_core.o 2023-11-18T19:20:19.737 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/clear_page_64.o 2023-11-18T19:20:19.843 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/cmdline.o 2023-11-18T19:20:19.870 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/trace.o 2023-11-18T19:20:20.052 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/lzo/built-in.a 2023-11-18T19:20:20.067 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/cmpxchg16b_emu.o 2023-11-18T19:20:20.089 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sysctl_binary.o 2023-11-18T19:20:20.111 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbfind.o 2023-11-18T19:20:20.168 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/math/div64.o 2023-11-18T19:20:20.173 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/regmap/regmap-debugfs.o 2023-11-18T19:20:20.174 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/copy_page_64.o 2023-11-18T19:20:20.269 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/copy_user_64.o 2023-11-18T19:20:20.348 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/math/gcd.o 2023-11-18T19:20:20.403 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/cpu.o 2023-11-18T19:20:20.523 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/math/lcm.o 2023-11-18T19:20:20.555 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbinstal.o 2023-11-18T19:20:20.594 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/power/clock_ops.o 2023-11-18T19:20:20.670 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/math/int_pow.o 2023-11-18T19:20:20.821 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/csum-copy_64.o 2023-11-18T19:20:20.832 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/math/int_sqrt.o 2023-11-18T19:20:20.844 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/dev.o 2023-11-18T19:20:20.887 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/regmap/regmap-i2c.o 2023-11-18T19:20:20.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/csum-partial_64.o 2023-11-18T19:20:20.944 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/capability.o 2023-11-18T19:20:21.031 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/math/reciprocal_div.o 2023-11-18T19:20:21.094 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbprint.o 2023-11-18T19:20:21.225 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/base/power/built-in.a 2023-11-18T19:20:21.229 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/math/rational.o 2023-11-18T19:20:21.313 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nls/nls_base.o 2023-11-18T19:20:21.359 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/csum-wrappers_64.o 2023-11-18T19:20:21.403 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/math/built-in.a 2023-11-18T19:20:21.468 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:20:21.478 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:20:21.492 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/generic_mpih-lshift.o 2023-11-18T19:20:21.526 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/base/regmap/built-in.a 2023-11-18T19:20:21.611 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/base/test/built-in.a 2023-11-18T19:20:21.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbutils.o 2023-11-18T19:20:21.659 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/component.o 2023-11-18T19:20:21.659 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/namespace.o 2023-11-18T19:20:21.793 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/delay.o 2023-11-18T19:20:21.824 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/ptrace.o 2023-11-18T19:20:21.855 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nls/nls_cp437.o 2023-11-18T19:20:22.044 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/generic_mpih-mul1.o 2023-11-18T19:20:22.118 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbxface.o 2023-11-18T19:20:22.195 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/error-inject.o 2023-11-18T19:20:22.272 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nls/nls_ascii.o 2023-11-18T19:20:22.381 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/core.o 2023-11-18T19:20:22.607 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/generic_mpih-mul2.o 2023-11-18T19:20:22.632 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbxfload.o 2023-11-18T19:20:22.684 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nls/nls_iso8859-1.o 2023-11-18T19:20:22.752 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/getuser.o 2023-11-18T19:20:22.754 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/mount_clnt.o 2023-11-18T19:20:22.868 INFO:tasks.workunit.client.1.smithi135.stdout: GEN arch/x86/lib/inat-tables.c 2023-11-18T19:20:22.878 INFO:tasks.workunit.client.1.smithi135.stderr:awk: ./arch/x86/tools/gen-insn-attr-x86.awk:260: warning: regexp escape sequence `\:' is not a known regexp operator 2023-11-18T19:20:22.880 INFO:tasks.workunit.client.1.smithi135.stderr:awk: ./arch/x86/tools/gen-insn-attr-x86.awk:350: (FILENAME=./arch/x86/lib/x86-opcode-map.txt FNR=41) warning: regexp escape sequence `\&' is not a known regexp operator 2023-11-18T19:20:22.921 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/insn-eval.o 2023-11-18T19:20:22.939 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/user.o 2023-11-18T19:20:23.091 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nls/nls_utf8.o 2023-11-18T19:20:23.098 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/tbxfroot.o 2023-11-18T19:20:23.148 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/generic_mpih-mul3.o 2023-11-18T19:20:23.406 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/signal.o 2023-11-18T19:20:23.506 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/nls/built-in.a 2023-11-18T19:20:23.582 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utaddress.o 2023-11-18T19:20:23.642 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/dnotify/dnotify.o 2023-11-18T19:20:23.711 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/insn.o 2023-11-18T19:20:23.730 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/generic_mpih-rshift.o 2023-11-18T19:20:23.881 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfstrace.o 2023-11-18T19:20:24.021 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/kaslr.o 2023-11-18T19:20:24.055 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utalloc.o 2023-11-18T19:20:24.189 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/bus.o 2023-11-18T19:20:24.277 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/generic_mpih-sub1.o 2023-11-18T19:20:24.295 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/memcpy_64.o 2023-11-18T19:20:24.306 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/notify/dnotify/built-in.a 2023-11-18T19:20:24.396 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/notify/fanotify/built-in.a 2023-11-18T19:20:24.419 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/memmove_64.o 2023-11-18T19:20:24.453 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/inotify/inotify_fsnotify.o 2023-11-18T19:20:24.518 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utascii.o 2023-11-18T19:20:24.534 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/memset_64.o 2023-11-18T19:20:24.645 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/misc.o 2023-11-18T19:20:24.765 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/putuser.o 2023-11-18T19:20:24.838 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/generic_mpih-add1.o 2023-11-18T19:20:24.889 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/lib/retpoline.o 2023-11-18T19:20:24.963 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utbuffer.o 2023-11-18T19:20:25.019 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/inotify/inotify_user.o 2023-11-18T19:20:25.050 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/dd.o 2023-11-18T19:20:25.228 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/usercopy.o 2023-11-18T19:20:25.529 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpicoder.o 2023-11-18T19:20:25.617 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utcopy.o 2023-11-18T19:20:25.867 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sys.o 2023-11-18T19:20:26.078 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/ethtool.o 2023-11-18T19:20:26.500 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utexcep.o 2023-11-18T19:20:26.589 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/syscore.o 2023-11-18T19:20:26.672 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/export.o 2023-11-18T19:20:27.022 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpi-bit.o 2023-11-18T19:20:27.572 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/notify/inotify/built-in.a 2023-11-18T19:20:27.641 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/usercopy_64.o 2023-11-18T19:20:27.739 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utdebug.o 2023-11-18T19:20:27.884 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/fsnotify.o 2023-11-18T19:20:28.269 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utdecode.o 2023-11-18T19:20:28.279 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpi-cmp.o 2023-11-18T19:20:28.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/umh.o 2023-11-18T19:20:28.802 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/notification.o 2023-11-18T19:20:28.807 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpih-cmp.o 2023-11-18T19:20:28.848 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utdelete.o 2023-11-18T19:20:28.872 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/driver.o 2023-11-18T19:20:28.893 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/sysfs.o 2023-11-18T19:20:28.911 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/lib/inat.o 2023-11-18T19:20:28.911 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/dev_addr_lists.o 2023-11-18T19:20:29.115 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/lib/lib.a 2023-11-18T19:20:29.251 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/workqueue.o 2023-11-18T19:20:29.283 INFO:tasks.workunit.client.1.smithi135.stdout: EXPORTS arch/x86/lib/lib-ksyms.o 2023-11-18T19:20:29.364 INFO:tasks.workunit.client.1.smithi135.stdout: AR arch/x86/lib/built-in.a 2023-11-18T19:20:29.364 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpih-div.o 2023-11-18T19:20:29.365 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/uterror.o 2023-11-18T19:20:29.391 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/class.o 2023-11-18T19:20:29.437 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/dst.o 2023-11-18T19:20:29.535 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/group.o 2023-11-18T19:20:29.808 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/uteval.o 2023-11-18T19:20:29.935 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfsroot.o 2023-11-18T19:20:30.026 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/mark.o 2023-11-18T19:20:30.040 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpih-mul.o 2023-11-18T19:20:30.157 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/platform.o 2023-11-18T19:20:30.273 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utglobal.o 2023-11-18T19:20:30.281 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cdrom/cdrom.o 2023-11-18T19:20:30.692 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/netevent.o 2023-11-18T19:20:30.714 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/uthex.o 2023-11-18T19:20:30.798 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpi-pow.o 2023-11-18T19:20:30.900 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/notify/fdinfo.o 2023-11-18T19:20:31.177 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/sysctl.o 2023-11-18T19:20:31.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utids.o 2023-11-18T19:20:31.968 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/cpu.o 2023-11-18T19:20:32.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/neighbour.o 2023-11-18T19:20:32.019 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utinit.o 2023-11-18T19:20:32.044 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/mpi/mpiutil.o 2023-11-18T19:20:32.097 INFO:tasks.workunit.client.1.smithi135.stderr:fs/notify/fdinfo.c: In function ‘show_mark_fhandle’: 2023-11-18T19:20:32.097 INFO:tasks.workunit.client.1.smithi135.stderr:fs/notify/fdinfo.c:66:61: warning: array subscript ‘i’ is outside the bounds of an interior zero-length array ‘unsigned char[0]’ [-Wzero-length-bounds] 2023-11-18T19:20:32.097 INFO:tasks.workunit.client.1.smithi135.stderr: 66 | seq_printf(m, "%02x", (int)f.handle.f_handle[i]); 2023-11-18T19:20:32.097 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-11-18T19:20:32.098 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from fs/notify/fdinfo.c:3: 2023-11-18T19:20:32.098 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/fs.h:980:23: note: while referencing ‘f_handle’ 2023-11-18T19:20:32.098 INFO:tasks.workunit.client.1.smithi135.stderr: 980 | unsigned char f_handle[0]; 2023-11-18T19:20:32.098 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~ 2023-11-18T19:20:32.196 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/pid.o 2023-11-18T19:20:32.246 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/cdrom/built-in.a 2023-11-18T19:20:32.252 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/notify/built-in.a 2023-11-18T19:20:32.330 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/xz/xz_dec_syms.o 2023-11-18T19:20:32.345 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netfilter/nf_defrag_ipv4.o 2023-11-18T19:20:32.467 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utlock.o 2023-11-18T19:20:32.635 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs2super.o 2023-11-18T19:20:32.639 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/mpi/built-in.a 2023-11-18T19:20:32.726 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/xz/xz_dec_stream.o 2023-11-18T19:20:32.731 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/reboot.o 2023-11-18T19:20:32.775 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/firmware.o 2023-11-18T19:20:32.890 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utmath.o 2023-11-18T19:20:33.198 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/init.o 2023-11-18T19:20:33.228 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/task_work.o 2023-11-18T19:20:33.239 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/xz/xz_dec_lzma2.o 2023-11-18T19:20:33.326 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utmisc.o 2023-11-18T19:20:33.383 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netfilter/nf_reject_ipv4.o 2023-11-18T19:20:33.431 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/rtnetlink.o 2023-11-18T19:20:33.624 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/map.o 2023-11-18T19:20:33.638 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/proc.o 2023-11-18T19:20:33.787 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utmutex.o 2023-11-18T19:20:33.911 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/xz/xz_dec_bcj.o 2023-11-18T19:20:33.917 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/extable.o 2023-11-18T19:20:34.100 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/devres.o 2023-11-18T19:20:34.262 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utnonansi.o 2023-11-18T19:20:34.404 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/xz/built-in.a 2023-11-18T19:20:34.525 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/attribute_container.o 2023-11-18T19:20:34.527 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netfilter/ip_tables.o 2023-11-18T19:20:34.538 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_deflate/deflate.o 2023-11-18T19:20:34.697 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utobject.o 2023-11-18T19:20:34.813 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/params.o 2023-11-18T19:20:34.856 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs2xdr.o 2023-11-18T19:20:34.884 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_deflate/deftree.o 2023-11-18T19:20:35.086 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/transport_class.o 2023-11-18T19:20:35.215 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utosi.o 2023-11-18T19:20:35.220 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/route.o 2023-11-18T19:20:35.468 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_deflate/deflate_syms.o 2023-11-18T19:20:35.556 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/topology.o 2023-11-18T19:20:35.715 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utownerid.o 2023-11-18T19:20:35.805 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/kthread.o 2023-11-18T19:20:35.844 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/zlib_deflate/built-in.a 2023-11-18T19:20:35.969 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_inflate/inffast.o 2023-11-18T19:20:36.185 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utpredef.o 2023-11-18T19:20:36.194 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/container.o 2023-11-18T19:20:36.198 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netfilter/iptable_filter.o 2023-11-18T19:20:36.240 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_inflate/inflate.o 2023-11-18T19:20:36.254 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/utils.o 2023-11-18T19:20:36.320 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs3super.o 2023-11-18T19:20:36.621 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/property.o 2023-11-18T19:20:36.621 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utresdecode.o 2023-11-18T19:20:36.846 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/sys_ni.o 2023-11-18T19:20:36.882 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_inflate/infutil.o 2023-11-18T19:20:36.994 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/nsproxy.o 2023-11-18T19:20:37.019 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utresrc.o 2023-11-18T19:20:37.229 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netfilter/iptable_mangle.o 2023-11-18T19:20:37.263 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_inflate/inftrees.o 2023-11-18T19:20:37.350 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs3client.o 2023-11-18T19:20:37.438 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/link_watch.o 2023-11-18T19:20:37.475 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utstate.o 2023-11-18T19:20:37.497 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/zlib_inflate/inflate_syms.o 2023-11-18T19:20:37.694 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utstring.o 2023-11-18T19:20:37.803 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/cacheinfo.o 2023-11-18T19:20:37.823 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/notifier.o 2023-11-18T19:20:37.890 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/zlib_inflate/built-in.a 2023-11-18T19:20:38.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/lockref.o 2023-11-18T19:20:38.146 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/task_mmu.o 2023-11-18T19:20:38.173 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utstrsuppt.o 2023-11-18T19:20:38.268 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netfilter/ipt_REJECT.o 2023-11-18T19:20:38.380 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/bcd.o 2023-11-18T19:20:38.398 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs3proc.o 2023-11-18T19:20:38.506 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/filter.o 2023-11-18T19:20:38.506 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/devcon.o 2023-11-18T19:20:38.542 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/sort.o 2023-11-18T19:20:38.587 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/ksysfs.o 2023-11-18T19:20:38.620 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utstrtoul64.o 2023-11-18T19:20:38.729 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/parser.o 2023-11-18T19:20:38.993 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/swnode.o 2023-11-18T19:20:39.055 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utxface.o 2023-11-18T19:20:39.175 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/debug_locks.o 2023-11-18T19:20:39.219 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/cred.o 2023-11-18T19:20:39.318 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv4/netfilter/nf_log_arp.o 2023-11-18T19:20:39.444 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/random32.o 2023-11-18T19:20:39.451 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/inode.o 2023-11-18T19:20:39.593 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utxfinit.o 2023-11-18T19:20:39.679 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs3xdr.o 2023-11-18T19:20:39.755 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/devtmpfs.o 2023-11-18T19:20:39.923 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/bust_spinlocks.o 2023-11-18T19:20:40.038 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utxferror.o 2023-11-18T19:20:40.087 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/reboot.o 2023-11-18T19:20:40.163 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/root.o 2023-11-18T19:20:40.358 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv4/netfilter/nf_log_ipv4.o 2023-11-18T19:20:40.488 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/kasprintf.o 2023-11-18T19:20:40.510 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpica/utxfmutex.o 2023-11-18T19:20:40.635 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/node.o 2023-11-18T19:20:40.825 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/base.o 2023-11-18T19:20:40.898 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/bitmap.o 2023-11-18T19:20:40.985 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/acpi/acpica/built-in.a 2023-11-18T19:20:41.086 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/async.o 2023-11-18T19:20:41.245 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/nvs.o 2023-11-18T19:20:41.353 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs3acl.o 2023-11-18T19:20:41.486 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/module.o 2023-11-18T19:20:41.534 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv4/netfilter/iptable_nat.o 2023-11-18T19:20:41.622 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/range.o 2023-11-18T19:20:41.845 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/smpboot.o 2023-11-18T19:20:41.881 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/scatterlist.o 2023-11-18T19:20:41.916 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/wakeup.o 2023-11-18T19:20:41.938 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/base/platform-msi.o 2023-11-18T19:20:42.421 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/generic.o 2023-11-18T19:20:42.449 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/ucount.o 2023-11-18T19:20:42.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4proc.o 2023-11-18T19:20:42.487 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/sock_diag.o 2023-11-18T19:20:42.492 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/sleep.o 2023-11-18T19:20:42.531 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/base/built-in.a 2023-11-18T19:20:42.679 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/kmod.o 2023-11-18T19:20:42.693 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/ipv4/netfilter/built-in.a 2023-11-18T19:20:42.758 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/inetpeer.o 2023-11-18T19:20:42.777 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/list_sort.o 2023-11-18T19:20:42.976 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/uuid.o 2023-11-18T19:20:42.993 INFO:tasks.workunit.client.1.smithi135.stdout: AR virt/lib/built-in.a 2023-11-18T19:20:43.025 INFO:tasks.workunit.client.1.smithi135.stdout: AR virt/built-in.a 2023-11-18T19:20:43.069 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/protocol.o 2023-11-18T19:20:43.266 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/iov_iter.o 2023-11-18T19:20:43.303 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/array.o 2023-11-18T19:20:43.510 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/groups.o 2023-11-18T19:20:43.579 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/device_sysfs.o 2023-11-18T19:20:43.584 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/dev_ioctl.o 2023-11-18T19:20:43.890 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/backend.o 2023-11-18T19:20:44.078 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_input.o 2023-11-18T19:20:44.267 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/freezer.o 2023-11-18T19:20:44.278 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/fd.o 2023-11-18T19:20:44.319 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/device_pm.o 2023-11-18T19:20:44.478 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/tso.o 2023-11-18T19:20:44.660 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/frontend.o 2023-11-18T19:20:44.971 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/proc_tty.o 2023-11-18T19:20:45.028 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/profile.o 2023-11-18T19:20:45.220 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/clz_ctz.o 2023-11-18T19:20:45.377 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/proc.o 2023-11-18T19:20:45.390 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/bsearch.o 2023-11-18T19:20:45.405 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_fragment.o 2023-11-18T19:20:45.511 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/cmdline.o 2023-11-18T19:20:45.530 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/generic.o 2023-11-18T19:20:45.560 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/sock_reuseport.o 2023-11-18T19:20:45.809 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/stacktrace.o 2023-11-18T19:20:46.049 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4xdr.o 2023-11-18T19:20:46.120 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/find_bit.o 2023-11-18T19:20:46.204 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/consoles.o 2023-11-18T19:20:46.921 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/llist.o 2023-11-18T19:20:47.280 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/futex.o 2023-11-18T19:20:47.375 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/fib_notifier.o 2023-11-18T19:20:47.506 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/memweight.o 2023-11-18T19:20:47.578 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_forward.o 2023-11-18T19:20:47.624 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/cpuinfo.o 2023-11-18T19:20:47.734 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/isoch.o 2023-11-18T19:20:47.869 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/kfifo.o 2023-11-18T19:20:48.187 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/bus.o 2023-11-18T19:20:48.247 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/devices.o 2023-11-18T19:20:48.456 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/xdp.o 2023-11-18T19:20:48.519 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/compat_ioctl.o 2023-11-18T19:20:48.935 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/interrupts.o 2023-11-18T19:20:48.956 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_options.o 2023-11-18T19:20:49.035 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/percpu-refcount.o 2023-11-18T19:20:49.256 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/dma.o 2023-11-18T19:20:49.402 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/amd64-agp.o 2023-11-18T19:20:49.438 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/loadavg.o 2023-11-18T19:20:49.501 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/glue.o 2023-11-18T19:20:49.546 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/rhashtable.o 2023-11-18T19:20:49.736 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/smp.o 2023-11-18T19:20:49.922 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/flow_offload.o 2023-11-18T19:20:49.986 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/meminfo.o 2023-11-18T19:20:50.031 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4state.o 2023-11-18T19:20:50.219 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/intel-agp.o 2023-11-18T19:20:50.253 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/scan.o 2023-11-18T19:20:50.290 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_output.o 2023-11-18T19:20:50.400 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/uid16.o 2023-11-18T19:20:50.617 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/once.o 2023-11-18T19:20:50.710 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/stat.o 2023-11-18T19:20:51.000 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/agp/intel-gtt.o 2023-11-18T19:20:51.077 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/refcount.o 2023-11-18T19:20:51.173 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/net-sysfs.o 2023-11-18T19:20:51.302 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/module.o 2023-11-18T19:20:51.337 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/uptime.o 2023-11-18T19:20:51.446 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/usercopy.o 2023-11-18T19:20:51.501 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/resource.o 2023-11-18T19:20:51.650 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:20:51.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:20:51.840 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4renewd.o 2023-11-18T19:20:51.857 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/util.o 2023-11-18T19:20:51.860 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/errseq.o 2023-11-18T19:20:51.989 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/char/agp/built-in.a 2023-11-18T19:20:52.083 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/bucket_locks.o 2023-11-18T19:20:52.091 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/hw_random/core.o 2023-11-18T19:20:52.242 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_sockglue.o 2023-11-18T19:20:52.249 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_processor.o 2023-11-18T19:20:52.313 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/version.o 2023-11-18T19:20:52.649 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/generic-radix-tree.o 2023-11-18T19:20:52.701 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/net-procfs.o 2023-11-18T19:20:52.788 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/softirqs.o 2023-11-18T19:20:52.847 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/hw_random/via-rng.o 2023-11-18T19:20:52.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4super.o 2023-11-18T19:20:53.047 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/processor_core.o 2023-11-18T19:20:53.262 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/namespaces.o 2023-11-18T19:20:53.294 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/char/hw_random/built-in.a 2023-11-18T19:20:53.362 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/string_helpers.o 2023-11-18T19:20:53.415 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/char/pcmcia/built-in.a 2023-11-18T19:20:53.462 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/mem.o 2023-11-18T19:20:53.582 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/netpoll.o 2023-11-18T19:20:53.611 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/kallsyms.o 2023-11-18T19:20:53.676 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/processor_pdc.o 2023-11-18T19:20:53.850 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/inet_hashtables.o 2023-11-18T19:20:54.001 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/self.o 2023-11-18T19:20:54.035 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4file.o 2023-11-18T19:20:54.079 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/hexdump.o 2023-11-18T19:20:54.269 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/ec.o 2023-11-18T19:20:54.358 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/random.o 2023-11-18T19:20:54.379 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/kstrtox.o 2023-11-18T19:20:54.576 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/thread_self.o 2023-11-18T19:20:54.623 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/if_ether.h:19, 2023-11-18T19:20:54.623 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/uapi/linux/ethtool.h:19, 2023-11-18T19:20:54.623 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/ethtool.h:18, 2023-11-18T19:20:54.623 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/netdevice.h:37, 2023-11-18T19:20:54.623 INFO:tasks.workunit.client.1.smithi135.stderr: from net/core/netpoll.c:17: 2023-11-18T19:20:54.623 INFO:tasks.workunit.client.1.smithi135.stderr:net/core/netpoll.c: In function ‘refill_skbs’: 2023-11-18T19:20:54.624 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:20:54.624 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:20:54.624 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:20:54.624 INFO:tasks.workunit.client.1.smithi135.stderr:net/core/netpoll.c:48:28: note: while referencing ‘skb_pool’ 2023-11-18T19:20:54.624 INFO:tasks.workunit.client.1.smithi135.stderr: 48 | static struct sk_buff_head skb_pool; 2023-11-18T19:20:54.624 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~ 2023-11-18T19:20:54.642 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/acct.o 2023-11-18T19:20:54.985 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/iomap.o 2023-11-18T19:20:55.002 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/fib_rules.o 2023-11-18T19:20:55.133 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/proc_sysctl.o 2023-11-18T19:20:55.294 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/delegation.o 2023-11-18T19:20:55.321 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/inet_timewait_sock.o 2023-11-18T19:20:55.496 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/dock.o 2023-11-18T19:20:55.552 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/crash_core.o 2023-11-18T19:20:55.787 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/pci_iomap.o 2023-11-18T19:20:56.211 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/kexec_core.o 2023-11-18T19:20:56.220 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/pci_root.o 2023-11-18T19:20:56.282 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/proc_net.o 2023-11-18T19:20:56.349 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/misc.o 2023-11-18T19:20:56.457 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/iomap_copy.o 2023-11-18T19:20:56.486 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/inet_connection_sock.o 2023-11-18T19:20:56.543 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/net-traces.o 2023-11-18T19:20:56.739 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/devres.o 2023-11-18T19:20:56.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/hpet.o 2023-11-18T19:20:56.955 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4idmap.o 2023-11-18T19:20:57.059 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/kcore.o 2023-11-18T19:20:57.107 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/pci_link.o 2023-11-18T19:20:57.365 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/kexec.o 2023-11-18T19:20:57.451 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/check_signature.o 2023-11-18T19:20:57.727 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/logic_pio.o 2023-11-18T19:20:57.812 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/char/nvram.o 2023-11-18T19:20:57.870 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/vmcore.o 2023-11-18T19:20:57.918 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/pci_irq.o 2023-11-18T19:20:58.031 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp.o 2023-11-18T19:20:58.118 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/compat.o 2023-11-18T19:20:58.323 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/interval_tree.o 2023-11-18T19:20:58.441 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/callback.o 2023-11-18T19:20:58.587 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/char/built-in.a 2023-11-18T19:20:58.662 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/assoc_array.o 2023-11-18T19:20:58.697 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_lpss.o 2023-11-18T19:20:58.757 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/ip6_tables.o 2023-11-18T19:20:58.822 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/kmsg.o 2023-11-18T19:20:58.972 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/ptp_classifier.o 2023-11-18T19:20:58.984 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/utsname.o 2023-11-18T19:20:59.334 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc/page.o 2023-11-18T19:20:59.615 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/bitrev.o 2023-11-18T19:20:59.744 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/pid_namespace.o 2023-11-18T19:20:59.766 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/callback_xdr.o 2023-11-18T19:20:59.788 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_apd.o 2023-11-18T19:20:59.799 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/dst_cache.o 2023-11-18T19:21:00.138 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/crc-ccitt.o 2023-11-18T19:21:00.162 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/proc/built-in.a 2023-11-18T19:21:00.306 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/callback_proc.o 2023-11-18T19:21:00.334 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/ip6table_filter.o 2023-11-18T19:21:00.431 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_input.o 2023-11-18T19:21:01.322 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/crc16.o 2023-11-18T19:21:01.322 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_platform.o 2023-11-18T19:21:01.340 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/ip6table_mangle.o 2023-11-18T19:21:01.347 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/stop_machine.o 2023-11-18T19:21:01.354 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/core/gro_cells.o 2023-11-18T19:21:01.359 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4namespace.o 2023-11-18T19:21:01.385 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/main.o 2023-11-18T19:21:01.716 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC lib/gen_crc32table 2023-11-18T19:21:01.888 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/genalloc.o 2023-11-18T19:21:01.938 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/if_ether.h:19, 2023-11-18T19:21:01.938 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/uapi/linux/ethtool.h:19, 2023-11-18T19:21:01.938 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/ethtool.h:18, 2023-11-18T19:21:01.939 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/netdevice.h:37, 2023-11-18T19:21:01.939 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/net/dst.h:13, 2023-11-18T19:21:01.939 INFO:tasks.workunit.client.1.smithi135.stderr: from net/ipv4/tcp_input.c:73: 2023-11-18T19:21:01.939 INFO:tasks.workunit.client.1.smithi135.stderr:net/ipv4/tcp_input.c: In function ‘tcp_collapse’: 2023-11-18T19:21:01.942 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:21:01.942 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:01.942 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:01.942 INFO:tasks.workunit.client.1.smithi135.stderr:net/ipv4/tcp_input.c:4911:29: note: while referencing ‘tmp’ 2023-11-18T19:21:01.943 INFO:tasks.workunit.client.1.smithi135.stderr: 4911 | struct sk_buff_head tmp; 2023-11-18T19:21:01.943 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~ 2023-11-18T19:21:02.047 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_pnp.o 2023-11-18T19:21:02.102 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/audit.o 2023-11-18T19:21:02.175 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/core/built-in.a 2023-11-18T19:21:02.425 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/char/ipmi/built-in.a 2023-11-18T19:21:03.093 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/actions/built-in.a 2023-11-18T19:21:03.096 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/power.o 2023-11-18T19:21:03.141 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/nf_defrag_ipv6_hooks.o 2023-11-18T19:21:03.169 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/analogbits/built-in.a 2023-11-18T19:21:03.201 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4getroot.o 2023-11-18T19:21:03.231 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/bcm/built-in.a 2023-11-18T19:21:03.249 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/percpu_counter.o 2023-11-18T19:21:03.272 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/imgtec/built-in.a 2023-11-18T19:21:03.324 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/imx/built-in.a 2023-11-18T19:21:03.369 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/ingenic/built-in.a 2023-11-18T19:21:03.414 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/mediatek/built-in.a 2023-11-18T19:21:03.462 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/mvebu/built-in.a 2023-11-18T19:21:03.513 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/renesas/built-in.a 2023-11-18T19:21:03.563 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/ti/built-in.a 2023-11-18T19:21:03.700 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/x86/clk-pmc-atom.o 2023-11-18T19:21:03.926 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/status.o 2023-11-18T19:21:03.979 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_output.o 2023-11-18T19:21:04.036 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/iommu-helper.o 2023-11-18T19:21:04.178 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/auditfilter.o 2023-11-18T19:21:04.214 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/event.o 2023-11-18T19:21:04.214 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/error-inject.o 2023-11-18T19:21:04.366 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4client.o 2023-11-18T19:21:04.394 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/nf_conntrack_reasm.o 2023-11-18T19:21:04.412 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/x86/built-in.a 2023-11-18T19:21:04.527 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-devres.o 2023-11-18T19:21:04.873 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/syscall.o 2023-11-18T19:21:04.996 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-bulk.o 2023-11-18T19:21:05.014 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/sysfs.o 2023-11-18T19:21:05.449 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/nlattr.o 2023-11-18T19:21:05.533 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clkdev.o 2023-11-18T19:21:05.589 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/auditsc.o 2023-11-18T19:21:05.621 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4session.o 2023-11-18T19:21:05.630 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/nf_reject_ipv6.o 2023-11-18T19:21:05.782 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/property.o 2023-11-18T19:21:05.890 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/driver-ops.o 2023-11-18T19:21:06.929 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/cpu_rmap.o 2023-11-18T19:21:07.003 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_timer.o 2023-11-18T19:21:07.066 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/ip6t_ipv6header.o 2023-11-18T19:21:07.080 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk.o 2023-11-18T19:21:07.150 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_cmos_rtc.o 2023-11-18T19:21:07.408 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/dynamic_queue_limits.o 2023-11-18T19:21:07.449 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/dns_resolve.o 2023-11-18T19:21:07.718 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/glob.o 2023-11-18T19:21:07.719 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/x86/apple.o 2023-11-18T19:21:07.746 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/audit_watch.o 2023-11-18T19:21:08.114 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/strncpy_from_user.o 2023-11-18T19:21:08.179 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter/ip6t_REJECT.o 2023-11-18T19:21:08.309 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_ipv4.o 2023-11-18T19:21:08.330 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/x86/utils.o 2023-11-18T19:21:08.444 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4trace.o 2023-11-18T19:21:08.496 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/sta_info.o 2023-11-18T19:21:08.609 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/audit_fsnotify.o 2023-11-18T19:21:08.664 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/strnlen_user.o 2023-11-18T19:21:08.871 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/debugfs.o 2023-11-18T19:21:09.228 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/net_utils.o 2023-11-18T19:21:09.271 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv6/netfilter/nf_log_ipv6.o 2023-11-18T19:21:09.341 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/audit_tree.o 2023-11-18T19:21:09.397 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-divider.o 2023-11-18T19:21:09.414 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/numa.o 2023-11-18T19:21:09.862 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/sg_pool.o 2023-11-18T19:21:10.059 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-fixed-factor.o 2023-11-18T19:21:10.140 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_lpat.o 2023-11-18T19:21:10.393 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/kprobes.o 2023-11-18T19:21:10.438 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/if_ether.h:19, 2023-11-18T19:21:10.438 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/etherdevice.h:20, 2023-11-18T19:21:10.438 INFO:tasks.workunit.client.1.smithi135.stderr: from net/mac80211/sta_info.c:12: 2023-11-18T19:21:10.439 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/sta_info.c: In function ‘ieee80211_sta_ps_deliver_response’: 2023-11-18T19:21:10.439 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:21:10.439 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:10.439 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:10.439 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/sta_info.c:1561:29: note: while referencing ‘frames’ 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr: 1561 | struct sk_buff_head frames; 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~ 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/if_ether.h:19, 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/etherdevice.h:20, 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr: from net/mac80211/sta_info.c:12: 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:10.440 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/sta_info.c:1604:37: note: while referencing ‘pending’ 2023-11-18T19:21:10.441 INFO:tasks.workunit.client.1.smithi135.stderr: 1604 | struct sk_buff_head pending; 2023-11-18T19:21:10.441 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~ 2023-11-18T19:21:10.450 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/ipv6/netfilter/built-in.a 2023-11-18T19:21:10.475 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/asn1_decoder.o 2023-11-18T19:21:10.581 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_minisocks.o 2023-11-18T19:21:10.592 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/af_inet6.o 2023-11-18T19:21:10.600 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-fixed-rate.o 2023-11-18T19:21:10.736 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nfs/nfs4sysctl.o 2023-11-18T19:21:10.770 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_lpit.o 2023-11-18T19:21:11.021 INFO:tasks.workunit.client.1.smithi135.stdout: GEN lib/oid_registry_data.c 2023-11-18T19:21:11.090 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-gate.o 2023-11-18T19:21:11.138 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/ucs2_string.o 2023-11-18T19:21:11.172 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/wep.o 2023-11-18T19:21:11.359 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/ac.o 2023-11-18T19:21:11.553 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-multiplier.o 2023-11-18T19:21:11.584 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/sbitmap.o 2023-11-18T19:21:11.756 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/seccomp.o 2023-11-18T19:21:11.788 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/nfs/built-in.a 2023-11-18T19:21:11.928 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/quota/dquot.o 2023-11-18T19:21:11.929 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_cong.o 2023-11-18T19:21:12.005 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/button.o 2023-11-18T19:21:12.019 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-mux.o 2023-11-18T19:21:12.050 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/anycast.o 2023-11-18T19:21:12.319 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/aead_api.o 2023-11-18T19:21:12.392 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/argv_split.o 2023-11-18T19:21:12.527 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-composite.o 2023-11-18T19:21:12.723 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/fan.o 2023-11-18T19:21:12.774 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/bug.o 2023-11-18T19:21:12.930 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/wpa.o 2023-11-18T19:21:13.034 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-fractional-divider.o 2023-11-18T19:21:13.128 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/relay.o 2023-11-18T19:21:13.165 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_metrics.o 2023-11-18T19:21:13.232 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/chacha.o 2023-11-18T19:21:13.254 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ip6_output.o 2023-11-18T19:21:13.394 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_video.o 2023-11-18T19:21:13.581 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clk/clk-gpio.o 2023-11-18T19:21:13.600 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/quota/quota_v2.o 2023-11-18T19:21:13.697 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/clz_tab.o 2023-11-18T19:21:13.803 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/cmdline.o 2023-11-18T19:21:14.037 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/cpumask.o 2023-11-18T19:21:14.076 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/utsname_sysctl.o 2023-11-18T19:21:14.188 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clk/built-in.a 2023-11-18T19:21:14.234 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/quota/quota_tree.o 2023-11-18T19:21:14.306 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/ctype.o 2023-11-18T19:21:14.462 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/scan.o 2023-11-18T19:21:14.469 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/core.o 2023-11-18T19:21:14.469 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/delayacct.o 2023-11-18T19:21:14.599 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_fastopen.o 2023-11-18T19:21:14.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/dec_and_lock.o 2023-11-18T19:21:14.655 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/video_detect.o 2023-11-18T19:21:14.921 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/decompress.o 2023-11-18T19:21:14.974 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/taskstats.o 2023-11-18T19:21:15.034 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/quota/quota.o 2023-11-18T19:21:15.078 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/decompress_bunzip2.o 2023-11-18T19:21:15.349 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/processor_driver.o 2023-11-18T19:21:15.524 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ip6_input.o 2023-11-18T19:21:15.749 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/decompress_inflate.o 2023-11-18T19:21:15.778 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_log.o 2023-11-18T19:21:15.837 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_rate.o 2023-11-18T19:21:15.898 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/tsacct.o 2023-11-18T19:21:16.652 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/decompress_unlz4.o 2023-11-18T19:21:16.671 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/quota/kqid.o 2023-11-18T19:21:16.836 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/processor_idle.o 2023-11-18T19:21:16.961 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/tracepoint.o 2023-11-18T19:21:17.005 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/offchannel.o 2023-11-18T19:21:17.209 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/quota/compat.o 2023-11-18T19:21:17.244 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/decompress_unlzma.o 2023-11-18T19:21:17.331 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_recovery.o 2023-11-18T19:21:17.443 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/addrconf.o 2023-11-18T19:21:17.531 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_queue.o 2023-11-18T19:21:17.603 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/elfcore.o 2023-11-18T19:21:17.810 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/processor_throttling.o 2023-11-18T19:21:17.896 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/decompress_unlzo.o 2023-11-18T19:21:17.909 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/quota/netlink.o 2023-11-18T19:21:18.147 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/irq_work.o 2023-11-18T19:21:18.415 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_ulp.o 2023-11-18T19:21:18.429 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/decompress_unxz.o 2023-11-18T19:21:18.642 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/quota/built-in.a 2023-11-18T19:21:18.652 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/processor_thermal.o 2023-11-18T19:21:18.655 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/crash_dump.o 2023-11-18T19:21:18.723 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_sockopt.o 2023-11-18T19:21:18.751 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ramfs/inode.o 2023-11-18T19:21:18.922 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/ht.o 2023-11-18T19:21:18.926 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/dump_stack.o 2023-11-18T19:21:19.242 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/jump_label.o 2023-11-18T19:21:19.275 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/processor_perflib.o 2023-11-18T19:21:19.495 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ramfs/file-mmu.o 2023-11-18T19:21:19.560 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_offload.o 2023-11-18T19:21:19.571 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/earlycpio.o 2023-11-18T19:21:19.705 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/utils.o 2023-11-18T19:21:19.767 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/extable.o 2023-11-18T19:21:19.977 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/iomem.o 2023-11-18T19:21:20.020 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/ramfs/built-in.a 2023-11-18T19:21:20.078 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/container.o 2023-11-18T19:21:20.110 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/sysfs/file.o 2023-11-18T19:21:20.204 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/flex_proportions.o 2023-11-18T19:21:20.592 INFO:tasks.workunit.client.1.smithi135.stdout: CC kernel/rseq.o 2023-11-18T19:21:20.634 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/agg-tx.o 2023-11-18T19:21:20.643 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/addrlabel.o 2023-11-18T19:21:20.665 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/idr.o 2023-11-18T19:21:20.672 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/thermal.o 2023-11-18T19:21:20.762 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/sysfs/dir.o 2023-11-18T19:21:20.776 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/datagram.o 2023-11-18T19:21:20.808 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nfnetlink.o 2023-11-18T19:21:21.282 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/sysfs/symlink.o 2023-11-18T19:21:21.289 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/ioremap.o 2023-11-18T19:21:21.497 INFO:tasks.workunit.client.1.smithi135.stdout: AR kernel/built-in.a 2023-11-18T19:21:21.548 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/acpi_memhotplug.o 2023-11-18T19:21:21.698 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/sysfs/mount.o 2023-11-18T19:21:21.823 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/route.o 2023-11-18T19:21:21.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:21:21.855 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:21:21.871 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/raw.o 2023-11-18T19:21:21.878 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/agg-rx.o 2023-11-18T19:21:21.959 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/irq_regs.o 2023-11-18T19:21:22.010 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nfnetlink_log.o 2023-11-18T19:21:22.084 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/ioapic.o 2023-11-18T19:21:22.252 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/is_single_threaded.o 2023-11-18T19:21:22.410 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/sysfs/group.o 2023-11-18T19:21:22.547 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/tracefs/inode.o 2023-11-18T19:21:22.671 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/klist.o 2023-11-18T19:21:23.679 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/sysfs/built-in.a 2023-11-18T19:21:23.880 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/battery.o 2023-11-18T19:21:23.887 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_core.o 2023-11-18T19:21:23.910 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/udp.o 2023-11-18T19:21:23.945 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/kobject.o 2023-11-18T19:21:24.039 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/tracefs/built-in.a 2023-11-18T19:21:24.041 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/udplite.o 2023-11-18T19:21:24.095 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/open.o 2023-11-18T19:21:24.192 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/vht.o 2023-11-18T19:21:24.668 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/kobject_uevent.o 2023-11-18T19:21:25.250 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/bgrt.o 2023-11-18T19:21:25.358 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clocksource/acpi_pm.o 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr:net/netfilter/nf_conntrack_core.c: In function ‘__nf_conntrack_alloc.constprop’: 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr:net/netfilter/nf_conntrack_core.c:1384:16: warning: array subscript 0 is outside the bounds of an interior zero-length array ‘u8[0]’ {aka ‘unsigned char[]’} [-Wzero-length-bounds] 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr: 1384 | memset(&ct->__nfct_init_offset[0], 0, 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from net/netfilter/nf_conntrack_core.c:37: 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr:./include/net/netfilter/nf_conntrack.h:90:12: note: while referencing ‘__nfct_init_offset’ 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr: 90 | u8 __nfct_init_offset[0]; 2023-11-18T19:21:25.622 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:25.667 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/read_write.o 2023-11-18T19:21:25.828 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/cppc_acpi.o 2023-11-18T19:21:25.838 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ip6_fib.o 2023-11-18T19:21:26.257 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/memcat_p.o 2023-11-18T19:21:26.354 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/clocksource/i8253.o 2023-11-18T19:21:26.639 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/he.o 2023-11-18T19:21:26.913 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/nmi_backtrace.o 2023-11-18T19:21:26.943 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/clocksource/built-in.a 2023-11-18T19:21:26.998 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_standalone.o 2023-11-18T19:21:27.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/udp_offload.o 2023-11-18T19:21:27.147 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_user.o 2023-11-18T19:21:27.251 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/acpi/spcr.o 2023-11-18T19:21:27.537 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/nodemask.o 2023-11-18T19:21:27.826 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/ibss.o 2023-11-18T19:21:27.884 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/acpi/built-in.a 2023-11-18T19:21:27.927 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/file_table.o 2023-11-18T19:21:27.927 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ipv6_sockglue.o 2023-11-18T19:21:27.975 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/plist.o 2023-11-18T19:21:28.133 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/connector/cn_queue.o 2023-11-18T19:21:28.182 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/radix-tree.o 2023-11-18T19:21:28.185 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_kapi.o 2023-11-18T19:21:28.215 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_expect.o 2023-11-18T19:21:28.247 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/arp.o 2023-11-18T19:21:28.783 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/super.o 2023-11-18T19:21:29.062 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/ratelimit.o 2023-11-18T19:21:29.143 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/connector/connector.o 2023-11-18T19:21:29.432 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/rbtree.o 2023-11-18T19:21:29.468 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_domainhash.o 2023-11-18T19:21:29.550 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ndisc.o 2023-11-18T19:21:29.619 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_helper.o 2023-11-18T19:21:29.737 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/icmp.o 2023-11-18T19:21:29.894 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/seq_buf.o 2023-11-18T19:21:29.940 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/iface.o 2023-11-18T19:21:30.063 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/char_dev.o 2023-11-18T19:21:30.205 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/connector/cn_proc.o 2023-11-18T19:21:30.434 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/sha1.o 2023-11-18T19:21:30.741 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_addrlist.o 2023-11-18T19:21:30.819 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/show_mem.o 2023-11-18T19:21:30.943 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/stat.o 2023-11-18T19:21:30.989 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_proto.o 2023-11-18T19:21:31.219 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/devinet.o 2023-11-18T19:21:31.278 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/connector/built-in.a 2023-11-18T19:21:31.360 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/udp.o 2023-11-18T19:21:31.361 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/cpufreq.o 2023-11-18T19:21:31.371 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/siphash.o 2023-11-18T19:21:31.826 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_mgmt.o 2023-11-18T19:21:31.916 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/exec.o 2023-11-18T19:21:31.916 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/string.o 2023-11-18T19:21:32.321 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/rate.o 2023-11-18T19:21:32.535 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_proto_generic.o 2023-11-18T19:21:32.897 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/timerqueue.o 2023-11-18T19:21:33.018 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/freq_table.o 2023-11-18T19:21:33.038 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_unlabeled.o 2023-11-18T19:21:33.109 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/af_inet.o 2023-11-18T19:21:33.297 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/udplite.o 2023-11-18T19:21:33.444 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/vsprintf.o 2023-11-18T19:21:33.538 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/cpufreq_performance.o 2023-11-18T19:21:33.556 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/pipe.o 2023-11-18T19:21:34.231 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_proto_tcp.o 2023-11-18T19:21:34.232 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/cpufreq_userspace.o 2023-11-18T19:21:34.245 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/raw.o 2023-11-18T19:21:34.258 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_cipso_v4.o 2023-11-18T19:21:34.282 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/michael.o 2023-11-18T19:21:34.585 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/namei.o 2023-11-18T19:21:34.720 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/igmp.o 2023-11-18T19:21:34.754 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/cpufreq_ondemand.o 2023-11-18T19:21:35.071 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/tkip.o 2023-11-18T19:21:35.313 INFO:tasks.workunit.client.1.smithi135.stderr:lib/vsprintf.c: In function ‘vsnprintf’: 2023-11-18T19:21:35.314 INFO:tasks.workunit.client.1.smithi135.stderr:lib/vsprintf.c:2585:33: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:21:35.314 INFO:tasks.workunit.client.1.smithi135.stderr: 2585 | end[-1] = '\0'; 2023-11-18T19:21:35.314 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~^~~~~~ 2023-11-18T19:21:35.315 INFO:tasks.workunit.client.1.smithi135.stderr:lib/vsprintf.c:2440:21: note: at offset [-9223372036854775808, 9223372036854775806] into destination object ‘buf’ of size [0, 9223372036854775807] 2023-11-18T19:21:35.315 INFO:tasks.workunit.client.1.smithi135.stderr: 2440 | int vsnprintf(char *buf, size_t size, const char *fmt, va_list args) 2023-11-18T19:21:35.315 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:21:35.442 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/cpufreq_governor.o 2023-11-18T19:21:35.452 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlabel/netlabel_calipso.o 2023-11-18T19:21:35.465 INFO:tasks.workunit.client.1.smithi135.stderr:lib/vsprintf.c: In function ‘bstr_printf’: 2023-11-18T19:21:35.466 INFO:tasks.workunit.client.1.smithi135.stderr:lib/vsprintf.c:3083:33: warning: writing 1 byte into a region of size 0 [-Wstringop-overflow=] 2023-11-18T19:21:35.466 INFO:tasks.workunit.client.1.smithi135.stderr: 3083 | end[-1] = '\0'; 2023-11-18T19:21:35.466 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~^~~~~~ 2023-11-18T19:21:35.466 INFO:tasks.workunit.client.1.smithi135.stderr:lib/vsprintf.c:2903:23: note: at offset [-9223372036854775808, 9223372036854775806] into destination object ‘buf’ of size [0, 9223372036854775807] 2023-11-18T19:21:35.467 INFO:tasks.workunit.client.1.smithi135.stderr: 2903 | int bstr_printf(char *buf, size_t size, const char *fmt, const u32 *bin_buf) 2023-11-18T19:21:35.467 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~^~~ 2023-11-18T19:21:35.687 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_proto_udp.o 2023-11-18T19:21:35.754 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/win_minmax.o 2023-11-18T19:21:35.853 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/icmp.o 2023-11-18T19:21:36.139 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/cpufreq_governor_attr_set.o 2023-11-18T19:21:36.171 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/xarray.o 2023-11-18T19:21:36.585 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/netlabel/built-in.a 2023-11-18T19:21:36.639 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/acpi-cpufreq.o 2023-11-18T19:21:36.655 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/mcast.o 2023-11-18T19:21:36.795 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_proto_icmp.o 2023-11-18T19:21:36.839 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/aes_cmac.o 2023-11-18T19:21:36.847 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/fib_frontend.o 2023-11-18T19:21:37.205 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fcntl.o 2023-11-18T19:21:37.244 INFO:tasks.workunit.client.1.smithi135.stdout: GEN lib/crc32table.h 2023-11-18T19:21:37.265 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/oid_registry.o 2023-11-18T19:21:37.311 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_extend.o 2023-11-18T19:21:37.494 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpufreq/intel_pstate.o 2023-11-18T19:21:37.685 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/lib.a 2023-11-18T19:21:37.873 INFO:tasks.workunit.client.1.smithi135.stdout: CC lib/crc32.o 2023-11-18T19:21:37.889 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/aes_gmac.o 2023-11-18T19:21:37.948 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/reassembly.o 2023-11-18T19:21:38.147 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/ioctl.o 2023-11-18T19:21:38.405 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_acct.o 2023-11-18T19:21:38.422 INFO:tasks.workunit.client.1.smithi135.stdout: EXPORTS lib/lib-ksyms.o 2023-11-18T19:21:38.435 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/fib_semantics.o 2023-11-18T19:21:38.511 INFO:tasks.workunit.client.1.smithi135.stdout: AR lib/built-in.a 2023-11-18T19:21:38.707 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlink/af_netlink.o 2023-11-18T19:21:38.862 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netlink/genetlink.o 2023-11-18T19:21:38.975 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/fils_aead.o 2023-11-18T19:21:39.010 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/cpufreq/built-in.a 2023-11-18T19:21:39.034 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/readdir.o 2023-11-18T19:21:39.094 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpuidle/governors/menu.o 2023-11-18T19:21:39.235 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/tcp_ipv6.o 2023-11-18T19:21:39.467 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_seqadj.o 2023-11-18T19:21:39.617 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/cpuidle/governors/built-in.a 2023-11-18T19:21:39.682 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpuidle/cpuidle.o 2023-11-18T19:21:39.933 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/select.o 2023-11-18T19:21:40.153 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/cfg.o 2023-11-18T19:21:40.246 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ping.o 2023-11-18T19:21:40.343 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/fib_trie.o 2023-11-18T19:21:40.648 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_proto_icmpv6.o 2023-11-18T19:21:40.738 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpuidle/driver.o 2023-11-18T19:21:40.756 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/netlink/built-in.a 2023-11-18T19:21:40.838 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpuidle/governor.o 2023-11-18T19:21:41.581 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/packet/af_packet.o 2023-11-18T19:21:41.616 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpuidle/sysfs.o 2023-11-18T19:21:41.690 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/crypto/hisilicon/built-in.a 2023-11-18T19:21:41.769 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/crypto/built-in.a 2023-11-18T19:21:41.801 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/exthdrs.o 2023-11-18T19:21:41.816 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/fib_notifier.o 2023-11-18T19:21:41.863 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/dcache.o 2023-11-18T19:21:42.168 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_netlink.o 2023-11-18T19:21:42.229 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/cpuidle/poll_state.o 2023-11-18T19:21:42.577 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/rfkill/core.o 2023-11-18T19:21:42.642 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/cpuidle/built-in.a 2023-11-18T19:21:42.731 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma/dw/core.o 2023-11-18T19:21:42.820 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/inet_fragment.o 2023-11-18T19:21:43.781 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/datagram.o 2023-11-18T19:21:44.041 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/ethtool.o 2023-11-18T19:21:44.107 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/inode.o 2023-11-18T19:21:44.166 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma/dw/dw.o 2023-11-18T19:21:44.201 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/rfkill/input.o 2023-11-18T19:21:44.226 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/packet/built-in.a 2023-11-18T19:21:44.447 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/attr.o 2023-11-18T19:21:44.565 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_ftp.o 2023-11-18T19:21:44.653 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ping.o 2023-11-18T19:21:44.803 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma/dw/idma32.o 2023-11-18T19:21:44.950 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/rfkill/built-in.a 2023-11-18T19:21:45.166 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma-buf/dma-buf.o 2023-11-18T19:21:45.362 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma/hsu/hsu.o 2023-11-18T19:21:45.412 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ip6_flowlabel.o 2023-11-18T19:21:45.647 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma/dw/built-in.a 2023-11-18T19:21:45.719 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/sch_generic.o 2023-11-18T19:21:45.977 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/bad_inode.o 2023-11-18T19:21:46.070 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/rx.o 2023-11-18T19:21:46.090 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_irc.o 2023-11-18T19:21:46.181 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma-buf/dma-fence.o 2023-11-18T19:21:46.217 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma/hsu/built-in.a 2023-11-18T19:21:46.274 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_tunnel_core.o 2023-11-18T19:21:46.282 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma/mediatek/built-in.a 2023-11-18T19:21:46.327 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma/qcom/built-in.a 2023-11-18T19:21:46.372 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma/ti/built-in.a 2023-11-18T19:21:46.420 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma/xilinx/built-in.a 2023-11-18T19:21:46.468 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma/dmaengine.o 2023-11-18T19:21:46.490 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/file.o 2023-11-18T19:21:46.751 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/inet6_connection_sock.o 2023-11-18T19:21:47.193 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma-buf/dma-fence-array.o 2023-11-18T19:21:47.198 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_conntrack_sip.o 2023-11-18T19:21:47.446 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/gre_offload.o 2023-11-18T19:21:47.483 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/filesystems.o 2023-11-18T19:21:47.547 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma/virt-dma.o 2023-11-18T19:21:47.551 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/sch_mq.o 2023-11-18T19:21:47.693 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma-buf/dma-fence-chain.o 2023-11-18T19:21:47.822 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/udp_offload.o 2023-11-18T19:21:48.194 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma/acpi-dma.o 2023-11-18T19:21:48.208 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma-buf/dma-resv.o 2023-11-18T19:21:48.250 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/namespace.o 2023-11-18T19:21:48.508 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/sch_api.o 2023-11-18T19:21:48.602 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/metrics.o 2023-11-18T19:21:48.681 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from net/mac80211/rx.c:15: 2023-11-18T19:21:48.681 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/rx.c: In function ‘ieee80211_prepare_and_rx_handle’: 2023-11-18T19:21:48.681 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:21:48.681 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:48.681 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:48.682 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/rx.c:3680:29: note: while referencing ‘reorder_release’ 2023-11-18T19:21:48.682 INFO:tasks.workunit.client.1.smithi135.stderr: 3680 | struct sk_buff_head reorder_release; 2023-11-18T19:21:48.682 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~ 2023-11-18T19:21:48.905 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma-buf/seqno-fence.o 2023-11-18T19:21:48.913 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_nat_core.o 2023-11-18T19:21:48.935 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/seg6.o 2023-11-18T19:21:48.959 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma/built-in.a 2023-11-18T19:21:49.093 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/seq_file.o 2023-11-18T19:21:49.238 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/spectmgmt.o 2023-11-18T19:21:49.491 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/dma-buf/sync_file.o 2023-11-18T19:21:49.709 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netlink.o 2023-11-18T19:21:49.976 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/fib6_notifier.o 2023-11-18T19:21:50.071 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_gss/auth_gss.o 2023-11-18T19:21:50.194 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/dma-buf/built-in.a 2023-11-18T19:21:50.281 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/edac_mc.o 2023-11-18T19:21:50.377 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/tx.o 2023-11-18T19:21:50.436 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_nat_proto.o 2023-11-18T19:21:50.461 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/sch_blackhole.o 2023-11-18T19:21:50.471 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/xattr.o 2023-11-18T19:21:50.683 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/nexthop.o 2023-11-18T19:21:50.982 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/sysctl_net_ipv6.o 2023-11-18T19:21:51.292 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/cls_api.o 2023-11-18T19:21:51.318 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/edac_device.o 2023-11-18T19:21:51.557 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/libfs.o 2023-11-18T19:21:51.833 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_nat_helper.o 2023-11-18T19:21:51.855 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_gss/gss_generic_token.o 2023-11-18T19:21:52.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/xfrm6_policy.o 2023-11-18T19:21:52.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:21:52.059 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:21:52.095 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/edac_mc_sysfs.o 2023-11-18T19:21:52.324 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ip_tunnel.o 2023-11-18T19:21:52.585 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_gss/gss_mech_switch.o 2023-11-18T19:21:52.741 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fs-writeback.o 2023-11-18T19:21:52.946 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/edac_module.o 2023-11-18T19:21:53.020 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_nat_masquerade.o 2023-11-18T19:21:53.116 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/xfrm6_state.o 2023-11-18T19:21:53.271 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from net/mac80211/tx.c:15: 2023-11-18T19:21:53.271 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/tx.c: In function ‘__ieee80211_subif_start_xmit’: 2023-11-18T19:21:53.271 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct ieee80211_tx_data[1]’ [-Warray-bounds] 2023-11-18T19:21:53.271 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:53.271 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:53.272 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/tx.c:3419:34: note: while referencing ‘tx’ 2023-11-18T19:21:53.272 INFO:tasks.workunit.client.1.smithi135.stderr: 3419 | struct ieee80211_tx_data tx; 2023-11-18T19:21:53.272 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~ 2023-11-18T19:21:53.397 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from net/mac80211/tx.c:15: 2023-11-18T19:21:53.397 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/tx.c: In function ‘ieee80211_subif_start_xmit’: 2023-11-18T19:21:53.397 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:21:53.397 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:53.397 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:53.398 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/tx.c:4019:37: note: while referencing ‘queue’ 2023-11-18T19:21:53.398 INFO:tasks.workunit.client.1.smithi135.stderr: 4019 | struct sk_buff_head queue; 2023-11-18T19:21:53.398 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~ 2023-11-18T19:21:53.398 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from net/mac80211/tx.c:15: 2023-11-18T19:21:53.398 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:21:53.398 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:53.398 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/tx.c:4019:37: note: while referencing ‘queue’ 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr: 4019 | struct sk_buff_head queue; 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~ 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from net/mac80211/tx.c:15: 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/skbuff.h:1974:9: warning: array subscript ‘struct sk_buff[0]’ is partly outside array bounds of ‘struct sk_buff_head[1]’ [-Warray-bounds] 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr: 1974 | __skb_insert(newsk, next->prev, next, list); 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr:net/mac80211/tx.c:4019:37: note: while referencing ‘queue’ 2023-11-18T19:21:53.399 INFO:tasks.workunit.client.1.smithi135.stderr: 4019 | struct sk_buff_head queue; 2023-11-18T19:21:53.400 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~ 2023-11-18T19:21:53.591 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/edac_device_sysfs.o 2023-11-18T19:21:53.734 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/act_api.o 2023-11-18T19:21:53.740 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_gss/svcauth_gss.o 2023-11-18T19:21:53.745 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/key.o 2023-11-18T19:21:53.945 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/sysctl_net_ipv4.o 2023-11-18T19:21:54.198 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/xfrm6_input.o 2023-11-18T19:21:54.258 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_nat_ftp.o 2023-11-18T19:21:54.313 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/wq.o 2023-11-18T19:21:54.777 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/pnode.o 2023-11-18T19:21:54.933 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/edac_pci.o 2023-11-18T19:21:55.201 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/proc.o 2023-11-18T19:21:55.226 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/sch_fifo.o 2023-11-18T19:21:55.289 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_gss/gss_rpc_upcall.o 2023-11-18T19:21:55.322 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_nat_irc.o 2023-11-18T19:21:55.368 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/xfrm6_output.o 2023-11-18T19:21:55.425 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/splice.o 2023-11-18T19:21:55.649 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/edac_pci_sysfs.o 2023-11-18T19:21:55.811 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/util.o 2023-11-18T19:21:56.215 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sched/ematch.o 2023-11-18T19:21:56.419 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/nf_nat_sip.o 2023-11-18T19:21:56.434 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/edac/mce_amd.o 2023-11-18T19:21:56.453 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_gss/gss_rpc_xdr.o 2023-11-18T19:21:56.481 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/fib_rules.o 2023-11-18T19:21:56.554 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/xfrm6_protocol.o 2023-11-18T19:21:56.785 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/sync.o 2023-11-18T19:21:57.187 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/edac/built-in.a 2023-11-18T19:21:57.207 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/sched/built-in.a 2023-11-18T19:21:57.286 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/wme.o 2023-11-18T19:21:57.290 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firewire/init_ohci1394_dma.o 2023-11-18T19:21:57.616 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_gss/trace.o 2023-11-18T19:21:57.641 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ipmr.o 2023-11-18T19:21:57.655 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/utimes.o 2023-11-18T19:21:57.662 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/netfilter.o 2023-11-18T19:21:57.715 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/x_tables.o 2023-11-18T19:21:57.938 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firewire/built-in.a 2023-11-18T19:21:58.064 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/broadcom/built-in.a 2023-11-18T19:21:58.353 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/libstub/efi-stub-helper.o 2023-11-18T19:21:58.411 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_tcpudp.o 2023-11-18T19:21:58.450 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/d_path.o 2023-11-18T19:21:58.869 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/proc.o 2023-11-18T19:21:59.063 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/sunrpc/auth_gss/built-in.a 2023-11-18T19:21:59.140 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/clnt.o 2023-11-18T19:21:59.176 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/chan.o 2023-11-18T19:21:59.233 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/stack.o 2023-11-18T19:21:59.311 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/libstub/gop.o 2023-11-18T19:21:59.532 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/syncookies.o 2023-11-18T19:21:59.551 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_CONNSECMARK.o 2023-11-18T19:21:59.701 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fs_struct.o 2023-11-18T19:21:59.761 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ipmr_base.o 2023-11-18T19:22:00.039 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/imx/built-in.a 2023-11-18T19:22:00.077 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/libstub/secureboot.o 2023-11-18T19:22:00.133 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/arm/built-in.a 2023-11-18T19:22:00.191 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/bridge/synopsys/built-in.a 2023-11-18T19:22:00.230 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/bridge/built-in.a 2023-11-18T19:22:00.246 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/statfs.o 2023-11-18T19:22:00.280 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/hisilicon/built-in.a 2023-11-18T19:22:00.322 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/i2c/built-in.a 2023-11-18T19:22:00.606 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_NFLOG.o 2023-11-18T19:22:00.707 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/calipso.o 2023-11-18T19:22:00.781 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/libstub/tpm.o 2023-11-18T19:22:00.842 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/i915/display/built-in.a 2023-11-18T19:22:00.899 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/i915/gem/built-in.a 2023-11-18T19:22:00.961 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/i915/gt/built-in.a 2023-11-18T19:22:01.004 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/i915/gt/uc/built-in.a 2023-11-18T19:22:01.059 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/i915/oa/built-in.a 2023-11-18T19:22:01.084 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/syncookies.o 2023-11-18T19:22:01.096 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fs_pin.o 2023-11-18T19:22:01.105 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_drv.o 2023-11-18T19:22:01.202 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/xprt.o 2023-11-18T19:22:01.385 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/trace.o 2023-11-18T19:22:01.403 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_SECMARK.o 2023-11-18T19:22:01.609 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/efi/libstub/lib.a 2023-11-18T19:22:01.609 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/nsfs.o 2023-11-18T19:22:01.699 INFO:tasks.workunit.client.1.smithi135.stdout: EXPORTS drivers/firmware/efi/libstub/lib-ksyms.o 2023-11-18T19:22:01.780 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/efi/libstub/built-in.a 2023-11-18T19:22:01.845 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/efi-bgrt.o 2023-11-18T19:22:02.216 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fs_types.o 2023-11-18T19:22:02.238 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_TCPMSS.o 2023-11-18T19:22:02.310 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ah6.o 2023-11-18T19:22:02.327 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tunnel4.o 2023-11-18T19:22:02.421 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/efi.o 2023-11-18T19:22:02.660 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fs_context.o 2023-11-18T19:22:03.054 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/socklib.o 2023-11-18T19:22:03.179 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_irq.o 2023-11-18T19:22:03.377 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/vars.o 2023-11-18T19:22:03.423 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_conntrack.o 2023-11-18T19:22:03.425 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/ipconfig.o 2023-11-18T19:22:03.538 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fs_parser.o 2023-11-18T19:22:03.596 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/esp6.o 2023-11-18T19:22:04.056 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/xprtsock.o 2023-11-18T19:22:04.157 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fsopen.o 2023-11-18T19:22:04.277 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/reboot.o 2023-11-18T19:22:04.551 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_policy.o 2023-11-18T19:22:04.853 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/memattr.o 2023-11-18T19:22:04.910 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/netfilter.o 2023-11-18T19:22:05.164 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/sit.o 2023-11-18T19:22:05.225 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/buffer.o 2023-11-18T19:22:05.791 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_getparam.o 2023-11-18T19:22:06.053 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/sched.o 2023-11-18T19:22:06.056 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/tcp_cubic.o 2023-11-18T19:22:06.071 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/netfilter/xt_state.o 2023-11-18T19:22:06.129 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/tpm.o 2023-11-18T19:22:06.388 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/mlme.o 2023-11-18T19:22:06.792 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/capsule.o 2023-11-18T19:22:06.793 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/addrconf_core.o 2023-11-18T19:22:06.879 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_params.o 2023-11-18T19:22:07.126 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/nf_log_common.o 2023-11-18T19:22:07.198 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/cipso_ipv4.o 2023-11-18T19:22:07.436 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/block_dev.o 2023-11-18T19:22:07.450 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/memmap.o 2023-11-18T19:22:07.873 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/exthdrs_core.o 2023-11-18T19:22:07.949 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_pci.o 2023-11-18T19:22:08.086 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/efivars.o 2023-11-18T19:22:08.293 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_mark.o 2023-11-18T19:22:08.743 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/xfrm4_policy.o 2023-11-18T19:22:08.948 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/direct-io.o 2023-11-18T19:22:08.966 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/esrt.o 2023-11-18T19:22:09.482 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ip6_checksum.o 2023-11-18T19:22:10.121 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_nat.o 2023-11-18T19:22:10.141 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_scatterlist.o 2023-11-18T19:22:10.179 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/runtime-map.o 2023-11-18T19:22:10.223 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/tdls.o 2023-11-18T19:22:10.241 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth.o 2023-11-18T19:22:10.412 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/xfrm4_state.o 2023-11-18T19:22:10.478 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/mpage.o 2023-11-18T19:22:10.688 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_suspend.o 2023-11-18T19:22:10.725 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ip6_icmp.o 2023-11-18T19:22:10.760 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/runtime-wrappers.o 2023-11-18T19:22:11.305 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_LOG.o 2023-11-18T19:22:11.437 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/proc_namespace.o 2023-11-18T19:22:11.662 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/xfrm4_input.o 2023-11-18T19:22:11.774 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/efi/earlycon.o 2023-11-18T19:22:11.809 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/output_core.o 2023-11-18T19:22:11.910 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_sysfs.o 2023-11-18T19:22:12.016 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_null.o 2023-11-18T19:22:12.231 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/eventpoll.o 2023-11-18T19:22:12.460 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/efi/built-in.a 2023-11-18T19:22:12.522 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_MASQUERADE.o 2023-11-18T19:22:12.570 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/meson/built-in.a 2023-11-18T19:22:12.615 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/psci/built-in.a 2023-11-18T19:22:12.663 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/tegra/built-in.a 2023-11-18T19:22:12.676 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/ocb.o 2023-11-18T19:22:12.709 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/xilinx/built-in.a 2023-11-18T19:22:12.751 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/dmi_scan.o 2023-11-18T19:22:13.028 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/xfrm4_output.o 2023-11-18T19:22:13.082 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/auth_unix.o 2023-11-18T19:22:13.131 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/protocol.o 2023-11-18T19:22:13.180 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_utils.o 2023-11-18T19:22:13.589 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_addrtype.o 2023-11-18T19:22:13.671 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/dmi-id.o 2023-11-18T19:22:13.804 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/anon_inodes.o 2023-11-18T19:22:14.101 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv4/xfrm4_protocol.o 2023-11-18T19:22:14.112 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/ip6_offload.o 2023-11-18T19:22:14.146 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/svc.o 2023-11-18T19:22:14.163 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_csr.o 2023-11-18T19:22:14.194 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/firmware/memmap.o 2023-11-18T19:22:14.314 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/led.o 2023-11-18T19:22:14.398 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/signalfd.o 2023-11-18T19:22:14.809 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/netfilter/built-in.a 2023-11-18T19:22:14.882 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/firmware/built-in.a 2023-11-18T19:22:14.969 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/pm.o 2023-11-18T19:22:14.975 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/timerfd.o 2023-11-18T19:22:15.226 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_device_info.o 2023-11-18T19:22:15.233 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/ipv4/built-in.a 2023-11-18T19:22:15.252 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/tcpv6_offload.o 2023-11-18T19:22:15.321 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/exthdrs_offload.o 2023-11-18T19:22:15.363 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/inet6_hashtables.o 2023-11-18T19:22:15.516 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/vga/vgaarb.o 2023-11-18T19:22:15.871 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/svcsock.o 2023-11-18T19:22:15.882 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/eventfd.o 2023-11-18T19:22:16.325 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/usbhid/hid-core.o 2023-11-18T19:22:16.358 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-core.o 2023-11-18T19:22:16.541 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/vga/built-in.a 2023-11-18T19:22:16.615 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-input.o 2023-11-18T19:22:16.618 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/ipv6/mcast_snoop.o 2023-11-18T19:22:16.636 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/rc80211_minstrel.o 2023-11-18T19:22:16.704 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_pch.o 2023-11-18T19:22:16.724 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/aio.o 2023-11-18T19:22:17.320 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/svcauth.o 2023-11-18T19:22:17.468 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/usbhid/hiddev.o 2023-11-18T19:22:17.685 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/ipv6/built-in.a 2023-11-18T19:22:17.747 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/unix/af_unix.o 2023-11-18T19:22:17.809 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/unix/garbage.o 2023-11-18T19:22:17.826 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_pm.o 2023-11-18T19:22:18.094 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/svcauth_unix.o 2023-11-18T19:22:18.266 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_runtime_pm.o 2023-11-18T19:22:18.338 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/usbhid/hid-pidff.o 2023-11-18T19:22:18.388 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/io_uring.o 2023-11-18T19:22:18.447 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/mac80211/rc80211_minstrel_ht.o 2023-11-18T19:22:18.851 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_sideband.o 2023-11-18T19:22:19.258 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/hid/usbhid/built-in.a 2023-11-18T19:22:19.356 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-quirks.o 2023-11-18T19:22:19.431 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/addr.o 2023-11-18T19:22:19.517 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/rpcb_clnt.o 2023-11-18T19:22:19.670 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/unix/sysctl_net_unix.o 2023-11-18T19:22:19.995 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-debug.o 2023-11-18T19:22:20.013 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hwmon/hwmon.o 2023-11-18T19:22:20.498 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hidraw.o 2023-11-18T19:22:20.612 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/unix/scm.o 2023-11-18T19:22:20.613 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/locks.o 2023-11-18T19:22:20.669 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/mac80211/built-in.a 2023-11-18T19:22:20.731 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/timer.o 2023-11-18T19:22:20.803 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/omapdrm/displays/built-in.a 2023-11-18T19:22:20.852 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/omapdrm/dss/built-in.a 2023-11-18T19:22:20.858 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_uncore.o 2023-11-18T19:22:20.884 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/omapdrm/built-in.a 2023-11-18T19:22:20.947 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/compat.o 2023-11-18T19:22:21.081 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/hwmon/built-in.a 2023-11-18T19:22:21.167 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/core.o 2023-11-18T19:22:21.266 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-generic.o 2023-11-18T19:22:21.620 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/xdr.o 2023-11-18T19:22:21.644 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/unix/built-in.a 2023-11-18T19:22:21.716 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_wakeref.o 2023-11-18T19:22:21.733 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘ilk_setup_wm_latency’, 2023-11-18T19:22:21.733 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.733 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3063:9: warning: ‘intel_read_wm_latency’ accessing 16 bytes in a region of size 10 [-Wstringop-overflow=] 2023-11-18T19:22:21.733 INFO:tasks.workunit.client.1.smithi135.stderr: 3063 | intel_read_wm_latency(dev_priv, dev_priv->wm.pri_latency); 2023-11-18T19:22:21.734 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.734 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.734 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3063:9: note: referencing argument 2 of type ‘u16 *’ {aka ‘short unsigned int *’} 2023-11-18T19:22:21.734 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2824:13: note: in a call to function ‘intel_read_wm_latency’ 2023-11-18T19:22:21.734 INFO:tasks.workunit.client.1.smithi135.stderr: 2824 | static void intel_read_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.734 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.734 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘snb_wm_latency_quirk’, 2023-11-18T19:22:21.735 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘ilk_setup_wm_latency’ at drivers/gpu/drm/i915/intel_pm.c:3078:3, 2023-11-18T19:22:21.735 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.735 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3028:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.735 INFO:tasks.workunit.client.1.smithi135.stderr: 3028 | intel_print_wm_latency(dev_priv, "Primary", dev_priv->wm.pri_latency); 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3028:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘snb_wm_latency_quirk’, 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘ilk_setup_wm_latency’ at drivers/gpu/drm/i915/intel_pm.c:3078:3, 2023-11-18T19:22:21.736 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.737 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3029:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.737 INFO:tasks.workunit.client.1.smithi135.stderr: 3029 | intel_print_wm_latency(dev_priv, "Sprite", dev_priv->wm.spr_latency); 2023-11-18T19:22:21.737 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.737 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.737 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3029:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.738 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.738 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.738 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.738 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘snb_wm_latency_quirk’, 2023-11-18T19:22:21.738 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘ilk_setup_wm_latency’ at drivers/gpu/drm/i915/intel_pm.c:3078:3, 2023-11-18T19:22:21.738 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.739 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3030:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.739 INFO:tasks.workunit.client.1.smithi135.stderr: 3030 | intel_print_wm_latency(dev_priv, "Cursor", dev_priv->wm.cur_latency); 2023-11-18T19:22:21.739 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.739 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.739 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3030:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.739 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘snb_wm_lp3_irq_quirk’, 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘ilk_setup_wm_latency’ at drivers/gpu/drm/i915/intel_pm.c:3079:3, 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3056:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr: 3056 | intel_print_wm_latency(dev_priv, "Primary", dev_priv->wm.pri_latency); 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.740 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3056:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.741 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.741 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.741 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.741 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘snb_wm_lp3_irq_quirk’, 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘ilk_setup_wm_latency’ at drivers/gpu/drm/i915/intel_pm.c:3079:3, 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3057:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr: 3057 | intel_print_wm_latency(dev_priv, "Sprite", dev_priv->wm.spr_latency); 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3057:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.742 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘snb_wm_lp3_irq_quirk’, 2023-11-18T19:22:21.743 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘ilk_setup_wm_latency’ at drivers/gpu/drm/i915/intel_pm.c:3079:3, 2023-11-18T19:22:21.743 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3058:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr: 3058 | intel_print_wm_latency(dev_priv, "Cursor", dev_priv->wm.cur_latency); 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3058:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.744 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘ilk_setup_wm_latency’, 2023-11-18T19:22:21.745 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.745 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3073:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.745 INFO:tasks.workunit.client.1.smithi135.stderr: 3073 | intel_print_wm_latency(dev_priv, "Primary", dev_priv->wm.pri_latency); 2023-11-18T19:22:21.745 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.745 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.745 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3073:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘ilk_setup_wm_latency’, 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3074:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr: 3074 | intel_print_wm_latency(dev_priv, "Sprite", dev_priv->wm.spr_latency); 2023-11-18T19:22:21.746 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.747 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.747 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3074:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.747 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.747 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.747 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.747 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘ilk_setup_wm_latency’, 2023-11-18T19:22:21.747 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_init_pm’ at drivers/gpu/drm/i915/intel_pm.c:9782:3: 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3075:9: warning: ‘intel_print_wm_latency’ reading 16 bytes from a region of size 10 [-Wstringop-overread] 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr: 3075 | intel_print_wm_latency(dev_priv, "Cursor", dev_priv->wm.cur_latency); 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c: In function ‘intel_init_pm’: 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:3075:9: note: referencing argument 3 of type ‘const u16 *’ {aka ‘const short unsigned int *’} 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/intel_pm.c:2967:13: note: in a call to function ‘intel_print_wm_latency’ 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr: 2967 | static void intel_print_wm_latency(struct drm_i915_private *dev_priv, 2023-11-18T19:22:21.748 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:21.779 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/panel/built-in.a 2023-11-18T19:22:21.796 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-a4tech.o 2023-11-18T19:22:21.820 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-apple.o 2023-11-18T19:22:22.209 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/sysfs.o 2023-11-18T19:22:22.231 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:22:22.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:22:22.398 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/compat_ioctl.o 2023-11-18T19:22:22.476 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_policy.o 2023-11-18T19:22:22.478 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-belkin.o 2023-11-18T19:22:22.530 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/sunrpc_syms.o 2023-11-18T19:22:23.028 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-cherry.o 2023-11-18T19:22:23.302 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/cache.o 2023-11-18T19:22:23.306 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_memcpy.o 2023-11-18T19:22:23.453 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/socket.o 2023-11-18T19:22:23.563 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_state.o 2023-11-18T19:22:23.564 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-chicony.o 2023-11-18T19:22:23.577 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_mm.o 2023-11-18T19:22:23.771 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/binfmt_misc.o 2023-11-18T19:22:23.801 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/radiotap.o 2023-11-18T19:22:24.161 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-cypress.o 2023-11-18T19:22:24.572 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_sw_fence.o 2023-11-18T19:22:24.681 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/util.o 2023-11-18T19:22:24.692 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/binfmt_script.o 2023-11-18T19:22:24.695 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/rpc_pipe.o 2023-11-18T19:22:24.713 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-ezkey.o 2023-11-18T19:22:25.172 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_sw_fence_work.o 2023-11-18T19:22:27.298 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/binfmt_elf.o 2023-11-18T19:22:27.298 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-gyration.o 2023-11-18T19:22:27.298 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/svc_xprt.o 2023-11-18T19:22:27.298 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_syncmap.o 2023-11-18T19:22:27.298 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/reg.o 2023-11-18T19:22:27.298 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-ite.o 2023-11-18T19:22:27.299 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_hash.o 2023-11-18T19:22:27.299 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_user_extensions.o 2023-11-18T19:22:27.299 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/compat_binfmt_elf.o 2023-11-18T19:22:27.299 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-kensington.o 2023-11-18T19:22:27.299 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/rcar-du/built-in.a 2023-11-18T19:22:27.299 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_ioc32.o 2023-11-18T19:22:27.299 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/tilcdc/built-in.a 2023-11-18T19:22:27.300 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_input.o 2023-11-18T19:22:27.300 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/tiny/built-in.a 2023-11-18T19:22:27.300 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_crtc_helper.o 2023-11-18T19:22:27.300 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-lg.o 2023-11-18T19:22:27.300 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/xprtmultipath.o 2023-11-18T19:22:27.300 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-lgff.o 2023-11-18T19:22:27.536 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_debugfs.o 2023-11-18T19:22:27.587 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/mbcache.o 2023-11-18T19:22:27.589 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/stats.o 2023-11-18T19:22:27.681 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/posix_acl.o 2023-11-18T19:22:27.818 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-lg4ff.o 2023-11-18T19:22:27.938 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_output.o 2023-11-18T19:22:28.251 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/scan.o 2023-11-18T19:22:28.275 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-microsoft.o 2023-11-18T19:22:28.288 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_pipe_crc.o 2023-11-18T19:22:28.499 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/coredump.o 2023-11-18T19:22:28.673 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/hwtracing/intel_th/built-in.a 2023-11-18T19:22:28.760 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/i2c/algos/i2c-algo-bit.o 2023-11-18T19:22:28.921 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-monterey.o 2023-11-18T19:22:28.935 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sunrpc/sysctl.o 2023-11-18T19:22:29.238 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_sysctl.o 2023-11-18T19:22:29.923 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-ntrig.o 2023-11-18T19:22:30.205 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/sunrpc/built-in.a 2023-11-18T19:22:30.207 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/i2c/algos/built-in.a 2023-11-18T19:22:30.236 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/drop_caches.o 2023-11-18T19:22:30.318 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/compat.o 2023-11-18T19:22:30.440 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_pmu.o 2023-11-18T19:22:30.462 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/i2c/busses/i2c-i801.o 2023-11-18T19:22:30.849 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_replay.o 2023-11-18T19:22:30.854 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-pl.o 2023-11-18T19:22:31.018 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/fhandle.o 2023-11-18T19:22:31.188 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/nl80211.o 2023-11-18T19:22:31.253 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_dp_helper.o 2023-11-18T19:22:31.585 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-petalynx.o 2023-11-18T19:22:31.825 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/i2c/busses/built-in.a 2023-11-18T19:22:31.877 INFO:tasks.workunit.client.1.smithi135.stdout: CC fs/dcookies.o 2023-11-18T19:22:31.894 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/i2c/muxes/built-in.a 2023-11-18T19:22:31.917 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/i3c/built-in.a 2023-11-18T19:22:31.951 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/i2c/i2c-boardinfo.o 2023-11-18T19:22:31.963 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_dsc.o 2023-11-18T19:22:31.975 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_breadcrumbs.o 2023-11-18T19:22:32.165 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-redragon.o 2023-11-18T19:22:32.225 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_device.o 2023-11-18T19:22:32.377 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_algo.o 2023-11-18T19:22:32.551 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/i2c/i2c-core-base.o 2023-11-18T19:22:32.574 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/xfrm/xfrm_user.o 2023-11-18T19:22:32.686 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-samsung.o 2023-11-18T19:22:32.750 INFO:tasks.workunit.client.1.smithi135.stdout: AR fs/built-in.a 2023-11-18T19:22:33.023 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_context.o 2023-11-18T19:22:33.252 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/i2c/i2c-core-smbus.o 2023-11-18T19:22:33.268 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-sony.o 2023-11-18T19:22:33.315 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/idle/built-in.a 2023-11-18T19:22:33.369 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/mlme.o 2023-11-18T19:22:33.538 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/sysctl_net.o 2023-11-18T19:22:34.141 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_cs.o 2023-11-18T19:22:34.171 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_probe_helper.o 2023-11-18T19:22:34.414 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-sunplus.o 2023-11-18T19:22:34.454 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/i2c/i2c-core-acpi.o 2023-11-18T19:22:34.496 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/xfrm/built-in.a 2023-11-18T19:22:34.576 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/hid/hid-topseed.o 2023-11-18T19:22:34.604 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_pool.o 2023-11-18T19:22:34.961 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/ibss.o 2023-11-18T19:22:34.985 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/joystick/built-in.a 2023-11-18T19:22:35.045 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/keyboard/atkbd.o 2023-11-18T19:22:35.151 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/hid/built-in.a 2023-11-18T19:22:35.229 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/i2c/i2c-smbus.o 2023-11-18T19:22:35.256 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_plane_helper.o 2023-11-18T19:22:35.382 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_dp_mst_topology.o 2023-11-18T19:22:35.670 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/misc/built-in.a 2023-11-18T19:22:35.702 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_pm.o 2023-11-18T19:22:35.714 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/sme.o 2023-11-18T19:22:35.850 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/i2c/built-in.a 2023-11-18T19:22:35.919 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_atomic_helper.o 2023-11-18T19:22:35.940 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/serio/serio.o 2023-11-18T19:22:36.013 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/keyboard/built-in.a 2023-11-18T19:22:36.095 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/psmouse-base.o 2023-11-18T19:22:36.676 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/serio/i8042.o 2023-11-18T19:22:36.765 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_user.o 2023-11-18T19:22:36.876 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_gt.o 2023-11-18T19:22:37.092 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/synaptics.o 2023-11-18T19:22:37.288 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/iommu.o 2023-11-18T19:22:37.704 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/input/mouse/synaptics.c: In function ‘synaptics_report_mt_data’: 2023-11-18T19:22:37.704 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/input/mouse/synaptics.c:995:9: warning: ‘pos’ may be used uninitialized [-Wmaybe-uninitialized] 2023-11-18T19:22:37.704 INFO:tasks.workunit.client.1.smithi135.stderr: 995 | input_mt_assign_slots(dev, slot, pos, nsemi, DMAX * priv->info.x_res); 2023-11-18T19:22:37.704 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:37.704 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/input/mouse/synaptics.c:26: 2023-11-18T19:22:37.705 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/input/mt.h:118:5: note: by argument 3 of type ‘const struct input_mt_pos *’ to ‘input_mt_assign_slots’ declared here 2023-11-18T19:22:37.705 INFO:tasks.workunit.client.1.smithi135.stderr: 118 | int input_mt_assign_slots(struct input_dev *dev, int *slots, 2023-11-18T19:22:37.705 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:37.705 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/input/mouse/synaptics.c:985:29: note: ‘pos’ declared here 2023-11-18T19:22:37.705 INFO:tasks.workunit.client.1.smithi135.stderr: 985 | struct input_mt_pos pos[2]; 2023-11-18T19:22:37.705 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~ 2023-11-18T19:22:37.796 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/irqchip/built-in.a 2023-11-18T19:22:37.835 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/leds/trigger/built-in.a 2023-11-18T19:22:37.860 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/leds/led-core.o 2023-11-18T19:22:38.489 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/focaltech.o 2023-11-18T19:22:38.496 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/chan.o 2023-11-18T19:22:38.506 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/leds/led-class.o 2023-11-18T19:22:38.506 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_irq.o 2023-11-18T19:22:38.514 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/leds/led-triggers.o 2023-11-18T19:22:38.661 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/serio/serport.o 2023-11-18T19:22:38.803 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/iommu-traces.o 2023-11-18T19:22:39.042 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/iommu-sysfs.o 2023-11-18T19:22:39.071 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/alps.o 2023-11-18T19:22:39.127 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/leds/built-in.a 2023-11-18T19:22:39.198 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/byd.o 2023-11-18T19:22:39.235 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_pm.o 2023-11-18T19:22:39.307 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/serio/libps2.o 2023-11-18T19:22:39.635 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/iova.o 2023-11-18T19:22:39.688 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/macintosh/mac_hid.o 2023-11-18T19:22:39.689 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/mailbox/mailbox.o 2023-11-18T19:22:39.785 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/ethtool.o 2023-11-18T19:22:40.009 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/serio/built-in.a 2023-11-18T19:22:40.074 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_kms_helper_common.o 2023-11-18T19:22:40.263 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/macintosh/built-in.a 2023-11-18T19:22:40.307 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_pm_irq.o 2023-11-18T19:22:40.316 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/mailbox/pcc.o 2023-11-18T19:22:40.328 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_hangcheck.o 2023-11-18T19:22:40.348 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/tablet/built-in.a 2023-11-18T19:22:40.389 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_dp_dual_mode_helper.o 2023-11-18T19:22:40.444 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/logips2pp.o 2023-11-18T19:22:40.584 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/amd_iommu.o 2023-11-18T19:22:40.688 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/lifebook.o 2023-11-18T19:22:40.990 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/mailbox/built-in.a 2023-11-18T19:22:41.040 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/md.o 2023-11-18T19:22:41.067 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/common/b2c2/built-in.a 2023-11-18T19:22:41.102 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/common/saa7146/built-in.a 2023-11-18T19:22:41.116 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/firewire/built-in.a 2023-11-18T19:22:41.155 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/common/siano/built-in.a 2023-11-18T19:22:41.166 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_simple_kms_helper.o 2023-11-18T19:22:41.209 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/common/v4l2-tpg/built-in.a 2023-11-18T19:22:41.250 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/common/videobuf2/built-in.a 2023-11-18T19:22:41.286 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/trackpoint.o 2023-11-18T19:22:41.286 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/common/built-in.a 2023-11-18T19:22:41.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/mesh.o 2023-11-18T19:22:41.327 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/cypress_ps2.o 2023-11-18T19:22:41.351 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/i2c/built-in.a 2023-11-18T19:22:41.401 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/mmc/siano/built-in.a 2023-11-18T19:22:41.423 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_lrc.o 2023-11-18T19:22:41.432 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/mmc/built-in.a 2023-11-18T19:22:41.484 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/b2c2/built-in.a 2023-11-18T19:22:41.529 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/ddbridge/built-in.a 2023-11-18T19:22:41.573 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/dm1105/built-in.a 2023-11-18T19:22:41.628 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/intel/ipu3/built-in.a 2023-11-18T19:22:41.661 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/intel/built-in.a 2023-11-18T19:22:41.714 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/mantis/built-in.a 2023-11-18T19:22:41.760 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/netup_unidvb/built-in.a 2023-11-18T19:22:41.809 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/ngene/built-in.a 2023-11-18T19:22:41.820 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/pluto2/built-in.a 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/input/mouse/cypress_ps2.c: In function ‘cypress_process_packet.constprop’: 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/input/mouse/cypress_ps2.c:536:9: warning: ‘pos’ may be used uninitialized [-Wmaybe-uninitialized] 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr: 536 | input_mt_assign_slots(input, slots, pos, n, 0); 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/input/mouse/cypress_ps2.c:21: 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/input/mt.h:118:5: note: by argument 3 of type ‘const struct input_mt_pos *’ to ‘input_mt_assign_slots’ declared here 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr: 118 | int input_mt_assign_slots(struct input_dev *dev, int *slots, 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:22:41.849 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/input/mouse/cypress_ps2.c:520:29: note: ‘pos’ declared here 2023-11-18T19:22:41.850 INFO:tasks.workunit.client.1.smithi135.stderr: 520 | struct input_mt_pos pos[CYTP_MAX_MT_SLOTS]; 2023-11-18T19:22:41.850 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~ 2023-11-18T19:22:41.857 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_renderstate.o 2023-11-18T19:22:41.861 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/pt1/built-in.a 2023-11-18T19:22:41.908 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/pt3/built-in.a 2023-11-18T19:22:41.966 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/saa7146/built-in.a 2023-11-18T19:22:42.011 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/smipcie/built-in.a 2023-11-18T19:22:42.026 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_reset.o 2023-11-18T19:22:42.058 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/ttpci/built-in.a 2023-11-18T19:22:42.089 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/pci/built-in.a 2023-11-18T19:22:42.147 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/mouse/psmouse-smbus.o 2023-11-18T19:22:42.201 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/cros-ec-cec/built-in.a 2023-11-18T19:22:42.244 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/davinci/built-in.a 2023-11-18T19:22:42.296 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/meson/built-in.a 2023-11-18T19:22:42.343 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/omap/built-in.a 2023-11-18T19:22:42.384 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/stm32/built-in.a 2023-11-18T19:22:42.432 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/amd_iommu_init.o 2023-11-18T19:22:42.441 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/sunxi/sun4i-csi/built-in.a 2023-11-18T19:22:42.492 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/sunxi/sun6i-csi/built-in.a 2023-11-18T19:22:42.525 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/sunxi/built-in.a 2023-11-18T19:22:42.569 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/platform/built-in.a 2023-11-18T19:22:42.658 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/rc/keymaps/built-in.a 2023-11-18T19:22:42.689 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/rc/built-in.a 2023-11-18T19:22:42.736 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/spi/built-in.a 2023-11-18T19:22:42.784 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/tuners/built-in.a 2023-11-18T19:22:42.821 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/mouse/built-in.a 2023-11-18T19:22:42.852 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/b2c2/built-in.a 2023-11-18T19:22:42.901 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/touchscreen/of_touchscreen.o 2023-11-18T19:22:42.917 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/dvb-usb/built-in.a 2023-11-18T19:22:42.962 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/dvb-usb-v2/built-in.a 2023-11-18T19:22:42.971 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/ap.o 2023-11-18T19:22:42.984 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/amd_iommu_quirks.o 2023-11-18T19:22:43.012 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/s2255/built-in.a 2023-11-18T19:22:43.057 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/siano/built-in.a 2023-11-18T19:22:43.096 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/stkwebcam/built-in.a 2023-11-18T19:22:43.216 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/ttusb-budget/built-in.a 2023-11-18T19:22:43.266 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/ttusb-dec/built-in.a 2023-11-18T19:22:43.313 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/zr364xx/built-in.a 2023-11-18T19:22:43.344 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/usb/built-in.a 2023-11-18T19:22:43.379 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/md-bitmap.o 2023-11-18T19:22:43.411 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/media/built-in.a 2023-11-18T19:22:43.496 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/touchscreen/built-in.a 2023-11-18T19:22:43.499 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_modeset_helper.o 2023-11-18T19:22:43.573 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/trace.o 2023-11-18T19:22:43.573 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/input.o 2023-11-18T19:22:43.599 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_ringbuffer.o 2023-11-18T19:22:43.892 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/dmar.o 2023-11-18T19:22:44.155 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/input-compat.o 2023-11-18T19:22:44.525 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/intel-iommu.o 2023-11-18T19:22:44.706 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm.o 2023-11-18T19:22:44.927 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/input-mt.o 2023-11-18T19:22:45.067 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_mocs.o 2023-11-18T19:22:45.260 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/mfd/built-in.a 2023-11-18T19:22:45.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-table.o 2023-11-18T19:22:45.320 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_scdc_helper.o 2023-11-18T19:22:45.345 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/ocb.o 2023-11-18T19:22:45.614 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/input-poller.o 2023-11-18T19:22:45.978 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/pmsr.o 2023-11-18T19:22:46.183 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_sseu.o 2023-11-18T19:22:46.218 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/ff-core.o 2023-11-18T19:22:46.402 INFO:tasks.workunit.client.1.smithi135.stdout: GEN net/wireless/shipped-certs.c 2023-11-18T19:22:46.432 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_gem_framebuffer_helper.o 2023-11-18T19:22:46.712 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-target.o 2023-11-18T19:22:46.839 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/ff-memless.o 2023-11-18T19:22:46.890 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/input-polldev.o 2023-11-18T19:22:47.154 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_timeline.o 2023-11-18T19:22:47.194 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/intel-pasid.o 2023-11-18T19:22:47.272 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/cardreader/built-in.a 2023-11-18T19:22:47.337 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/cb710/built-in.a 2023-11-18T19:22:47.387 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/eeprom/built-in.a 2023-11-18T19:22:47.435 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/lis3lv02d/built-in.a 2023-11-18T19:22:47.490 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/mic/bus/built-in.a 2023-11-18T19:22:47.521 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/mmc/built-in.a 2023-11-18T19:22:47.527 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/mic/built-in.a 2023-11-18T19:22:47.550 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/sparse-keymap.o 2023-11-18T19:22:47.567 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/input-leds.o 2023-11-18T19:22:47.574 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/ti-st/built-in.a 2023-11-18T19:22:47.576 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-linear.o 2023-11-18T19:22:47.608 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/misc/built-in.a 2023-11-18T19:22:47.686 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-stripe.o 2023-11-18T19:22:47.831 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/iommu/intel-trace.o 2023-11-18T19:22:48.032 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/intel_workarounds.o 2023-11-18T19:22:48.151 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-ioctl.o 2023-11-18T19:22:48.181 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/input/evdev.o 2023-11-18T19:22:48.286 INFO:tasks.workunit.client.1.smithi135.stdout: CC net/wireless/shipped-certs.o 2023-11-18T19:22:48.322 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_atomic_state_helper.o 2023-11-18T19:22:48.526 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/dsa/b53/built-in.a 2023-11-18T19:22:48.592 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/dsa/microchip/built-in.a 2023-11-18T19:22:48.643 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/dsa/mv88e6xxx/built-in.a 2023-11-18T19:22:48.662 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/iommu/built-in.a 2023-11-18T19:22:48.701 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/dsa/sja1105/built-in.a 2023-11-18T19:22:48.727 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/gen6_renderstate.o 2023-11-18T19:22:48.740 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/dsa/built-in.a 2023-11-18T19:22:48.812 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/3com/built-in.a 2023-11-18T19:22:48.862 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/8390/built-in.a 2023-11-18T19:22:48.863 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-io.o 2023-11-18T19:22:48.908 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/adaptec/built-in.a 2023-11-18T19:22:48.959 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/agere/built-in.a 2023-11-18T19:22:49.003 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/alacritech/built-in.a 2023-11-18T19:22:49.051 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/alteon/built-in.a 2023-11-18T19:22:49.098 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_damage_helper.o 2023-11-18T19:22:49.103 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/amazon/built-in.a 2023-11-18T19:22:49.150 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/amd/built-in.a 2023-11-18T19:22:49.153 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/fddi/built-in.a 2023-11-18T19:22:49.194 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/aquantia/built-in.a 2023-11-18T19:22:49.200 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_format_helper.o 2023-11-18T19:22:49.217 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/input/built-in.a 2023-11-18T19:22:49.235 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/arc/built-in.a 2023-11-18T19:22:49.289 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/atheros/built-in.a 2023-11-18T19:22:49.289 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-kcopyd.o 2023-11-18T19:22:49.334 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/aurora/built-in.a 2023-11-18T19:22:49.393 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/broadcom/tg3.o 2023-11-18T19:22:49.484 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/gen7_renderstate.o 2023-11-18T19:22:49.531 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/brocade/built-in.a 2023-11-18T19:22:49.580 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/hamradio/built-in.a 2023-11-18T19:22:49.622 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/gen8_renderstate.o 2023-11-18T19:22:49.627 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_self_refresh_helper.o 2023-11-18T19:22:49.739 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/gen9_renderstate.o 2023-11-18T19:22:49.898 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cadence/built-in.a 2023-11-18T19:22:49.902 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/nfc/built-in.a 2023-11-18T19:22:50.025 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/mdio-boardinfo.o 2023-11-18T19:22:50.055 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_busy.o 2023-11-18T19:22:50.102 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/nvme/host/built-in.a 2023-11-18T19:22:50.333 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/nvme/target/built-in.a 2023-11-18T19:22:50.514 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/nvme/built-in.a 2023-11-18T19:22:51.079 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/nvmem/core.o 2023-11-18T19:22:51.101 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-sysfs.o 2023-11-18T19:22:51.177 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cavium/common/built-in.a 2023-11-18T19:22:51.237 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cavium/liquidio/built-in.a 2023-11-18T19:22:51.246 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_clflush.o 2023-11-18T19:22:51.270 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cavium/octeon/built-in.a 2023-11-18T19:22:51.286 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_client_blt.o 2023-11-18T19:22:51.300 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/wireless/built-in.a 2023-11-18T19:22:51.307 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/phy.o 2023-11-18T19:22:51.314 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cavium/thunder/built-in.a 2023-11-18T19:22:51.358 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cavium/built-in.a 2023-11-18T19:22:51.362 INFO:tasks.workunit.client.1.smithi135.stdout: AR net/built-in.a 2023-11-18T19:22:51.515 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/phy-c45.o 2023-11-18T19:22:51.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/phy-core.o 2023-11-18T19:22:52.089 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-stats.o 2023-11-18T19:22:52.194 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/nvmem/nvmem-sysfs.o 2023-11-18T19:22:52.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:22:52.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:22:52.442 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-rq.o 2023-11-18T19:22:52.552 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/phy_device.o 2023-11-18T19:22:52.574 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/bridge/panel.o 2023-11-18T19:22:52.619 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_context.o 2023-11-18T19:22:52.649 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/chelsio/built-in.a 2023-11-18T19:22:52.703 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/usb/built-in.a 2023-11-18T19:22:52.751 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cisco/built-in.a 2023-11-18T19:22:52.755 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/nvmem/built-in.a 2023-11-18T19:22:52.803 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/mdio_bus.o 2023-11-18T19:22:52.814 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pci/controller/dwc/built-in.a 2023-11-18T19:22:52.847 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pci/controller/built-in.a 2023-11-18T19:22:52.906 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/hotplug/pci_hotplug_core.o 2023-11-18T19:22:53.273 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pcie/portdrv_core.o 2023-11-18T19:22:53.353 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_dmabuf.o 2023-11-18T19:22:53.381 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-builtin.o 2023-11-18T19:22:53.740 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/hotplug/acpi_pcihp.o 2023-11-18T19:22:53.951 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_domain.o 2023-11-18T19:22:54.017 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pcie/portdrv_pci.o 2023-11-18T19:22:54.108 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/mdio_device.o 2023-11-18T19:22:54.170 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-raid1.o 2023-11-18T19:22:54.457 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pci/hotplug/built-in.a 2023-11-18T19:22:54.458 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/admtek/built-in.a 2023-11-18T19:22:54.523 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/cortina/built-in.a 2023-11-18T19:22:54.531 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/ath/built-in.a 2023-11-18T19:22:54.552 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/atmel/built-in.a 2023-11-18T19:22:54.566 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_fb_helper.o 2023-11-18T19:22:54.582 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/phy/realtek.o 2023-11-18T19:22:54.589 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/broadcom/built-in.a 2023-11-18T19:22:54.630 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/cisco/built-in.a 2023-11-18T19:22:54.674 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/intel/built-in.a 2023-11-18T19:22:54.702 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pcie/err.o 2023-11-18T19:22:54.717 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/intersil/built-in.a 2023-11-18T19:22:54.767 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/marvell/built-in.a 2023-11-18T19:22:54.811 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/mediatek/built-in.a 2023-11-18T19:22:54.856 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/quantenna/built-in.a 2023-11-18T19:22:54.875 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/ralink/built-in.a 2023-11-18T19:22:54.928 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/realtek/built-in.a 2023-11-18T19:22:54.929 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-log.o 2023-11-18T19:22:54.976 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/rsi/built-in.a 2023-11-18T19:22:55.015 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/st/built-in.a 2023-11-18T19:22:55.055 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/ti/built-in.a 2023-11-18T19:22:55.095 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/zydas/built-in.a 2023-11-18T19:22:55.131 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/wireless/built-in.a 2023-11-18T19:22:55.142 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_execbuffer.o 2023-11-18T19:22:55.237 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_fence.o 2023-11-18T19:22:55.277 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_auth.o 2023-11-18T19:22:55.355 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pcie/aspm.o 2023-11-18T19:22:55.366 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/phy/built-in.a 2023-11-18T19:22:55.445 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/dec/tulip/built-in.a 2023-11-18T19:22:55.477 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/dec/built-in.a 2023-11-18T19:22:55.527 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pci/switch/built-in.a 2023-11-18T19:22:55.584 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/cs.o 2023-11-18T19:22:55.797 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-region-hash.o 2023-11-18T19:22:55.909 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/socket_sysfs.o 2023-11-18T19:22:56.015 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_internal.o 2023-11-18T19:22:56.229 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pcie/aer.o 2023-11-18T19:22:56.351 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/mii.o 2023-11-18T19:22:56.476 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_cache.o 2023-11-18T19:22:56.586 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/cardbus.o 2023-11-18T19:22:56.770 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/md/dm-zero.o 2023-11-18T19:22:57.055 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pcie/pme.o 2023-11-18T19:22:57.065 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/access.o 2023-11-18T19:22:57.209 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_object.o 2023-11-18T19:22:57.217 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/dlink/built-in.a 2023-11-18T19:22:57.234 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/ds.o 2023-11-18T19:22:57.268 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_object_blt.o 2023-11-18T19:22:57.355 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/emulex/built-in.a 2023-11-18T19:22:57.401 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_file.o 2023-11-18T19:22:57.403 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/md/built-in.a 2023-11-18T19:22:57.464 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/ezchip/built-in.a 2023-11-18T19:22:57.508 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_mman.o 2023-11-18T19:22:57.656 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/broadcom/built-in.a 2023-11-18T19:22:57.719 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/fujitsu/built-in.a 2023-11-18T19:22:57.769 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/google/built-in.a 2023-11-18T19:22:57.775 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pci/pcie/built-in.a 2023-11-18T19:22:57.823 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/hp/built-in.a 2023-11-18T19:22:57.842 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/perf/built-in.a 2023-11-18T19:22:57.874 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/huawei/built-in.a 2023-11-18T19:22:57.882 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/Space.o 2023-11-18T19:22:57.915 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/i825xx/built-in.a 2023-11-18T19:22:57.979 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000/e1000_main.o 2023-11-18T19:22:57.989 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/bus.o 2023-11-18T19:22:58.278 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/pcmcia_resource.o 2023-11-18T19:22:58.311 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/82571.o 2023-11-18T19:22:58.372 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/marvell/octeontx2/built-in.a 2023-11-18T19:22:58.414 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/marvell/sky2.o 2023-11-18T19:22:58.562 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/platform/x86/eeepc-laptop.o 2023-11-18T19:22:58.657 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000/e1000_hw.o 2023-11-18T19:22:58.757 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/probe.o 2023-11-18T19:22:58.829 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_pages.o 2023-11-18T19:22:59.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/cistpl.o 2023-11-18T19:22:59.436 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/ich8lan.o 2023-11-18T19:22:59.535 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/platform/x86/pmc_atom.o 2023-11-18T19:22:59.991 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_phys.o 2023-11-18T19:23:00.165 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/host-bridge.o 2023-11-18T19:23:00.234 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/platform/x86/built-in.a 2023-11-18T19:23:00.323 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/platform/built-in.a 2023-11-18T19:23:00.398 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/pcmcia_cis.o 2023-11-18T19:23:00.463 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_pm.o 2023-11-18T19:23:00.582 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/remove.o 2023-11-18T19:23:00.597 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000/e1000_ethtool.o 2023-11-18T19:23:00.779 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/loopback.o 2023-11-18T19:23:01.063 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/marvell/built-in.a 2023-11-18T19:23:01.079 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000/e1000_param.o 2023-11-18T19:23:01.118 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/rsrc_mgr.o 2023-11-18T19:23:01.265 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pci.o 2023-11-18T19:23:01.283 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e100.o 2023-11-18T19:23:01.380 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/80003es2lan.o 2023-11-18T19:23:01.577 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_shmem.o 2023-11-18T19:23:01.722 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/rsrc_nonstatic.o 2023-11-18T19:23:01.830 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pcmcia/yenta_socket.o 2023-11-18T19:23:02.224 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/mac.o 2023-11-18T19:23:02.235 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/intel/e1000/built-in.a 2023-11-18T19:23:02.354 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/pnpacpi/core.o 2023-11-18T19:23:02.443 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/core.o 2023-11-18T19:23:02.603 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_shrinker.o 2023-11-18T19:23:02.925 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/netconsole.o 2023-11-18T19:23:03.006 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pcmcia/built-in.a 2023-11-18T19:23:03.011 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pci-driver.o 2023-11-18T19:23:03.021 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/pnpacpi/rsparser.o 2023-11-18T19:23:03.098 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/manage.o 2023-11-18T19:23:03.131 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/mellanox/built-in.a 2023-11-18T19:23:03.175 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_gem.o 2023-11-18T19:23:03.345 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_stolen.o 2023-11-18T19:23:03.834 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/power/supply/power_supply_core.o 2023-11-18T19:23:03.859 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pps/clients/built-in.a 2023-11-18T19:23:03.888 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pnp/pnpacpi/built-in.a 2023-11-18T19:23:03.907 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pps/generators/built-in.a 2023-11-18T19:23:03.932 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/card.o 2023-11-18T19:23:03.954 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pps/pps.o 2023-11-18T19:23:03.965 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/nvm.o 2023-11-18T19:23:03.968 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pps/kapi.o 2023-11-18T19:23:04.249 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/search.o 2023-11-18T19:23:04.300 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/phy.o 2023-11-18T19:23:04.510 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_throttle.o 2023-11-18T19:23:04.543 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/power/supply/power_supply_sysfs.o 2023-11-18T19:23:04.596 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pps/sysfs.o 2023-11-18T19:23:04.651 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/micrel/built-in.a 2023-11-18T19:23:04.660 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/driver.o 2023-11-18T19:23:04.706 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_tiling.o 2023-11-18T19:23:04.903 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/microchip/built-in.a 2023-11-18T19:23:04.969 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ptp/ptp_clock.o 2023-11-18T19:23:04.986 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pci-sysfs.o 2023-11-18T19:23:05.057 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pps/built-in.a 2023-11-18T19:23:05.071 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/power/supply/power_supply_leds.o 2023-11-18T19:23:05.118 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/power/supply/power_supply_hwmon.o 2023-11-18T19:23:05.226 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/resource.o 2023-11-18T19:23:05.499 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_ioctl.o 2023-11-18T19:23:05.531 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pwm/built-in.a 2023-11-18T19:23:05.580 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/param.o 2023-11-18T19:23:05.621 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/power/supply/built-in.a 2023-11-18T19:23:05.645 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/mscc/built-in.a 2023-11-18T19:23:05.677 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/power/built-in.a 2023-11-18T19:23:05.697 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ptp/ptp_chardev.o 2023-11-18T19:23:05.759 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_userptr.o 2023-11-18T19:23:05.771 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_wait.o 2023-11-18T19:23:05.787 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/list.h:9, 2023-11-18T19:23:05.788 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/module.h:9, 2023-11-18T19:23:05.788 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/pnp/resource.c:11: 2023-11-18T19:23:05.788 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c: In function ‘pnp_range_reserved’: 2023-11-18T19:23:05.788 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/kernel.h:997:10: warning: array subscript -45 is outside array bounds of ‘struct list_head[1]’ [-Warray-bounds] 2023-11-18T19:23:05.789 INFO:tasks.workunit.client.1.smithi135.stderr: 997 | ((type *)(__mptr - offsetof(type, member))); }) 2023-11-18T19:23:05.789 INFO:tasks.workunit.client.1.smithi135.stderr: | ~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.789 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/list.h:479:9: note: in expansion of macro ‘container_of’ 2023-11-18T19:23:05.789 INFO:tasks.workunit.client.1.smithi135.stderr: 479 | container_of(ptr, type, member) 2023-11-18T19:23:05.789 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~ 2023-11-18T19:23:05.789 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:275:30: note: in expansion of macro ‘list_entry’ 2023-11-18T19:23:05.789 INFO:tasks.workunit.client.1.smithi135.stderr: 275 | #define global_to_pnp_dev(n) list_entry(n, struct pnp_dev, global_list) 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:281:18: note: in expansion of macro ‘global_to_pnp_dev’ 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr: 281 | (dev) != global_to_pnp_dev(&pnp_global); \ 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c:692:9: note: in expansion of macro ‘pnp_for_each_dev’ 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr: 692 | pnp_for_each_dev(dev) { 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.790 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/pnp/resource.c:23: 2023-11-18T19:23:05.791 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:456:25: note: while referencing ‘pnp_global’ 2023-11-18T19:23:05.791 INFO:tasks.workunit.client.1.smithi135.stderr: 456 | extern struct list_head pnp_global; 2023-11-18T19:23:05.791 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.805 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/ethtool.o 2023-11-18T19:23:05.845 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/list.h:9, 2023-11-18T19:23:05.845 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/module.h:9, 2023-11-18T19:23:05.845 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/pnp/resource.c:11: 2023-11-18T19:23:05.845 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c: In function ‘pnp_check_port’: 2023-11-18T19:23:05.845 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/kernel.h:997:10: warning: array subscript -45 is outside array bounds of ‘struct list_head[1]’ [-Warray-bounds] 2023-11-18T19:23:05.845 INFO:tasks.workunit.client.1.smithi135.stderr: 997 | ((type *)(__mptr - offsetof(type, member))); }) 2023-11-18T19:23:05.845 INFO:tasks.workunit.client.1.smithi135.stderr: | ~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.846 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/list.h:479:9: note: in expansion of macro ‘container_of’ 2023-11-18T19:23:05.846 INFO:tasks.workunit.client.1.smithi135.stderr: 479 | container_of(ptr, type, member) 2023-11-18T19:23:05.846 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~ 2023-11-18T19:23:05.846 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:275:30: note: in expansion of macro ‘list_entry’ 2023-11-18T19:23:05.846 INFO:tasks.workunit.client.1.smithi135.stderr: 275 | #define global_to_pnp_dev(n) list_entry(n, struct pnp_dev, global_list) 2023-11-18T19:23:05.846 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.846 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:281:18: note: in expansion of macro ‘global_to_pnp_dev’ 2023-11-18T19:23:05.847 INFO:tasks.workunit.client.1.smithi135.stderr: 281 | (dev) != global_to_pnp_dev(&pnp_global); \ 2023-11-18T19:23:05.847 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.847 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c:207:9: note: in expansion of macro ‘pnp_for_each_dev’ 2023-11-18T19:23:05.847 INFO:tasks.workunit.client.1.smithi135.stderr: 207 | pnp_for_each_dev(tdev) { 2023-11-18T19:23:05.847 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.847 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/pnp/resource.c:23: 2023-11-18T19:23:05.847 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:456:25: note: while referencing ‘pnp_global’ 2023-11-18T19:23:05.848 INFO:tasks.workunit.client.1.smithi135.stderr: 456 | extern struct list_head pnp_global; 2023-11-18T19:23:05.848 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.868 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/list.h:9, 2023-11-18T19:23:05.868 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/module.h:9, 2023-11-18T19:23:05.868 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/pnp/resource.c:11: 2023-11-18T19:23:05.868 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c: In function ‘pnp_check_mem’: 2023-11-18T19:23:05.868 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/kernel.h:997:10: warning: array subscript -45 is outside array bounds of ‘struct list_head[1]’ [-Warray-bounds] 2023-11-18T19:23:05.869 INFO:tasks.workunit.client.1.smithi135.stderr: 997 | ((type *)(__mptr - offsetof(type, member))); }) 2023-11-18T19:23:05.869 INFO:tasks.workunit.client.1.smithi135.stderr: | ~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.869 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/list.h:479:9: note: in expansion of macro ‘container_of’ 2023-11-18T19:23:05.869 INFO:tasks.workunit.client.1.smithi135.stderr: 479 | container_of(ptr, type, member) 2023-11-18T19:23:05.869 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~ 2023-11-18T19:23:05.869 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:275:30: note: in expansion of macro ‘list_entry’ 2023-11-18T19:23:05.869 INFO:tasks.workunit.client.1.smithi135.stderr: 275 | #define global_to_pnp_dev(n) list_entry(n, struct pnp_dev, global_list) 2023-11-18T19:23:05.870 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.870 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:281:18: note: in expansion of macro ‘global_to_pnp_dev’ 2023-11-18T19:23:05.870 INFO:tasks.workunit.client.1.smithi135.stderr: 281 | (dev) != global_to_pnp_dev(&pnp_global); \ 2023-11-18T19:23:05.870 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.870 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c:270:9: note: in expansion of macro ‘pnp_for_each_dev’ 2023-11-18T19:23:05.870 INFO:tasks.workunit.client.1.smithi135.stderr: 270 | pnp_for_each_dev(tdev) { 2023-11-18T19:23:05.871 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.871 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/pnp/resource.c:23: 2023-11-18T19:23:05.871 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:456:25: note: while referencing ‘pnp_global’ 2023-11-18T19:23:05.871 INFO:tasks.workunit.client.1.smithi135.stderr: 456 | extern struct list_head pnp_global; 2023-11-18T19:23:05.871 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.892 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/list.h:9, 2023-11-18T19:23:05.892 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/module.h:9, 2023-11-18T19:23:05.892 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/pnp/resource.c:11: 2023-11-18T19:23:05.893 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c: In function ‘pnp_check_irq’: 2023-11-18T19:23:05.893 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/kernel.h:997:10: warning: array subscript -45 is outside array bounds of ‘struct list_head[1]’ [-Warray-bounds] 2023-11-18T19:23:05.893 INFO:tasks.workunit.client.1.smithi135.stderr: 997 | ((type *)(__mptr - offsetof(type, member))); }) 2023-11-18T19:23:05.893 INFO:tasks.workunit.client.1.smithi135.stderr: | ~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.893 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/list.h:479:9: note: in expansion of macro ‘container_of’ 2023-11-18T19:23:05.894 INFO:tasks.workunit.client.1.smithi135.stderr: 479 | container_of(ptr, type, member) 2023-11-18T19:23:05.894 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~ 2023-11-18T19:23:05.894 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:275:30: note: in expansion of macro ‘list_entry’ 2023-11-18T19:23:05.894 INFO:tasks.workunit.client.1.smithi135.stderr: 275 | #define global_to_pnp_dev(n) list_entry(n, struct pnp_dev, global_list) 2023-11-18T19:23:05.894 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.895 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:281:18: note: in expansion of macro ‘global_to_pnp_dev’ 2023-11-18T19:23:05.895 INFO:tasks.workunit.client.1.smithi135.stderr: 281 | (dev) != global_to_pnp_dev(&pnp_global); \ 2023-11-18T19:23:05.895 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.895 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c:397:9: note: in expansion of macro ‘pnp_for_each_dev’ 2023-11-18T19:23:05.895 INFO:tasks.workunit.client.1.smithi135.stderr: 397 | pnp_for_each_dev(tdev) { 2023-11-18T19:23:05.895 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.895 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/pnp/resource.c:23: 2023-11-18T19:23:05.896 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:456:25: note: while referencing ‘pnp_global’ 2023-11-18T19:23:05.896 INFO:tasks.workunit.client.1.smithi135.stderr: 456 | extern struct list_head pnp_global; 2023-11-18T19:23:05.896 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.920 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from ./include/linux/list.h:9, 2023-11-18T19:23:05.921 INFO:tasks.workunit.client.1.smithi135.stderr: from ./include/linux/module.h:9, 2023-11-18T19:23:05.921 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/pnp/resource.c:11: 2023-11-18T19:23:05.921 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c: In function ‘pnp_check_dma’: 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/kernel.h:997:10: warning: array subscript -45 is outside array bounds of ‘struct list_head[1]’ [-Warray-bounds] 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr: 997 | ((type *)(__mptr - offsetof(type, member))); }) 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr: | ~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/list.h:479:9: note: in expansion of macro ‘container_of’ 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr: 479 | container_of(ptr, type, member) 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~ 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:275:30: note: in expansion of macro ‘list_entry’ 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr: 275 | #define global_to_pnp_dev(n) list_entry(n, struct pnp_dev, global_list) 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:05.922 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:281:18: note: in expansion of macro ‘global_to_pnp_dev’ 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr: 281 | (dev) != global_to_pnp_dev(&pnp_global); \ 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/pnp/resource.c:456:9: note: in expansion of macro ‘pnp_for_each_dev’ 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr: 456 | pnp_for_each_dev(tdev) { 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/pnp/resource.c:23: 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/pnp.h:456:25: note: while referencing ‘pnp_global’ 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr: 456 | extern struct list_head pnp_global; 2023-11-18T19:23:05.923 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~ 2023-11-18T19:23:06.372 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/rom.o 2023-11-18T19:23:06.518 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/manager.o 2023-11-18T19:23:06.632 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ptp/ptp_sysfs.o 2023-11-18T19:23:06.637 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/support.o 2023-11-18T19:23:06.718 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/interface.o 2023-11-18T19:23:06.729 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/myricom/built-in.a 2023-11-18T19:23:06.787 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gem/i915_gemfs.o 2023-11-18T19:23:07.031 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/setup-res.o 2023-11-18T19:23:07.112 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/netdev.o 2023-11-18T19:23:07.195 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ras/ras.o 2023-11-18T19:23:07.248 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/ptp/built-in.a 2023-11-18T19:23:07.264 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_irq.o 2023-11-18T19:23:07.295 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/natsemi/built-in.a 2023-11-18T19:23:07.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/quirks.o 2023-11-18T19:23:07.345 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_active.o 2023-11-18T19:23:07.553 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/irq.o 2023-11-18T19:23:07.743 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/vpd.o 2023-11-18T19:23:07.786 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/ras/debugfs.o 2023-11-18T19:23:07.922 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/setup-bus.o 2023-11-18T19:23:08.016 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pnp/system.o 2023-11-18T19:23:08.143 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_memory.o 2023-11-18T19:23:08.186 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_drv.o 2023-11-18T19:23:08.276 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/ras/built-in.a 2023-11-18T19:23:08.351 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/neterion/built-in.a 2023-11-18T19:23:08.398 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/intel/e1000e/ptp.o 2023-11-18T19:23:08.486 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pnp/built-in.a 2023-11-18T19:23:08.533 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_pci.o 2023-11-18T19:23:08.549 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_buddy.o 2023-11-18T19:23:08.569 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/lib.o 2023-11-18T19:23:08.853 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/systohc.o 2023-11-18T19:23:09.091 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/netronome/built-in.a 2023-11-18T19:23:09.135 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/vc.o 2023-11-18T19:23:09.203 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/scsi/pcmcia/built-in.a 2023-11-18T19:23:09.242 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_cmd_parser.o 2023-11-18T19:23:09.259 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/ni/built-in.a 2023-11-18T19:23:09.272 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi.o 2023-11-18T19:23:09.275 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/class.o 2023-11-18T19:23:09.307 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_sysfs.o 2023-11-18T19:23:09.328 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/amlogic/built-in.a 2023-11-18T19:23:09.378 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/bcm/built-in.a 2023-11-18T19:23:09.378 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/thermal/broadcom/built-in.a 2023-11-18T19:23:09.423 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/thermal/intel/built-in.a 2023-11-18T19:23:09.427 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/fsl/built-in.a 2023-11-18T19:23:09.453 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] drivers/thermal/intel/x86_pkg_temp_thermal.o 2023-11-18T19:23:09.491 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/mediatek/built-in.a 2023-11-18T19:23:09.545 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/qcom/built-in.a 2023-11-18T19:23:09.591 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/renesas/built-in.a 2023-11-18T19:23:09.638 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/sunxi/built-in.a 2023-11-18T19:23:09.684 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/ti/built-in.a 2023-11-18T19:23:09.729 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/xilinx/built-in.a 2023-11-18T19:23:09.759 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/soc/built-in.a 2023-11-18T19:23:09.844 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/thermal/samsung/built-in.a 2023-11-18T19:23:09.893 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/tty/ipwireless/built-in.a 2023-11-18T19:23:09.944 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_core.o 2023-11-18T19:23:10.926 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/intel/e1000e/built-in.a 2023-11-18T19:23:11.016 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_gem_evict.o 2023-11-18T19:23:11.105 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/interface.o 2023-11-18T19:23:11.134 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/mmap.o 2023-11-18T19:23:11.150 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/setup-irq.o 2023-11-18T19:23:11.434 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/thermal/st/built-in.a 2023-11-18T19:23:11.673 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/thermal/tegra/built-in.a 2023-11-18T19:23:11.784 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/thermal/thermal_core.o 2023-11-18T19:23:11.898 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/intel/built-in.a 2023-11-18T19:23:11.914 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/hosts.o 2023-11-18T19:23:11.950 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_pnp.o 2023-11-18T19:23:12.203 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/nvidia/forcedeth.o 2023-11-18T19:23:12.371 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/class/usblp.o 2023-11-18T19:23:12.588 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/proc.o 2023-11-18T19:23:12.803 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_gem_fence_reg.o 2023-11-18T19:23:12.952 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/nvmem.o 2023-11-18T19:23:12.958 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_ioctl.o 2023-11-18T19:23:13.022 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_port.o 2023-11-18T19:23:13.304 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/class/built-in.a 2023-11-18T19:23:13.362 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/slot.o 2023-11-18T19:23:13.400 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/common/common.o 2023-11-18T19:23:13.507 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/dev.o 2023-11-18T19:23:13.592 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/thermal/thermal_sysfs.o 2023-11-18T19:23:13.686 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsicam.o 2023-11-18T19:23:13.990 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/common/debug.o 2023-11-18T19:23:13.999 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_gem_gtt.o 2023-11-18T19:23:14.120 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pci-acpi.o 2023-11-18T19:23:14.145 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/proc.o 2023-11-18T19:23:14.283 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/thermal/thermal_helpers.o 2023-11-18T19:23:14.402 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_error.o 2023-11-18T19:23:14.459 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/common/built-in.a 2023-11-18T19:23:14.498 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_dma.o 2023-11-18T19:23:14.574 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/usb.o 2023-11-18T19:23:14.667 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/sysfs.o 2023-11-18T19:23:14.834 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/thermal/thermal_hwmon.o 2023-11-18T19:23:15.035 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/nvidia/built-in.a 2023-11-18T19:23:15.039 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/quirks.o 2023-11-18T19:23:15.103 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/oki-semi/built-in.a 2023-11-18T19:23:15.149 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/packetengines/built-in.a 2023-11-18T19:23:15.191 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/pensando/built-in.a 2023-11-18T19:23:15.237 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/qlogic/built-in.a 2023-11-18T19:23:15.250 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_dwlib.o 2023-11-18T19:23:15.297 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/qualcomm/emac/built-in.a 2023-11-18T19:23:15.300 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/rtc-mc146818-lib.o 2023-11-18T19:23:15.337 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/qualcomm/built-in.a 2023-11-18T19:23:15.372 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/thermal/step_wise.o 2023-11-18T19:23:15.391 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/rdc/built-in.a 2023-11-18T19:23:15.458 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/realtek/8139too.o 2023-11-18T19:23:15.507 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/hub.o 2023-11-18T19:23:15.725 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_lib.o 2023-11-18T19:23:15.865 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/thermal/user_space.o 2023-11-18T19:23:15.899 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_pci.o 2023-11-18T19:23:15.908 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/rtc/rtc-cmos.o 2023-11-18T19:23:16.349 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/thermal/built-in.a 2023-11-18T19:23:16.407 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_hashtab.o 2023-11-18T19:23:16.437 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_gem.o 2023-11-18T19:23:16.726 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/msi.o 2023-11-18T19:23:16.810 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/rtc/built-in.a 2023-11-18T19:23:16.812 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/realtek/r8169_main.o 2023-11-18T19:23:16.873 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/serial_core.o 2023-11-18T19:23:17.075 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/vt_ioctl.o 2023-11-18T19:23:17.158 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_exar.o 2023-11-18T19:23:17.252 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/constants.o 2023-11-18T19:23:17.716 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/hcd.o 2023-11-18T19:23:17.956 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/ats.o 2023-11-18T19:23:17.973 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_lib_dma.o 2023-11-18T19:23:18.038 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_early.o 2023-11-18T19:23:18.137 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/vc_screen.o 2023-11-18T19:23:18.167 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_globals.o 2023-11-18T19:23:18.428 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/urb.o 2023-11-18T19:23:18.607 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_lpss.o 2023-11-18T19:23:18.656 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_scan.o 2023-11-18T19:23:18.693 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/pci/pci-label.o 2023-11-18T19:23:18.928 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/selection.o 2023-11-18T19:23:18.948 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_query.o 2023-11-18T19:23:19.123 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/backlight/backlight.o 2023-11-18T19:23:19.355 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/message.o 2023-11-18T19:23:19.396 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/pci/built-in.a 2023-11-18T19:23:19.398 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/8250/8250_mid.o 2023-11-18T19:23:19.494 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/backlight/generic_bl.o 2023-11-18T19:23:19.653 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/keyboard.o 2023-11-18T19:23:19.799 INFO:tasks.workunit.client.1.smithi135.stdout: GEN drivers/scsi/scsi_devinfo_tbl.c 2023-11-18T19:23:19.822 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_devinfo.o 2023-11-18T19:23:19.846 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/net/ethernet/realtek/r8169_firmware.o 2023-11-18T19:23:19.875 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/driver.o 2023-11-18T19:23:20.007 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_request.o 2023-11-18T19:23:20.075 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/backlight/built-in.a 2023-11-18T19:23:20.164 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/console/dummycon.o 2023-11-18T19:23:20.204 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/tty/serial/8250/built-in.a 2023-11-18T19:23:20.263 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/serial/earlycon.o 2023-11-18T19:23:20.309 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/realtek/built-in.a 2023-11-18T19:23:20.360 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/renesas/built-in.a 2023-11-18T19:23:20.404 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/rocker/built-in.a 2023-11-18T19:23:20.445 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/samsung/built-in.a 2023-11-18T19:23:20.494 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/seeq/built-in.a 2023-11-18T19:23:20.537 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/sfc/built-in.a 2023-11-18T19:23:20.582 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/silan/built-in.a 2023-11-18T19:23:20.626 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/sis/built-in.a 2023-11-18T19:23:20.645 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_sysctl.o 2023-11-18T19:23:20.677 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/smsc/built-in.a 2023-11-18T19:23:20.701 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/console/vgacon.o 2023-11-18T19:23:20.719 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/socionext/built-in.a 2023-11-18T19:23:20.764 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/stmicro/built-in.a 2023-11-18T19:23:20.775 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_mm.o 2023-11-18T19:23:20.808 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/sun/built-in.a 2023-11-18T19:23:20.847 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/synopsys/built-in.a 2023-11-18T19:23:20.890 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/config.o 2023-11-18T19:23:20.891 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/tehuti/built-in.a 2023-11-18T19:23:20.946 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/tty/serial/built-in.a 2023-11-18T19:23:20.993 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/ti/built-in.a 2023-11-18T19:23:21.119 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/via/built-in.a 2023-11-18T19:23:21.235 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/wiznet/built-in.a 2023-11-18T19:23:21.371 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/xilinx/built-in.a 2023-11-18T19:23:21.476 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_proc.o 2023-11-18T19:23:21.486 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/xircom/built-in.a 2023-11-18T19:23:21.600 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/ethernet/built-in.a 2023-11-18T19:23:21.758 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/consolemap.o 2023-11-18T19:23:21.902 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_io.o 2023-11-18T19:23:21.921 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/early/ehci-dbgp.o 2023-11-18T19:23:22.053 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_scheduler.o 2023-11-18T19:23:22.060 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/console/built-in.a 2023-11-18T19:23:22.145 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fb_cmdline.o 2023-11-18T19:23:22.211 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/net/built-in.a 2023-11-18T19:23:22.343 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fb_notify.o 2023-11-18T19:23:22.377 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_debugfs.o 2023-11-18T19:23:22.453 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c: In function ‘_dbgp_external_startup’: 2023-11-18T19:23:22.454 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:621:24: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.454 INFO:tasks.workunit.client.1.smithi135.stderr: 621 | portsc = readl(&ehci_regs->port_status[port - 1]); 2023-11-18T19:23:22.454 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.454 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.454 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.455 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.455 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.455 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:624:24: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.455 INFO:tasks.workunit.client.1.smithi135.stderr: 624 | writel(portsc, &ehci_regs->port_status[port - 1]); 2023-11-18T19:23:22.455 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.455 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.456 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.456 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.456 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.456 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:630:32: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.456 INFO:tasks.workunit.client.1.smithi135.stderr: 630 | portsc = readl(&ehci_regs->port_status[port - 1]); 2023-11-18T19:23:22.456 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.456 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:638:25: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr: 638 | &ehci_regs->port_status[port - 1]); 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.457 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:641:40: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr: 641 | portsc = readl(&ehci_regs->port_status[port-1]); 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.458 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.459 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:551:24: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.459 INFO:tasks.workunit.client.1.smithi135.stderr: 551 | portsc = readl(&ehci_regs->port_status[dbg_port - 1]); 2023-11-18T19:23:22.459 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.459 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.459 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.459 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.459 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.460 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:553:24: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.460 INFO:tasks.workunit.client.1.smithi135.stderr: 553 | writel(portsc, &ehci_regs->port_status[dbg_port - 1]); 2023-11-18T19:23:22.460 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.460 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.460 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.460 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.460 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:514:32: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr: 514 | portsc = readl(&ehci_regs->port_status[dbg_port - 1]); 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:523:40: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr: 523 | portsc = readl(&ehci_regs->port_status[dbg_port - 1]); 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.461 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.462 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.462 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.462 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:525:40: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.462 INFO:tasks.workunit.client.1.smithi135.stderr: 525 | writel(portsc, &ehci_regs->port_status[dbg_port - 1]); 2023-11-18T19:23:22.462 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.463 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.463 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.463 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.463 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.479 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/file.o 2023-11-18T19:23:22.506 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c: In function ‘early_dbgp_init’: 2023-11-18T19:23:22.506 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/early/ehci-dbgp.c:781:32: warning: array subscript 15 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:22.506 INFO:tasks.workunit.client.1.smithi135.stderr: 781 | portsc = readl(&ehci_regs->port_status[i-1]); 2023-11-18T19:23:22.506 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:22.507 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/early/ehci-dbgp.c:21: 2023-11-18T19:23:22.507 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:22.507 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:22.507 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:22.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:23:22.582 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:23:22.685 INFO:tasks.workunit.client.1.smithi135.stdout: CONMK drivers/tty/vt/consolemap_deftbl.c 2023-11-18T19:23:22.709 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/vt.o 2023-11-18T19:23:22.748 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/early/built-in.a 2023-11-18T19:23:22.773 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/n_tty.o 2023-11-18T19:23:22.825 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_crtc.o 2023-11-18T19:23:22.921 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fbmem.o 2023-11-18T19:23:23.041 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_trace.o 2023-11-18T19:23:23.133 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/buffer.o 2023-11-18T19:23:23.187 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_trace_points.o 2023-11-18T19:23:23.454 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/sysfs.o 2023-11-18T19:23:23.733 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/logo/logo.o 2023-11-18T19:23:23.788 INFO:tasks.workunit.client.1.smithi135.stdout: LOGO drivers/video/logo/logo_linux_clut224.c 2023-11-18T19:23:23.806 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_logging.o 2023-11-18T19:23:23.811 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_pm.o 2023-11-18T19:23:24.079 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fbmon.o 2023-11-18T19:23:24.153 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/logo/logo_linux_clut224.o 2023-11-18T19:23:24.268 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/pci-quirks.o 2023-11-18T19:23:24.300 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/logo/built-in.a 2023-11-18T19:23:24.347 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/endpoint.o 2023-11-18T19:23:24.359 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/watchdog/built-in.a 2023-11-18T19:23:24.406 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_ioctl.o 2023-11-18T19:23:24.538 INFO:tasks.workunit.client.1.smithi135.stdout: SHIPPED drivers/tty/vt/defkeymap.c 2023-11-18T19:23:24.558 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_fourcc.o 2023-11-18T19:23:24.642 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_common.o 2023-11-18T19:23:24.887 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_transport_spi.o 2023-11-18T19:23:24.991 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/devio.o 2023-11-18T19:23:25.028 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/consolemap_deftbl.o 2023-11-18T19:23:25.032 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/sd.o 2023-11-18T19:23:25.148 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/vt/defkeymap.o 2023-11-18T19:23:25.161 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/ehci-hcd.o 2023-11-18T19:23:25.164 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fbcmap.o 2023-11-18T19:23:25.228 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/hdmi.o 2023-11-18T19:23:25.389 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/tty/vt/built-in.a 2023-11-18T19:23:25.412 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_vma.o 2023-11-18T19:23:25.490 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_ldisc.o 2023-11-18T19:23:25.847 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fbsysfs.o 2023-11-18T19:23:26.058 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_modes.o 2023-11-18T19:23:26.078 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.078 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘ehci_port_handed_over’: 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:1331:15: warning: array subscript ‘’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr: 1331 | reg = &ehci->regs->port_status[portnum - 1]; 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.079 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘set_owner’: 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:541:22: warning: array subscript ‘portnum’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr: 541 | status_reg = &ehci->regs->port_status[portnum]; 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.094 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.149 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.149 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘ehci_adjust_port_wakeup_flags.part.0’: 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:167:55: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr: 167 | u32 __iomem *hostpc_reg = &ehci->regs->hostpc[port]; 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:184:25: note: while referencing ‘hostpc’ 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr: 184 | u32 hostpc[0]; /* HOSTPC extension */ 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~ 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:199:55: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr: 199 | u32 __iomem *hostpc_reg = &ehci->regs->hostpc[port]; 2023-11-18T19:23:26.150 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:184:25: note: while referencing ‘hostpc’ 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr: 184 | u32 hostpc[0]; /* HOSTPC extension */ 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~ 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:141:38: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr: 141 | if (ehci_readl(ehci, &ehci->regs->port_status[i]) & PORT_CSC) 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.151 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:179:40: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr: 179 | u32 __iomem *reg = &ehci->regs->port_status[port]; 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.152 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘ehci_port_power.isra’: 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:1338:35: warning: array subscript ‘portnum’ is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr: 1338 | u32 __iomem *status_reg = &ehci->regs->port_status[portnum]; 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.249 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.273 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_buffer.o 2023-11-18T19:23:26.285 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/fbdev/omap2/omapfb/displays/built-in.a 2023-11-18T19:23:26.328 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/fbdev/omap2/omapfb/dss/built-in.a 2023-11-18T19:23:26.364 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/fbdev/omap2/omapfb/built-in.a 2023-11-18T19:23:26.392 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.392 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘ehci_hub_status_data’: 2023-11-18T19:23:26.392 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:662:49: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.393 INFO:tasks.workunit.client.1.smithi135.stderr: 662 | temp = ehci_readl(ehci, &ehci->regs->port_status[i]); 2023-11-18T19:23:26.393 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.393 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.393 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.393 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.393 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.393 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.404 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/fbdev/omap2/built-in.a 2023-11-18T19:23:26.451 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/notify.o 2023-11-18T19:23:26.482 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hcd.c: In function ‘ehci_silence_controller’: 2023-11-18T19:23:26.482 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hcd.c:326:33: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.482 INFO:tasks.workunit.client.1.smithi135.stderr: 326 | &ehci->regs->port_status[port]); 2023-11-18T19:23:26.483 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.483 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.483 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.483 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.483 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.483 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.584 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/modedb.o 2023-11-18T19:23:26.681 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/ehci-pci.o 2023-11-18T19:23:26.837 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/sr.o 2023-11-18T19:23:26.937 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/intel_wopcm.o 2023-11-18T19:23:26.968 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘ehci_hub_control’: 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:891:22: warning: array subscript 256 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr: 891 | status_reg = &ehci->regs->port_status[temp]; 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:26.969 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:892:22: warning: array subscript 256 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr: 892 | hostpc_reg = &ehci->regs->hostpc[temp]; 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:184:25: note: while referencing ‘hostpc’ 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr: 184 | u32 hostpc[0]; /* HOSTPC extension */ 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~ 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:1281:49: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:26.970 INFO:tasks.workunit.client.1.smithi135.stderr: 1281 | &ehci->regs->port_status[ports]; 2023-11-18T19:23:26.971 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:26.971 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:26.971 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:26.971 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:26.971 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:26.971 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.010 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_port.o 2023-11-18T19:23:27.031 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/generic.o 2023-11-18T19:23:27.070 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.070 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘ehci_bus_resume’: 2023-11-18T19:23:27.070 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:427:41: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.070 INFO:tasks.workunit.client.1.smithi135.stderr: 427 | temp = ehci_readl(ehci, &ehci->regs->port_status[i]); 2023-11-18T19:23:27.070 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.071 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.071 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.071 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.071 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.071 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.071 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.071 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:447:57: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.072 INFO:tasks.workunit.client.1.smithi135.stderr: 447 | &ehci->regs->hostpc[i]; 2023-11-18T19:23:27.072 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.072 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.072 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.072 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:184:25: note: while referencing ‘hostpc’ 2023-11-18T19:23:27.072 INFO:tasks.workunit.client.1.smithi135.stderr: 184 | u32 hostpc[0]; /* HOSTPC extension */ 2023-11-18T19:23:27.072 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~ 2023-11-18T19:23:27.073 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.073 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:110:31: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.073 INFO:tasks.workunit.client.1.smithi135.stderr: 110 | reg = &ehci->regs->port_status[port]; 2023-11-18T19:23:27.073 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.073 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.073 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.074 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.074 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.074 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.074 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.074 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:73:31: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: 73 | reg = &ehci->regs->port_status[port]; 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:59:31: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: 59 | reg = &ehci->regs->port_status[port]; 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.075 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:488:41: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr: 488 | temp = ehci_readl(ehci, &ehci->regs->port_status [i]); 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.076 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:491:49: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr: 491 | ehci_writel(ehci, temp, &ehci->regs->port_status [i]); 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:464:41: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr: 464 | temp = ehci_readl(ehci, &ehci->regs->port_status [i]); 2023-11-18T19:23:27.077 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:471:41: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr: 471 | ehci_writel(ehci, temp, &ehci->regs->port_status [i]); 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.078 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.079 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.079 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.120 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/ohci-hcd.o 2023-11-18T19:23:27.258 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.258 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c: In function ‘ehci_bus_suspend’: 2023-11-18T19:23:27.258 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:320:55: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.258 INFO:tasks.workunit.client.1.smithi135.stderr: 320 | u32 __iomem *hostpc_reg = &ehci->regs->hostpc[port]; 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:184:25: note: while referencing ‘hostpc’ 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr: 184 | u32 hostpc[0]; /* HOSTPC extension */ 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~ 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci-hcd.c:305: 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hub.c:258:40: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr: 258 | u32 __iomem *reg = &ehci->regs->port_status [port]; 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.259 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.260 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.260 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.260 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.295 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hcd.c: In function ‘ehci_irq’: 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/host/ehci-hcd.c:786:42: warning: array subscript 14 is outside the bounds of an interior zero-length array ‘u32[0]’ {aka ‘unsigned int[]’} [-Wzero-length-bounds] 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr: 786 | &ehci->regs->port_status[i]); 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/usb/host/ehci.h:273, 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr: from drivers/usb/host/ehci-hcd.c:96: 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr:./include/linux/usb/ehci_def.h:130:25: note: while referencing ‘port_status’ 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr: 130 | u32 port_status[0]; /* up to N_PORTS */ 2023-11-18T19:23:27.296 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~ 2023-11-18T19:23:27.354 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/misc/built-in.a 2023-11-18T19:23:27.395 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fbcvt.o 2023-11-18T19:23:27.417 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/efifb.o 2023-11-18T19:23:27.637 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/quirks.o 2023-11-18T19:23:27.713 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_uc.o 2023-11-18T19:23:27.746 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/sr_ioctl.o 2023-11-18T19:23:27.789 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_mutex.o 2023-11-18T19:23:27.949 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_edid.o 2023-11-18T19:23:28.042 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fb_defio.o 2023-11-18T19:23:28.274 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/devices.o 2023-11-18T19:23:28.401 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_ldsem.o 2023-11-18T19:23:28.462 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/mon/mon_main.o 2023-11-18T19:23:28.569 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/sr_vendor.o 2023-11-18T19:23:28.830 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/ohci-pci.o 2023-11-18T19:23:28.849 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_uc_fw.o 2023-11-18T19:23:28.853 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fbcon.o 2023-11-18T19:23:29.010 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_baudrate.o 2023-11-18T19:23:29.086 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/phy.o 2023-11-18T19:23:29.100 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/mon/mon_stat.o 2023-11-18T19:23:29.295 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/sg.o 2023-11-18T19:23:29.499 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/uhci-hcd.o 2023-11-18T19:23:29.544 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_jobctrl.o 2023-11-18T19:23:29.584 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/port.o 2023-11-18T19:23:29.613 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/mon/mon_text.o 2023-11-18T19:23:29.914 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/bitblit.o 2023-11-18T19:23:29.951 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc.o 2023-11-18T19:23:30.227 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/n_null.o 2023-11-18T19:23:30.301 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/hcd-pci.o 2023-11-18T19:23:30.420 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/mon/mon_bin.o 2023-11-18T19:23:30.720 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/pty.o 2023-11-18T19:23:30.861 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/softcursor.o 2023-11-18T19:23:30.939 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci.o 2023-11-18T19:23:31.661 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/core/usb-acpi.o 2023-11-18T19:23:31.822 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/scsi/scsi_sysfs.o 2023-11-18T19:23:31.918 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_encoder_slave.o 2023-11-18T19:23:31.926 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/mon/built-in.a 2023-11-18T19:23:32.018 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_ads.o 2023-11-18T19:23:32.199 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/tileblit.o 2023-11-18T19:23:32.264 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_trace_points.o 2023-11-18T19:23:32.332 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/tty_audit.o 2023-11-18T19:23:32.563 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/core/built-in.a 2023-11-18T19:23:32.646 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_prime.o 2023-11-18T19:23:32.664 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/tty/sysrq.o 2023-11-18T19:23:32.914 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/cfbfillrect.o 2023-11-18T19:23:33.004 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-mem.o 2023-11-18T19:23:33.008 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_ct.o 2023-11-18T19:23:33.109 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/scsi/built-in.a 2023-11-18T19:23:33.366 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-ext-caps.o 2023-11-18T19:23:33.376 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/phy/built-in.a 2023-11-18T19:23:33.436 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/scsiglue.o 2023-11-18T19:23:33.698 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/cfbcopyarea.o 2023-11-18T19:23:33.770 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/protocol.o 2023-11-18T19:23:33.800 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/tty/built-in.a 2023-11-18T19:23:33.900 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/cfbimgblt.o 2023-11-18T19:23:34.025 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_rect.o 2023-11-18T19:23:34.039 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_fw.o 2023-11-18T19:23:34.265 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_log.o 2023-11-18T19:23:34.343 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/sysfillrect.o 2023-11-18T19:23:34.391 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-ring.o 2023-11-18T19:23:34.458 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/transport.o 2023-11-18T19:23:34.530 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-hub.o 2023-11-18T19:23:34.607 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/usb.o 2023-11-18T19:23:34.822 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_submission.o 2023-11-18T19:23:35.010 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/syscopyarea.o 2023-11-18T19:23:35.050 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/sysimgblt.o 2023-11-18T19:23:35.172 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘usb_stor_bulk_srb’, 2023-11-18T19:23:35.172 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘usb_stor_CB_transport’ at drivers/usb/storage/transport.c:982:12: 2023-11-18T19:23:35.174 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/storage/transport.c:469:47: warning: ‘partial’ may be used uninitialized [-Wmaybe-uninitialized] 2023-11-18T19:23:35.174 INFO:tasks.workunit.client.1.smithi135.stderr: 469 | scsi_set_resid(srb, scsi_bufflen(srb) - partial); 2023-11-18T19:23:35.174 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~~~~~~~~~~~~~~~^~~~~~~~~ 2023-11-18T19:23:35.174 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/storage/transport.c: In function ‘usb_stor_CB_transport’: 2023-11-18T19:23:35.175 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/usb/storage/transport.c:464:22: note: ‘partial’ declared here 2023-11-18T19:23:35.175 INFO:tasks.workunit.client.1.smithi135.stderr: 464 | unsigned int partial; 2023-11-18T19:23:35.175 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~ 2023-11-18T19:23:35.355 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-dbg.o 2023-11-18T19:23:35.408 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_vma_manager.o 2023-11-18T19:23:35.539 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/initializers.o 2023-11-18T19:23:35.687 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_flip_work.o 2023-11-18T19:23:35.688 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/video/fbdev/core/fb_sys_fops.o 2023-11-18T19:23:35.870 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_huc.o 2023-11-18T19:23:35.873 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_modeset_lock.o 2023-11-18T19:23:36.631 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/fbdev/core/built-in.a 2023-11-18T19:23:36.791 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/fbdev/built-in.a 2023-11-18T19:23:36.806 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/sierra_ms.o 2023-11-18T19:23:36.842 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/option_ms.o 2023-11-18T19:23:36.850 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_atomic.o 2023-11-18T19:23:36.870 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/video/built-in.a 2023-11-18T19:23:36.941 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/storage/usual-tables.o 2023-11-18T19:23:36.944 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-trace.o 2023-11-18T19:23:36.963 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_bridge.o 2023-11-18T19:23:37.128 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-debugfs.o 2023-11-18T19:23:37.364 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_huc_fw.o 2023-11-18T19:23:37.471 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/usb/host/xhci-pci.o 2023-11-18T19:23:37.514 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/storage/built-in.a 2023-11-18T19:23:37.524 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_atomic.o 2023-11-18T19:23:37.590 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_framebuffer.o 2023-11-18T19:23:37.657 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_atomic_plane.o 2023-11-18T19:23:38.007 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_connector.o 2023-11-18T19:23:38.011 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_blend.o 2023-11-18T19:23:38.361 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_encoder.o 2023-11-18T19:23:38.412 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_audio.o 2023-11-18T19:23:38.479 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/host/built-in.a 2023-11-18T19:23:38.555 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/usb/built-in.a 2023-11-18T19:23:38.568 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_bios.o 2023-11-18T19:23:38.683 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_bw.o 2023-11-18T19:23:38.733 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_cdclk.o 2023-11-18T19:23:38.733 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_mode_object.o 2023-11-18T19:23:38.986 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_color.o 2023-11-18T19:23:38.999 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_combo_phy.o 2023-11-18T19:23:39.174 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_connector.o 2023-11-18T19:23:39.542 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_display.o 2023-11-18T19:23:39.702 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_property.o 2023-11-18T19:23:39.832 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_plane.o 2023-11-18T19:23:40.137 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_color_mgmt.o 2023-11-18T19:23:40.160 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_print.o 2023-11-18T19:23:40.254 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_dumb_buffers.o 2023-11-18T19:23:40.475 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_mode_config.o 2023-11-18T19:23:40.567 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_vblank.o 2023-11-18T19:23:40.606 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_display_power.o 2023-11-18T19:23:40.780 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dpio_phy.o 2023-11-18T19:23:40.845 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dpll_mgr.o 2023-11-18T19:23:40.859 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_fbc.o 2023-11-18T19:23:40.874 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_fifo_underrun.o 2023-11-18T19:23:41.273 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_frontbuffer.o 2023-11-18T19:23:41.925 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_syncobj.o 2023-11-18T19:23:42.338 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_lease.o 2023-11-18T19:23:42.339 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_hdcp.o 2023-11-18T19:23:42.520 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_hotplug.o 2023-11-18T19:23:42.529 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_writeback.o 2023-11-18T19:23:42.698 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_client.o 2023-11-18T19:23:43.102 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_client_modeset.o 2023-11-18T19:23:43.620 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_atomic_uapi.o 2023-11-18T19:23:43.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_hdcp.o 2023-11-18T19:23:43.628 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_lpe_audio.o 2023-11-18T19:23:44.497 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_overlay.o 2023-11-18T19:23:44.513 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_ioc32.o 2023-11-18T19:23:44.519 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_psr.o 2023-11-18T19:23:44.520 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_panel.o 2023-11-18T19:23:44.522 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_quirks.o 2023-11-18T19:23:44.525 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_sprite.o 2023-11-18T19:23:44.529 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_agpsupport.o 2023-11-18T19:23:45.141 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_tc.o 2023-11-18T19:23:45.254 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_debugfs.o 2023-11-18T19:23:45.289 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_debugfs_crc.o 2023-11-18T19:23:45.561 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_mipi_dsi.o 2023-11-18T19:23:45.824 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/drm_panel_orientation_quirks.o 2023-11-18T19:23:45.891 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_acpi.o 2023-11-18T19:23:47.299 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_opregion.o 2023-11-18T19:23:47.343 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_fbdev.o 2023-11-18T19:23:47.344 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/dvo_ch7017.o 2023-11-18T19:23:47.358 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/dvo_ch7xxx.o 2023-11-18T19:23:47.383 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/dvo_ivch.o 2023-11-18T19:23:47.391 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/dvo_ns2501.o 2023-11-18T19:23:47.397 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/dvo_sil164.o 2023-11-18T19:23:47.438 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/dvo_tfp410.o 2023-11-18T19:23:48.545 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/icl_dsi.o 2023-11-18T19:23:48.594 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_crt.o 2023-11-18T19:23:48.606 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_ddi.o 2023-11-18T19:23:48.612 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dp.o 2023-11-18T19:23:48.625 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dp_aux_backlight.o 2023-11-18T19:23:48.657 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dp_link_training.o 2023-11-18T19:23:48.667 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dp_mst.o 2023-11-18T19:23:48.735 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dsi.o 2023-11-18T19:23:49.715 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/display/intel_dp.c:3636:56: warning: argument 2 of type ‘u8[6]’ {aka ‘unsigned char[6]’} with mismatched bound [-Warray-parameter=] 2023-11-18T19:23:49.715 INFO:tasks.workunit.client.1.smithi135.stderr: 3636 | intel_dp_get_link_status(struct intel_dp *intel_dp, u8 link_status[DP_LINK_STATUS_SIZE]) 2023-11-18T19:23:49.715 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:49.715 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/gpu/drm/i915/display/intel_dp.c:53: 2023-11-18T19:23:49.715 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/display/intel_dp.h:104:57: note: previously declared as ‘u8 *’ {aka ‘unsigned char *’} 2023-11-18T19:23:49.715 INFO:tasks.workunit.client.1.smithi135.stderr: 104 | intel_dp_get_link_status(struct intel_dp *intel_dp, u8 *link_status); 2023-11-18T19:23:49.715 INFO:tasks.workunit.client.1.smithi135.stderr: | ~~~~^~~~~~~~~~~ 2023-11-18T19:23:49.717 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dsi_dcs_backlight.o 2023-11-18T19:23:49.745 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dsi_vbt.o 2023-11-18T19:23:49.796 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_dvo.o 2023-11-18T19:23:49.830 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_gmbus.o 2023-11-18T19:23:49.850 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_hdmi.o 2023-11-18T19:23:50.195 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_lspcon.o 2023-11-18T19:23:50.805 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_lvds.o 2023-11-18T19:23:50.887 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_panel.o 2023-11-18T19:23:50.912 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_sdvo.o 2023-11-18T19:23:50.934 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_tv.o 2023-11-18T19:23:51.143 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/intel_vdsc.o 2023-11-18T19:23:51.340 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/vlv_dsi.o 2023-11-18T19:23:51.372 INFO:tasks.workunit.client.1.smithi135.stderr:In function ‘intel_dp_check_mst_status’, 2023-11-18T19:23:51.373 INFO:tasks.workunit.client.1.smithi135.stderr: inlined from ‘intel_dp_hpd_pulse’ at drivers/gpu/drm/i915/display/intel_dp.c:6298:7: 2023-11-18T19:23:51.374 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/display/intel_dp.c:4720:30: warning: ‘drm_dp_channel_eq_ok’ reading 6 bytes from a region of size 4 [-Wstringop-overread] 2023-11-18T19:23:51.374 INFO:tasks.workunit.client.1.smithi135.stderr: 4720 | !drm_dp_channel_eq_ok(&esi[10], intel_dp->lane_count)) { 2023-11-18T19:23:51.375 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:51.375 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/display/intel_dp.c: In function ‘intel_dp_hpd_pulse’: 2023-11-18T19:23:51.375 INFO:tasks.workunit.client.1.smithi135.stderr:drivers/gpu/drm/i915/display/intel_dp.c:4720:30: note: referencing argument 1 of type ‘const u8 *’ {aka ‘const unsigned char *’} 2023-11-18T19:23:51.375 INFO:tasks.workunit.client.1.smithi135.stderr:In file included from drivers/gpu/drm/i915/display/intel_dp.c:39: 2023-11-18T19:23:51.376 INFO:tasks.workunit.client.1.smithi135.stderr:./include/drm/drm_dp_helper.h:1044:6: note: in a call to function ‘drm_dp_channel_eq_ok’ 2023-11-18T19:23:51.376 INFO:tasks.workunit.client.1.smithi135.stderr: 1044 | bool drm_dp_channel_eq_ok(const u8 link_status[DP_LINK_STATUS_SIZE], 2023-11-18T19:23:51.376 INFO:tasks.workunit.client.1.smithi135.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-18T19:23:51.779 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/display/vlv_dsi_pll.o 2023-11-18T19:23:51.854 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_hsw.o 2023-11-18T19:23:52.045 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_bdw.o 2023-11-18T19:23:52.314 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_chv.o 2023-11-18T19:23:52.406 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_sklgt2.o 2023-11-18T19:23:52.458 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_sklgt3.o 2023-11-18T19:23:52.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:23:52.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:23:52.869 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_sklgt4.o 2023-11-18T19:23:52.928 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_bxt.o 2023-11-18T19:23:52.994 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_kblgt2.o 2023-11-18T19:23:53.032 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_kblgt3.o 2023-11-18T19:23:53.103 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_glk.o 2023-11-18T19:23:53.272 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_cflgt2.o 2023-11-18T19:23:53.345 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_cflgt3.o 2023-11-18T19:23:53.418 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_cnl.o 2023-11-18T19:23:53.847 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_icl.o 2023-11-18T19:23:53.900 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_perf.o 2023-11-18T19:23:53.957 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_gpu_error.o 2023-11-18T19:23:54.007 INFO:tasks.workunit.client.1.smithi135.stdout: CC drivers/gpu/drm/i915/i915_vgpu.o 2023-11-18T19:23:55.177 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/i915/built-in.a 2023-11-18T19:23:55.395 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/drm/built-in.a 2023-11-18T19:23:55.539 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/gpu/built-in.a 2023-11-18T19:23:55.656 INFO:tasks.workunit.client.1.smithi135.stdout: AR drivers/built-in.a 2023-11-18T19:23:56.517 INFO:tasks.workunit.client.1.smithi135.stdout: GEN .version 2023-11-18T19:23:56.603 INFO:tasks.workunit.client.1.smithi135.stdout: CHK include/generated/compile.h 2023-11-18T19:23:56.677 INFO:tasks.workunit.client.1.smithi135.stdout: LD vmlinux.o 2023-11-18T19:23:58.032 INFO:tasks.workunit.client.1.smithi135.stdout: MODPOST vmlinux.o 2023-11-18T19:23:58.265 INFO:tasks.workunit.client.1.smithi135.stdout: MODINFO modules.builtin.modinfo 2023-11-18T19:23:58.350 INFO:tasks.workunit.client.1.smithi135.stdout: LD .tmp_vmlinux1 2023-11-18T19:23:59.994 INFO:tasks.workunit.client.1.smithi135.stdout: KSYM .tmp_kallsyms1.o 2023-11-18T19:24:00.640 INFO:tasks.workunit.client.1.smithi135.stdout: LD .tmp_vmlinux2 2023-11-18T19:24:02.372 INFO:tasks.workunit.client.1.smithi135.stdout: KSYM .tmp_kallsyms2.o 2023-11-18T19:24:03.211 INFO:tasks.workunit.client.1.smithi135.stdout: LD vmlinux 2023-11-18T19:24:04.849 INFO:tasks.workunit.client.1.smithi135.stdout: SORTEX vmlinux 2023-11-18T19:24:04.863 INFO:tasks.workunit.client.1.smithi135.stdout: SYSMAP System.map 2023-11-18T19:24:05.154 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/bioscall.o 2023-11-18T19:24:05.157 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/copy.o 2023-11-18T19:24:05.158 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC arch/x86/boot/mkcpustr 2023-11-18T19:24:05.164 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/a20.o 2023-11-18T19:24:05.166 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/cmdline.o 2023-11-18T19:24:05.169 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/cpuflags.o 2023-11-18T19:24:05.172 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/cpucheck.o 2023-11-18T19:24:05.172 INFO:tasks.workunit.client.1.smithi135.stdout: Building modules, stage 2. 2023-11-18T19:24:05.176 INFO:tasks.workunit.client.1.smithi135.stdout: MODPOST 12 modules 2023-11-18T19:24:05.245 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/early_serial_console.o 2023-11-18T19:24:05.249 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/edd.o 2023-11-18T19:24:05.317 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/main.o 2023-11-18T19:24:05.335 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/memory.o 2023-11-18T19:24:05.340 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/pmjump.o 2023-11-18T19:24:05.346 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/pm.o 2023-11-18T19:24:05.367 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/printf.o 2023-11-18T19:24:05.410 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] drivers/thermal/intel/x86_pkg_temp_thermal.mod.o 2023-11-18T19:24:05.421 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/regs.o 2023-11-18T19:24:05.435 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/string.o 2023-11-18T19:24:05.461 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] fs/efivarfs/efivarfs.mod.o 2023-11-18T19:24:05.484 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv4/netfilter/iptable_nat.mod.o 2023-11-18T19:24:05.491 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/tty.o 2023-11-18T19:24:05.556 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/video.o 2023-11-18T19:24:05.565 INFO:tasks.workunit.client.1.smithi135.stdout: LDS arch/x86/boot/compressed/vmlinux.lds 2023-11-18T19:24:05.611 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/compressed/head_64.o 2023-11-18T19:24:05.612 INFO:tasks.workunit.client.1.smithi135.stdout: VOFFSET arch/x86/boot/compressed/../voffset.h 2023-11-18T19:24:05.634 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv4/netfilter/nf_log_arp.mod.o 2023-11-18T19:24:05.637 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv4/netfilter/nf_log_ipv4.mod.o 2023-11-18T19:24:05.708 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/video-mode.o 2023-11-18T19:24:05.743 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/version.o 2023-11-18T19:24:05.801 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/video-vga.o 2023-11-18T19:24:05.805 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/string.o 2023-11-18T19:24:05.872 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/cmdline.o 2023-11-18T19:24:05.877 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/ipv6/netfilter/nf_log_ipv6.mod.o 2023-11-18T19:24:05.878 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/video-vesa.o 2023-11-18T19:24:05.888 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/nf_log_common.mod.o 2023-11-18T19:24:05.943 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_LOG.mod.o 2023-11-18T19:24:05.952 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_MASQUERADE.mod.o 2023-11-18T19:24:05.999 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_addrtype.mod.o 2023-11-18T19:24:06.026 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_mark.mod.o 2023-11-18T19:24:06.050 INFO:tasks.workunit.client.1.smithi135.stdout: CC [M] net/netfilter/xt_nat.mod.o 2023-11-18T19:24:06.221 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/video-bios.o 2023-11-18T19:24:06.226 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/error.o 2023-11-18T19:24:06.256 INFO:tasks.workunit.client.1.smithi135.stdout: OBJCOPY arch/x86/boot/compressed/vmlinux.bin 2023-11-18T19:24:06.265 INFO:tasks.workunit.client.1.smithi135.stdout: RELOCS arch/x86/boot/compressed/vmlinux.relocs 2023-11-18T19:24:06.319 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-18T19:24:06.338 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC arch/x86/boot/compressed/mkpiggy 2023-11-18T19:24:06.340 INFO:tasks.workunit.client.1.smithi135.stdout: HOSTCC arch/x86/boot/tools/build 2023-11-18T19:24:06.365 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] fs/efivarfs/efivarfs.ko 2023-11-18T19:24:06.381 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/ipv4/netfilter/iptable_nat.ko 2023-11-18T19:24:06.389 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/ipv4/netfilter/nf_log_arp.ko 2023-11-18T19:24:06.406 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/ipv4/netfilter/nf_log_ipv4.ko 2023-11-18T19:24:06.410 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/cpuflags.o 2023-11-18T19:24:06.424 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/ipv6/netfilter/nf_log_ipv6.ko 2023-11-18T19:24:06.431 INFO:tasks.workunit.client.1.smithi135.stdout: CPUSTR arch/x86/boot/cpustr.h 2023-11-18T19:24:06.431 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/netfilter/nf_log_common.ko 2023-11-18T19:24:06.442 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/netfilter/xt_LOG.ko 2023-11-18T19:24:06.448 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/netfilter/xt_MASQUERADE.ko 2023-11-18T19:24:06.459 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/early_serial_console.o 2023-11-18T19:24:06.462 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/netfilter/xt_addrtype.ko 2023-11-18T19:24:06.474 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/cpu.o 2023-11-18T19:24:06.475 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/netfilter/xt_mark.ko 2023-11-18T19:24:06.489 INFO:tasks.workunit.client.1.smithi135.stdout: LD [M] net/netfilter/xt_nat.ko 2023-11-18T19:24:06.499 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/kaslr.o 2023-11-18T19:24:06.543 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/kaslr_64.o 2023-11-18T19:24:06.568 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/compressed/mem_encrypt.o 2023-11-18T19:24:06.599 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/pgtable_64.o 2023-11-18T19:24:06.639 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/acpi.o 2023-11-18T19:24:06.648 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/eboot.o 2023-11-18T19:24:06.652 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/compressed/efi_stub_64.o 2023-11-18T19:24:06.705 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/compressed/efi_thunk_64.o 2023-11-18T19:24:06.743 INFO:tasks.workunit.client.1.smithi135.stdout: CC arch/x86/boot/compressed/misc.o 2023-11-18T19:24:06.781 INFO:tasks.workunit.client.1.smithi135.stdout: GZIP arch/x86/boot/compressed/vmlinux.bin.gz 2023-11-18T19:24:09.276 INFO:tasks.workunit.client.1.smithi135.stdout: MKPIGGY arch/x86/boot/compressed/piggy.S 2023-11-18T19:24:09.284 INFO:tasks.workunit.client.1.smithi135.stdout: AS arch/x86/boot/compressed/piggy.o 2023-11-18T19:24:09.370 INFO:tasks.workunit.client.1.smithi135.stdout: LD arch/x86/boot/compressed/vmlinux 2023-11-18T19:24:09.579 INFO:tasks.workunit.client.1.smithi135.stderr:ld: arch/x86/boot/compressed/pgtable_64.o:(.bss+0x0): multiple definition of `__force_order'; arch/x86/boot/compressed/kaslr_64.o:(.bss+0x0): first defined here 2023-11-18T19:24:09.585 INFO:tasks.workunit.client.1.smithi135.stderr:ld: arch/x86/boot/compressed/head_64.o: warning: relocation in read-only section `.head.text' 2023-11-18T19:24:09.621 INFO:tasks.workunit.client.1.smithi135.stderr:ld: warning: creating DT_TEXTREL in a PIE 2023-11-18T19:24:09.627 INFO:tasks.workunit.client.1.smithi135.stderr:make[2]: *** [arch/x86/boot/compressed/Makefile:118: arch/x86/boot/compressed/vmlinux] Error 1 2023-11-18T19:24:09.628 INFO:tasks.workunit.client.1.smithi135.stderr:make[1]: *** [arch/x86/boot/Makefile:112: arch/x86/boot/compressed/vmlinux] Error 2 2023-11-18T19:24:09.629 INFO:tasks.workunit.client.1.smithi135.stderr:make: *** [arch/x86/Makefile:284: bzImage] Error 2 2023-11-18T19:24:09.648 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-18T19:24:09.648 INFO:tasks.workunit:Stopping ['kernel_untar_build.sh'] on client.1... 2023-11-18T19:24:09.648 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-11-18T19:24:10.615 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-18T19:24:10.615 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:24:10.615 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:24:10.667 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:24:10.667 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:24:10.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:24:11.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.007+0000 7fd324547640 1 Processor -- start 2023-11-18T19:24:11.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.008+0000 7fd324547640 1 -- start start 2023-11-18T19:24:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd324547640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd31c151c00 0x7fd31c0c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd324547640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd31c0c7e00 0x7fd31c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd324547640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31c0ca200 con 0x7fd31c0bd590 2023-11-18T19:24:11.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd324547640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c0c5610 con 0x7fd31c0c7e00 2023-11-18T19:24:11.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd324547640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c0cac50 con 0x7fd31c151c00 2023-11-18T19:24:11.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd321ae2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd31c0c7e00 0x7fd31c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd321ae2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd31c0c7e00 0x7fd31c1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58912/0 (socket says 172.21.15.45:58912) 2023-11-18T19:24:11.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.009+0000 7fd321ae2640 1 -- 172.21.15.45:0/1636867521 learned_addr learned my addr 172.21.15.45:0/1636867521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:11.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.010+0000 7fd3222e3640 1 --2- 172.21.15.45:0/1636867521 >> v2:172.21.15.135:3300/0 conn(0x7fd31c151c00 0x7fd31c0c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.010+0000 7fd321ae2640 1 -- 172.21.15.45:0/1636867521 >> v2:172.21.15.135:3300/0 conn(0x7fd31c151c00 msgr2=0x7fd31c0c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:11.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.010+0000 7fd321ae2640 1 --2- 172.21.15.45:0/1636867521 >> v2:172.21.15.135:3300/0 conn(0x7fd31c151c00 0x7fd31c0c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.010+0000 7fd321ae2640 1 -- 172.21.15.45:0/1636867521 >> v1:172.21.15.135:6789/0 conn(0x7fd31c0bd590 legacy=0x7fd31c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:11.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.010+0000 7fd321ae2640 1 -- 172.21.15.45:0/1636867521 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c151fe0 con 0x7fd31c0c7e00 2023-11-18T19:24:11.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.011+0000 7fd321ae2640 1 --2- 172.21.15.45:0/1636867521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c0c7e00 0x7fd31c1545c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd31c06c480 tx=0x7fd31002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86e1014820ee3fa server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd3212e1640 1 -- 172.21.15.45:0/1636867521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3100317e0 con 0x7fd31c0c7e00 2023-11-18T19:24:11.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd3212e1640 1 -- 172.21.15.45:0/1636867521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310031940 con 0x7fd31c0c7e00 2023-11-18T19:24:11.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd3212e1640 1 -- 172.21.15.45:0/1636867521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310031cd0 con 0x7fd31c0c7e00 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd324547640 1 -- 172.21.15.45:0/1636867521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c0c7e00 msgr2=0x7fd31c1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd324547640 1 --2- 172.21.15.45:0/1636867521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c0c7e00 0x7fd31c1545c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd31c06c480 tx=0x7fd31002b880 comp rx=0 tx=0).stop 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd324547640 1 -- 172.21.15.45:0/1636867521 shutdown_connections 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd324547640 1 --2- 172.21.15.45:0/1636867521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c0c7e00 0x7fd31c1545c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd324547640 1 --2- 172.21.15.45:0/1636867521 >> v2:172.21.15.135:3300/0 conn(0x7fd31c151c00 0x7fd31c0c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.012+0000 7fd324547640 1 -- 172.21.15.45:0/1636867521 >> 172.21.15.45:0/1636867521 conn(0x7fd31c0663d0 msgr2=0x7fd31c0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.013+0000 7fd324547640 1 -- 172.21.15.45:0/1636867521 shutdown_connections 2023-11-18T19:24:11.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.013+0000 7fd324547640 1 -- 172.21.15.45:0/1636867521 wait complete. 2023-11-18T19:24:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.014+0000 7fd324547640 1 Processor -- start 2023-11-18T19:24:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.015+0000 7fd324547640 1 -- start start 2023-11-18T19:24:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.015+0000 7fd324547640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0bd590 0x7fd31c0c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.015+0000 7fd324547640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c0c7e00 0x7fd31c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.015+0000 7fd324547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c151c00 0x7fd31c1ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.015+0000 7fd324547640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c156160 con 0x7fd31c151c00 2023-11-18T19:24:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.015+0000 7fd324547640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c1eddc0 con 0x7fd31c0c7e00 2023-11-18T19:24:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.015+0000 7fd324547640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c155a00 con 0x7fd31c0bd590 2023-11-18T19:24:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c151c00 0x7fd31c1ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c151c00 0x7fd31c1ed580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58928/0 (socket says 172.21.15.45:58928) 2023-11-18T19:24:11.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 -- 172.21.15.45:0/85334767 learned_addr learned my addr 172.21.15.45:0/85334767 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 -- 172.21.15.45:0/85334767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0bd590 msgr2=0x7fd31c0c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0bd590 0x7fd31c0c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 -- 172.21.15.45:0/85334767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c0c7e00 msgr2=0x7fd31c1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c0c7e00 0x7fd31c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.016+0000 7fd322ae4640 1 -- 172.21.15.45:0/85334767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3100094d0 con 0x7fd31c151c00 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.017+0000 7fd322ae4640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c151c00 0x7fd31c1ed580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd31400c410 tx=0x7fd31400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.017+0000 7fd31affd640 1 -- 172.21.15.45:0/85334767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314005230 con 0x7fd31c151c00 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.017+0000 7fd31affd640 1 -- 172.21.15.45:0/85334767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314005390 con 0x7fd31c151c00 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.017+0000 7fd31affd640 1 -- 172.21.15.45:0/85334767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140117d0 con 0x7fd31c151c00 2023-11-18T19:24:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.017+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c1ee060 con 0x7fd31c151c00 2023-11-18T19:24:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.017+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c1edac0 con 0x7fd31c151c00 2023-11-18T19:24:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.018+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c1562d0 con 0x7fd31c151c00 2023-11-18T19:24:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.019+0000 7fd31affd640 1 -- 172.21.15.45:0/85334767 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd314011930 con 0x7fd31c151c00 2023-11-18T19:24:11.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.020+0000 7fd31affd640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd30806ae40 0x7fd30806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.020+0000 7fd31affd640 1 -- 172.21.15.45:0/85334767 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd314088d30 con 0x7fd31c151c00 2023-11-18T19:24:11.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.021+0000 7fd3222e3640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd30806ae40 0x7fd30806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.021+0000 7fd3222e3640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd30806ae40 0x7fd30806d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0070b0 tx=0x7fd30c007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.025+0000 7fd31affd640 1 -- 172.21.15.45:0/85334767 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd314053a80 con 0x7fd31c151c00 2023-11-18T19:24:11.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.223+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd31c0747c0 con 0x7fd31c151c00 2023-11-18T19:24:11.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.224+0000 7fd31affd640 1 -- 172.21.15.45:0/85334767 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18481 (secure 0 0 0) 0x7fd314017090 con 0x7fd31c151c00 2023-11-18T19:24:11.226 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:24:11.226 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:07:25.049601+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:24:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.226+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd30806ae40 msgr2=0x7fd30806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd30806ae40 0x7fd30806d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0070b0 tx=0x7fd30c007040 comp rx=0 tx=0).stop 2023-11-18T19:24:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c151c00 msgr2=0x7fd31c1ed580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c151c00 0x7fd31c1ed580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd31400c410 tx=0x7fd31400c8d0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 shutdown_connections 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31c151c00 0x7fd31c1ed580 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd31c0c7e00 0x7fd31c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd30806ae40 0x7fd30806d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 --2- 172.21.15.45:0/85334767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd31c0bd590 0x7fd31c0c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 >> 172.21.15.45:0/85334767 conn(0x7fd31c0663d0 msgr2=0x7fd31c0c4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 shutdown_connections 2023-11-18T19:24:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.227+0000 7fd324547640 1 -- 172.21.15.45:0/85334767 wait complete. 2023-11-18T19:24:11.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-18T19:06:31.246517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-18T19:06:35.454808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-18T19:06:36.526298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-18T19:06:39.617712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-18T19:24:11.247 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-18T19:24:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.478+0000 7effb9d87640 1 Processor -- start 2023-11-18T19:24:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.478+0000 7effb9d87640 1 -- start start 2023-11-18T19:24:11.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.479+0000 7effb9d87640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effb414e400 0x7effb40ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.479+0000 7effb9d87640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40c6790 con 0x7effb40ca9d0 2023-11-18T19:24:11.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.479+0000 7effb9d87640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40c48a0 con 0x7effb40c7c80 2023-11-18T19:24:11.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.479+0000 7effb9d87640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb4155490 con 0x7effb414e400 2023-11-18T19:24:11.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb8d85640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effb414e400 0x7effb40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb8d85640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effb414e400 0x7effb40ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58936/0 (socket says 172.21.15.45:58936) 2023-11-18T19:24:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb9586640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7effb40ca9d0 0x7effb415ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34860/0 (socket says 172.21.15.45:34860) 2023-11-18T19:24:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb8d85640 1 -- 172.21.15.45:0/4115907538 learned_addr learned my addr 172.21.15.45:0/4115907538 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb8d85640 1 -- 172.21.15.45:0/4115907538 >> v1:172.21.15.135:6789/0 conn(0x7effb40c7c80 legacy=0x7effb40c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb8d85640 1 -- 172.21.15.45:0/4115907538 >> v1:172.21.15.45:6789/0 conn(0x7effb40ca9d0 legacy=0x7effb415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb8d85640 1 -- 172.21.15.45:0/4115907538 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40c4b80 con 0x7effb414e400 2023-11-18T19:24:11.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.480+0000 7effb37fe640 1 -- 172.21.15.45:0/4115907538 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900054659 0 0) 0x7effb40c6790 con 0x7effb40ca9d0 2023-11-18T19:24:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.482+0000 7effb8d85640 1 --2- 172.21.15.45:0/4115907538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb414e400 0x7effb40ca490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7effa4009e50 tx=0x7effa402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658f9a57577ed291 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.482+0000 7effb37fe640 1 -- 172.21.15.45:0/4115907538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa402cbb0 con 0x7effb414e400 2023-11-18T19:24:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.482+0000 7effb37fe640 1 -- 172.21.15.45:0/4115907538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa402cd10 con 0x7effb414e400 2023-11-18T19:24:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.482+0000 7effb37fe640 1 -- 172.21.15.45:0/4115907538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4034610 con 0x7effb414e400 2023-11-18T19:24:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.483+0000 7effb9d87640 1 -- 172.21.15.45:0/4115907538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb414e400 msgr2=0x7effb40ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.483+0000 7effb9d87640 1 --2- 172.21.15.45:0/4115907538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb414e400 0x7effb40ca490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7effa4009e50 tx=0x7effa402c010 comp rx=0 tx=0).stop 2023-11-18T19:24:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.483+0000 7effb9d87640 1 -- 172.21.15.45:0/4115907538 shutdown_connections 2023-11-18T19:24:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.483+0000 7effb9d87640 1 --2- 172.21.15.45:0/4115907538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb414e400 0x7effb40ca490 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.483+0000 7effb9d87640 1 -- 172.21.15.45:0/4115907538 >> 172.21.15.45:0/4115907538 conn(0x7effb4066820 msgr2=0x7effb40c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.483+0000 7effb9d87640 1 -- 172.21.15.45:0/4115907538 shutdown_connections 2023-11-18T19:24:11.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.483+0000 7effb9d87640 1 -- 172.21.15.45:0/4115907538 wait complete. 2023-11-18T19:24:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.485+0000 7effb9d87640 1 Processor -- start 2023-11-18T19:24:11.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.485+0000 7effb9d87640 1 -- start start 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb9d87640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effb40c7c80 0x7effb41ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb9d87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb40ca9d0 0x7effb40bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb9d87640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effb414e400 0x7effb414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb9d87640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40bd740 con 0x7effb40ca9d0 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb9d87640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41edbc0 con 0x7effb40c7c80 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb9d87640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb4157a40 con 0x7effb414e400 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb40ca9d0 0x7effb40bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb40ca9d0 0x7effb40bef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58944/0 (socket says 172.21.15.45:58944) 2023-11-18T19:24:11.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.486+0000 7effb3fff640 1 -- 172.21.15.45:0/185153284 learned_addr learned my addr 172.21.15.45:0/185153284 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:11.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb8d85640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effb40c7c80 0x7effb41ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb9586640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effb414e400 0x7effb414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb3fff640 1 -- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effb414e400 msgr2=0x7effb414a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb3fff640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effb414e400 0x7effb414a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb3fff640 1 -- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effb40c7c80 msgr2=0x7effb41ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb3fff640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effb40c7c80 0x7effb41ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb3fff640 1 -- 172.21.15.45:0/185153284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4009b30 con 0x7effb40ca9d0 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb8d85640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effb40c7c80 0x7effb41ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb9586640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effb414e400 0x7effb414a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb3fff640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb40ca9d0 0x7effb40bef00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7effa800c450 tx=0x7effa800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.487+0000 7effb17fa640 1 -- 172.21.15.45:0/185153284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa80052d0 con 0x7effb40ca9d0 2023-11-18T19:24:11.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.488+0000 7effb17fa640 1 -- 172.21.15.45:0/185153284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa8005430 con 0x7effb40ca9d0 2023-11-18T19:24:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.488+0000 7effb17fa640 1 -- 172.21.15.45:0/185153284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8012870 con 0x7effb40ca9d0 2023-11-18T19:24:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.488+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4157d20 con 0x7effb40ca9d0 2023-11-18T19:24:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.488+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40bd9e0 con 0x7effb40ca9d0 2023-11-18T19:24:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.489+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40c8110 con 0x7effb40ca9d0 2023-11-18T19:24:11.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.490+0000 7effb17fa640 1 -- 172.21.15.45:0/185153284 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effa80129d0 con 0x7effb40ca9d0 2023-11-18T19:24:11.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.491+0000 7effb17fa640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa006ae40 0x7effa006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.491+0000 7effb17fa640 1 -- 172.21.15.45:0/185153284 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7effa8089420 con 0x7effb40ca9d0 2023-11-18T19:24:11.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.491+0000 7effb8d85640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa006ae40 0x7effa006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.492+0000 7effb8d85640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa006ae40 0x7effa006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7effa4035000 tx=0x7effa4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.496+0000 7effb17fa640 1 -- 172.21.15.45:0/185153284 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effa80541f0 con 0x7effb40ca9d0 2023-11-18T19:24:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.691+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effb40683a0 con 0x7effb40ca9d0 2023-11-18T19:24:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.692+0000 7effb17fa640 1 -- 172.21.15.45:0/185153284 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7effa8057810 con 0x7effb40ca9d0 2023-11-18T19:24:11.693 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa006ae40 msgr2=0x7effa006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa006ae40 0x7effa006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7effa4035000 tx=0x7effa4030000 comp rx=0 tx=0).stop 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb40ca9d0 msgr2=0x7effb40bef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb40ca9d0 0x7effb40bef00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7effa800c450 tx=0x7effa800c910 comp rx=0 tx=0).stop 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 shutdown_connections 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7effa006ae40 0x7effa006d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effb414e400 0x7effb414a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb40ca9d0 0x7effb40bef00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 --2- 172.21.15.45:0/185153284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effb40c7c80 0x7effb41ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.694+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 >> 172.21.15.45:0/185153284 conn(0x7effb4066820 msgr2=0x7effb40c6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.695+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 shutdown_connections 2023-11-18T19:24:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.695+0000 7effb9d87640 1 -- 172.21.15.45:0/185153284 wait complete. 2023-11-18T19:24:11.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-18T19:24:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.940+0000 7fc0b0973640 1 Processor -- start 2023-11-18T19:24:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.940+0000 7fc0b0973640 1 -- start start 2023-11-18T19:24:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.941+0000 7fc0b0973640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0ac0c4690 0x7fc0ac0c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.941+0000 7fc0b0973640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc0ac0c6620 0x7fc0ac1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0b0973640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac0c51f0 con 0x7fc0ac0c8330 2023-11-18T19:24:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0b0973640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac06baf0 con 0x7fc0ac0c4690 2023-11-18T19:24:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0b0973640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac0c5f10 con 0x7fc0ac0c6620 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0ab7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0ac0c4690 0x7fc0ac0c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0ab7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0ac0c4690 0x7fc0ac0c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58952/0 (socket says 172.21.15.45:58952) 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0ab7fe640 1 -- 172.21.15.45:0/2270671527 learned_addr learned my addr 172.21.15.45:0/2270671527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0abfff640 1 --2- 172.21.15.45:0/2270671527 >> v2:172.21.15.135:3300/0 conn(0x7fc0ac0c6620 0x7fc0ac1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0ab7fe640 1 -- 172.21.15.45:0/2270671527 >> v2:172.21.15.135:3300/0 conn(0x7fc0ac0c6620 msgr2=0x7fc0ac1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0ab7fe640 1 --2- 172.21.15.45:0/2270671527 >> v2:172.21.15.135:3300/0 conn(0x7fc0ac0c6620 0x7fc0ac1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0ab7fe640 1 -- 172.21.15.45:0/2270671527 >> v1:172.21.15.135:6789/0 conn(0x7fc0ac0c8330 legacy=0x7fc0ac06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0ab7fe640 1 -- 172.21.15.45:0/2270671527 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac1555f0 con 0x7fc0ac0c4690 2023-11-18T19:24:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.942+0000 7fc0abfff640 1 --2- 172.21.15.45:0/2270671527 >> v2:172.21.15.135:3300/0 conn(0x7fc0ac0c6620 0x7fc0ac1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.944+0000 7fc0ab7fe640 1 --2- 172.21.15.45:0/2270671527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c4690 0x7fc0ac0c4a70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0bd7b0 tx=0x7fc09c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3382b849481799e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.944+0000 7fc0aa7fc640 1 -- 172.21.15.45:0/2270671527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c031870 con 0x7fc0ac0c4690 2023-11-18T19:24:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.944+0000 7fc0aa7fc640 1 -- 172.21.15.45:0/2270671527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0319d0 con 0x7fc0ac0c4690 2023-11-18T19:24:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.944+0000 7fc0aa7fc640 1 -- 172.21.15.45:0/2270671527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c031d60 con 0x7fc0ac0c4690 2023-11-18T19:24:11.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 -- 172.21.15.45:0/2270671527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c4690 msgr2=0x7fc0ac0c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 --2- 172.21.15.45:0/2270671527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c4690 0x7fc0ac0c4a70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0bd7b0 tx=0x7fc09c02b910 comp rx=0 tx=0).stop 2023-11-18T19:24:11.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 -- 172.21.15.45:0/2270671527 shutdown_connections 2023-11-18T19:24:11.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 --2- 172.21.15.45:0/2270671527 >> v2:172.21.15.135:3300/0 conn(0x7fc0ac0c6620 0x7fc0ac1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 --2- 172.21.15.45:0/2270671527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c4690 0x7fc0ac0c4a70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 -- 172.21.15.45:0/2270671527 >> 172.21.15.45:0/2270671527 conn(0x7fc0ac0ab8a0 msgr2=0x7fc0ac0abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:11.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 -- 172.21.15.45:0/2270671527 shutdown_connections 2023-11-18T19:24:11.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.945+0000 7fc0b0973640 1 -- 172.21.15.45:0/2270671527 wait complete. 2023-11-18T19:24:11.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.947+0000 7fc0b0973640 1 Processor -- start 2023-11-18T19:24:11.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.947+0000 7fc0b0973640 1 -- start start 2023-11-18T19:24:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0b0973640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0ac0c4690 0x7fc0ac1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0b0973640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c6620 0x7fc0ac14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0b0973640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0ac0c8330 0x7fc0ac1ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0b0973640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac14f390 con 0x7fc0ac0c6620 2023-11-18T19:24:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0b0973640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac1ee290 con 0x7fc0ac0c8330 2023-11-18T19:24:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0b0973640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac14f630 con 0x7fc0ac0c4690 2023-11-18T19:24:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c6620 0x7fc0ac14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c6620 0x7fc0ac14fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58956/0 (socket says 172.21.15.45:58956) 2023-11-18T19:24:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0aaffd640 1 -- 172.21.15.45:0/392107844 learned_addr learned my addr 172.21.15.45:0/392107844 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0aaffd640 1 -- 172.21.15.45:0/392107844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0ac0c4690 msgr2=0x7fc0ac1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.948+0000 7fc0aaffd640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0ac0c4690 0x7fc0ac1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0aaffd640 1 -- 172.21.15.45:0/392107844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0ac0c8330 msgr2=0x7fc0ac1ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0aaffd640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0ac0c8330 0x7fc0ac1ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0aaffd640 1 -- 172.21.15.45:0/392107844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0094d0 con 0x7fc0ac0c6620 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0aaffd640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c6620 0x7fc0ac14fb50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc09400ba50 tx=0x7fc09400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0a3fff640 1 -- 172.21.15.45:0/392107844 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400cc10 con 0x7fc0ac0c6620 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0a3fff640 1 -- 172.21.15.45:0/392107844 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400cd70 con 0x7fc0ac0c6620 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0a3fff640 1 -- 172.21.15.45:0/392107844 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094014680 con 0x7fc0ac0c6620 2023-11-18T19:24:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac156c30 con 0x7fc0ac0c6620 2023-11-18T19:24:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.949+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac1ee570 con 0x7fc0ac0c6620 2023-11-18T19:24:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.950+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac08ba90 con 0x7fc0ac0c6620 2023-11-18T19:24:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.951+0000 7fc0a3fff640 1 -- 172.21.15.45:0/392107844 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc09401d3b0 con 0x7fc0ac0c6620 2023-11-18T19:24:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.952+0000 7fc0a3fff640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc08c06ae40 0x7fc08c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.952+0000 7fc0a3fff640 1 -- 172.21.15.45:0/392107844 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc094089a40 con 0x7fc0ac0c6620 2023-11-18T19:24:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.953+0000 7fc0ab7fe640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc08c06ae40 0x7fc08c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:11.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.953+0000 7fc0ab7fe640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc08c06ae40 0x7fc08c06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc09c036000 tx=0x7fc09c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:11.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:11.957+0000 7fc0a3fff640 1 -- 172.21.15.45:0/392107844 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc094054700 con 0x7fc0ac0c6620 2023-11-18T19:24:12.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.152+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0ac0683a0 con 0x7fc0ac0c6620 2023-11-18T19:24:12.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.153+0000 7fc0a3fff640 1 -- 172.21.15.45:0/392107844 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc094019020 con 0x7fc0ac0c6620 2023-11-18T19:24:12.154 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:24:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc08c06ae40 msgr2=0x7fc08c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc08c06ae40 0x7fc08c06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc09c036000 tx=0x7fc09c030000 comp rx=0 tx=0).stop 2023-11-18T19:24:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c6620 msgr2=0x7fc0ac14fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c6620 0x7fc0ac14fb50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc09400ba50 tx=0x7fc09400bf10 comp rx=0 tx=0).stop 2023-11-18T19:24:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 shutdown_connections 2023-11-18T19:24:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0ac0c8330 0x7fc0ac1ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0ac0c6620 0x7fc0ac14fb50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc08c06ae40 0x7fc08c06d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 --2- 172.21.15.45:0/392107844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0ac0c4690 0x7fc0ac1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.155+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 >> 172.21.15.45:0/392107844 conn(0x7fc0ac0ab8a0 msgr2=0x7fc0ac0733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:12.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.156+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 shutdown_connections 2023-11-18T19:24:12.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.156+0000 7fc0b0973640 1 -- 172.21.15.45:0/392107844 wait complete. 2023-11-18T19:24:12.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-18T19:24:12.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.407+0000 7f525587c640 1 Processor -- start 2023-11-18T19:24:12.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.407+0000 7f525587c640 1 -- start start 2023-11-18T19:24:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f525587c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5250152490 0x7f52500c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f525587c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500c07d0 con 0x7f52500ab740 2023-11-18T19:24:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f525587c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525006e3b0 con 0x7f525014fc40 2023-11-18T19:24:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f525587c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52501528e0 con 0x7f5250152490 2023-11-18T19:24:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f524e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52500ab740 0x7f52500c4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34868/0 (socket says 172.21.15.45:34868) 2023-11-18T19:24:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f524e7fc640 1 -- 172.21.15.45:0/1293899015 learned_addr learned my addr 172.21.15.45:0/1293899015 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f524f7fe640 1 --2- 172.21.15.45:0/1293899015 >> v2:172.21.15.135:3300/0 conn(0x7f5250152490 0x7f52500c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.409+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834169153 0 0) 0x7f52500c07d0 con 0x7f52500ab740 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5238003520 con 0x7f52500ab740 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3577073660 0 0) 0x7f5238003520 con 0x7f52500ab740 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 >> v2:172.21.15.135:3300/0 conn(0x7f5250152490 msgr2=0x7f52500c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 --2- 172.21.15.45:0/1293899015 >> v2:172.21.15.135:3300/0 conn(0x7f5250152490 0x7f52500c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 >> v1:172.21.15.135:6789/0 conn(0x7f525014fc40 legacy=0x7f525006dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250072070 con 0x7f52500ab740 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f5244001670 con 0x7f52500ab740 2023-11-18T19:24:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 >> v1:172.21.15.45:6789/0 conn(0x7f52500ab740 legacy=0x7f52500c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380039c0 0x7f5238003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52380047c0 0x7f5238004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52380051d0 0x7f523800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52501528e0 con 0x7f52380047c0 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523800c120 con 0x7f52380051d0 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.410+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523800c2e0 con 0x7f52380039c0 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524e7fc640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52380047c0 0x7f5238004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524f7fe640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52380051d0 0x7f523800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524effd640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380039c0 0x7f5238003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524e7fc640 1 -- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380039c0 msgr2=0x7f5238003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524e7fc640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380039c0 0x7f5238003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524e7fc640 1 -- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52380051d0 msgr2=0x7f523800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524e7fc640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52380051d0 0x7f523800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524e7fc640 1 -- 172.21.15.45:0/1293899015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238003520 con 0x7f52380047c0 2023-11-18T19:24:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.411+0000 7f524f7fe640 1 -- 172.21.15.45:0/1293899015 reap_dead start 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.412+0000 7f524e7fc640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52380047c0 0x7f5238004c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5244001eb0 tx=0x7f52380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391433a3d6449741 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.412+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244005ad0 con 0x7f52380047c0 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.412+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5244005c30 con 0x7f52380047c0 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.412+0000 7f524dffb640 1 -- 172.21.15.45:0/1293899015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524402c9d0 con 0x7f52380047c0 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.413+0000 7f525587c640 1 -- 172.21.15.45:0/1293899015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52380047c0 msgr2=0x7f5238004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.413+0000 7f525587c640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52380047c0 0x7f5238004c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5244001eb0 tx=0x7f52380057f0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.413+0000 7f525587c640 1 -- 172.21.15.45:0/1293899015 shutdown_connections 2023-11-18T19:24:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.413+0000 7f525587c640 1 --2- 172.21.15.45:0/1293899015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52380047c0 0x7f5238004c40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.413+0000 7f525587c640 1 -- 172.21.15.45:0/1293899015 >> 172.21.15.45:0/1293899015 conn(0x7f52500a7980 msgr2=0x7f52500a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.413+0000 7f525587c640 1 -- 172.21.15.45:0/1293899015 shutdown_connections 2023-11-18T19:24:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.413+0000 7f525587c640 1 -- 172.21.15.45:0/1293899015 wait complete. 2023-11-18T19:24:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.415+0000 7f525587c640 1 Processor -- start 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.415+0000 7f525587c640 1 -- start start 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f525587c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380047c0 0x7f52500a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f525587c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525014ab00 0x7f52500a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f525587c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5250147ea0 0x7f5250148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f525587c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52500a9580 con 0x7f5250147ea0 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f525587c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250148fb0 con 0x7f525014ab00 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f525587c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250149d50 con 0x7f52380047c0 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5250147ea0 0x7f5250148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5250147ea0 0x7f5250148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58968/0 (socket says 172.21.15.45:58968) 2023-11-18T19:24:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.416+0000 7f524f7fe640 1 -- 172.21.15.45:0/1825565465 learned_addr learned my addr 172.21.15.45:0/1825565465 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524effd640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380047c0 0x7f52500a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524e7fc640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525014ab00 0x7f52500a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524f7fe640 1 -- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380047c0 msgr2=0x7f52500a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524f7fe640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380047c0 0x7f52500a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524f7fe640 1 -- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525014ab00 msgr2=0x7f52500a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524f7fe640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525014ab00 0x7f52500a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524f7fe640 1 -- 172.21.15.45:0/1825565465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525014a030 con 0x7f5250147ea0 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f524f7fe640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5250147ea0 0x7f5250148350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52500c5ba0 tx=0x7f52480115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f5237fff640 1 -- 172.21.15.45:0/1825565465 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524800e070 con 0x7f5250147ea0 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f5237fff640 1 -- 172.21.15.45:0/1825565465 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248011db0 con 0x7f5250147ea0 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f5237fff640 1 -- 172.21.15.45:0/1825565465 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248003990 con 0x7f5250147ea0 2023-11-18T19:24:12.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.417+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525014a310 con 0x7f5250147ea0 2023-11-18T19:24:12.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.418+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52500a55a0 con 0x7f5250147ea0 2023-11-18T19:24:12.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.419+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5250066b80 con 0x7f5250147ea0 2023-11-18T19:24:12.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.420+0000 7f5237fff640 1 -- 172.21.15.45:0/1825565465 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5248003af0 con 0x7f5250147ea0 2023-11-18T19:24:12.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.421+0000 7f5237fff640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f523c06ae70 0x7f523c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.421+0000 7f5237fff640 1 -- 172.21.15.45:0/1825565465 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f524808a220 con 0x7f5250147ea0 2023-11-18T19:24:12.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.422+0000 7f524effd640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f523c06ae70 0x7f523c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.422+0000 7f524effd640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f523c06ae70 0x7f523c06d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52500681a0 tx=0x7f5240009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:12.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.426+0000 7f5237fff640 1 -- 172.21.15.45:0/1825565465 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5248054f70 con 0x7f5250147ea0 2023-11-18T19:24:12.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.622+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52500747c0 con 0x7f5250147ea0 2023-11-18T19:24:12.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.622+0000 7f5237fff640 1 -- 172.21.15.45:0/1825565465 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5248058590 con 0x7f5250147ea0 2023-11-18T19:24:12.624 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-18T19:24:12.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f523c06ae70 msgr2=0x7f523c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f523c06ae70 0x7f523c06d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52500681a0 tx=0x7f5240009040 comp rx=0 tx=0).stop 2023-11-18T19:24:12.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5250147ea0 msgr2=0x7f5250148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5250147ea0 0x7f5250148350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52500c5ba0 tx=0x7f52480115a0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 shutdown_connections 2023-11-18T19:24:12.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5250147ea0 0x7f5250148350 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525014ab00 0x7f52500a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f523c06ae70 0x7f523c06d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 --2- 172.21.15.45:0/1825565465 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52380047c0 0x7f52500a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 >> 172.21.15.45:0/1825565465 conn(0x7f52500a7980 msgr2=0x7f5250150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.625+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 shutdown_connections 2023-11-18T19:24:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.626+0000 7f525587c640 1 -- 172.21.15.45:0/1825565465 wait complete. 2023-11-18T19:24:12.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-18T19:24:12.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.869+0000 7fc21b01a640 1 Processor -- start 2023-11-18T19:24:12.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.869+0000 7fc21b01a640 1 -- start start 2023-11-18T19:24:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21b01a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2140c1220 0x7fc2140c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21b01a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc21406c9b0 0x7fc21406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21b01a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2140c39c0 con 0x7fc2140c26a0 2023-11-18T19:24:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21b01a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21406d360 con 0x7fc2140c1220 2023-11-18T19:24:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21b01a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140c3b70 con 0x7fc21406c9b0 2023-11-18T19:24:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21a018640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2140c1220 0x7fc2140c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21a018640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2140c1220 0x7fc2140c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58984/0 (socket says 172.21.15.45:58984) 2023-11-18T19:24:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21a018640 1 -- 172.21.15.45:0/1517820951 learned_addr learned my addr 172.21.15.45:0/1517820951 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.871+0000 7fc21a819640 1 --2- 172.21.15.45:0/1517820951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc21406c9b0 0x7fc21406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.872+0000 7fc21a018640 1 -- 172.21.15.45:0/1517820951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc21406c9b0 msgr2=0x7fc21406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.872+0000 7fc21a018640 1 --2- 172.21.15.45:0/1517820951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc21406c9b0 0x7fc21406ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.872+0000 7fc21a018640 1 -- 172.21.15.45:0/1517820951 >> v1:172.21.15.135:6789/0 conn(0x7fc2140c26a0 legacy=0x7fc21406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.872+0000 7fc21a018640 1 -- 172.21.15.45:0/1517820951 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214158670 con 0x7fc2140c1220 2023-11-18T19:24:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.873+0000 7fc21a018640 1 --2- 172.21.15.45:0/1517820951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140c7460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc210009870 tx=0x7fc21002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0f03969f301ecb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.873+0000 7fc219016640 1 -- 172.21.15.45:0/1517820951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100317c0 con 0x7fc2140c1220 2023-11-18T19:24:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.873+0000 7fc219016640 1 -- 172.21.15.45:0/1517820951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc210031920 con 0x7fc2140c1220 2023-11-18T19:24:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.873+0000 7fc219016640 1 -- 172.21.15.45:0/1517820951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210031cb0 con 0x7fc2140c1220 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 -- 172.21.15.45:0/1517820951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 msgr2=0x7fc2140c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 --2- 172.21.15.45:0/1517820951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140c7460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc210009870 tx=0x7fc21002b860 comp rx=0 tx=0).stop 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 -- 172.21.15.45:0/1517820951 shutdown_connections 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 --2- 172.21.15.45:0/1517820951 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc21406c9b0 0x7fc21406ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 --2- 172.21.15.45:0/1517820951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140c7460 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 -- 172.21.15.45:0/1517820951 >> 172.21.15.45:0/1517820951 conn(0x7fc2140a9930 msgr2=0x7fc2140a9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 -- 172.21.15.45:0/1517820951 shutdown_connections 2023-11-18T19:24:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.874+0000 7fc21b01a640 1 -- 172.21.15.45:0/1517820951 wait complete. 2023-11-18T19:24:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.876+0000 7fc21b01a640 1 Processor -- start 2023-11-18T19:24:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.876+0000 7fc21b01a640 1 -- start start 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc21b01a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21406c9b0 0x7fc2141547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc21b01a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc21b01a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2140c26a0 0x7fc21409adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc21b01a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141ed220 con 0x7fc2140c1220 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc21b01a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141ee080 con 0x7fc21406c9b0 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc21b01a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140abe60 con 0x7fc2140c26a0 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc219817640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc219817640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58998/0 (socket says 172.21.15.45:58998) 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.877+0000 7fc219817640 1 -- 172.21.15.45:0/334312377 learned_addr learned my addr 172.21.15.45:0/334312377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc21a018640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21406c9b0 0x7fc2141547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc21a819640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2140c26a0 0x7fc21409adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc219817640 1 -- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2140c26a0 msgr2=0x7fc21409adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc219817640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2140c26a0 0x7fc21409adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc219817640 1 -- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21406c9b0 msgr2=0x7fc2141547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc219817640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21406c9b0 0x7fc2141547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc219817640 1 -- 172.21.15.45:0/334312377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100094d0 con 0x7fc2140c1220 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc219817640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140ac9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc20400b3f0 tx=0x7fc20400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.878+0000 7fc20affd640 1 -- 172.21.15.45:0/334312377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204011830 con 0x7fc2140c1220 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.879+0000 7fc20affd640 1 -- 172.21.15.45:0/334312377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc204011990 con 0x7fc2140c1220 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.879+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2141ed470 con 0x7fc2140c1220 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.879+0000 7fc20affd640 1 -- 172.21.15.45:0/334312377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204011d40 con 0x7fc2140c1220 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.879+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2141eda30 con 0x7fc2140c1220 2023-11-18T19:24:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.880+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2141e9c30 con 0x7fc2140c1220 2023-11-18T19:24:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.881+0000 7fc20affd640 1 -- 172.21.15.45:0/334312377 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc20401a400 con 0x7fc2140c1220 2023-11-18T19:24:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.882+0000 7fc20affd640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1f806ae40 0x7fc1f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.882+0000 7fc20affd640 1 -- 172.21.15.45:0/334312377 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc2040897b0 con 0x7fc2140c1220 2023-11-18T19:24:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.882+0000 7fc21a018640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1f806ae40 0x7fc1f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.883+0000 7fc21a018640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1f806ae40 0x7fc1f806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc210036000 tx=0x7fc21003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:12.887+0000 7fc20affd640 1 -- 172.21.15.45:0/334312377 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc204054500 con 0x7fc2140c1220 2023-11-18T19:24:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.079+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc2140683a0 con 0x7fc2140c1220 2023-11-18T19:24:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.080+0000 7fc20affd640 1 -- 172.21.15.45:0/334312377 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc204057b20 con 0x7fc2140c1220 2023-11-18T19:24:13.082 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-18T19:24:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1f806ae40 msgr2=0x7fc1f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1f806ae40 0x7fc1f806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc210036000 tx=0x7fc21003d040 comp rx=0 tx=0).stop 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 msgr2=0x7fc2140ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140ac9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc20400b3f0 tx=0x7fc20400b8b0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 shutdown_connections 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc1f806ae40 0x7fc1f806d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2140c26a0 0x7fc21409adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2140c1220 0x7fc2140ac9d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 --2- 172.21.15.45:0/334312377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21406c9b0 0x7fc2141547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 >> 172.21.15.45:0/334312377 conn(0x7fc2140a9930 msgr2=0x7fc2140a9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 shutdown_connections 2023-11-18T19:24:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.083+0000 7fc21b01a640 1 -- 172.21.15.45:0/334312377 wait complete. 2023-11-18T19:24:13.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-18T19:24:13.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.318+0000 7f16ed24d640 1 Processor -- start 2023-11-18T19:24:13.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.319+0000 7f16ed24d640 1 -- start start 2023-11-18T19:24:13.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16ed24d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e80a5100 0x7f16e80727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:13.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16ed24d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e80c55b0 0x7f16e80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:13.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16ed24d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e80c1f20 con 0x7f16e8155880 2023-11-18T19:24:13.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16ed24d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80c1d10 con 0x7f16e80c55b0 2023-11-18T19:24:13.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16ed24d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8071d90 con 0x7f16e80a5100 2023-11-18T19:24:13.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16df7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e80c55b0 0x7f16e80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:13.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16df7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e80c55b0 0x7f16e80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33002/0 (socket says 172.21.15.45:33002) 2023-11-18T19:24:13.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16df7fe640 1 -- 172.21.15.45:0/2212981754 learned_addr learned my addr 172.21.15.45:0/2212981754 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.320+0000 7f16e7fff640 1 --2- 172.21.15.45:0/2212981754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e80a5100 0x7f16e80727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.321+0000 7f16df7fe640 1 -- 172.21.15.45:0/2212981754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e80a5100 msgr2=0x7f16e80727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.321+0000 7f16df7fe640 1 --2- 172.21.15.45:0/2212981754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e80a5100 0x7f16e80727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.321+0000 7f16df7fe640 1 -- 172.21.15.45:0/2212981754 >> v1:172.21.15.135:6789/0 conn(0x7f16e8155880 legacy=0x7f16e806daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.321+0000 7f16df7fe640 1 -- 172.21.15.45:0/2212981754 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80c2200 con 0x7f16e80c55b0 2023-11-18T19:24:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.322+0000 7f16df7fe640 1 --2- 172.21.15.45:0/2212981754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80c55b0 0x7f16e80702c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009870 tx=0x7f16d002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43366ee0487d0c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.322+0000 7f16e77fe640 1 -- 172.21.15.45:0/2212981754 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d00317c0 con 0x7f16e80c55b0 2023-11-18T19:24:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.322+0000 7f16e77fe640 1 -- 172.21.15.45:0/2212981754 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0031920 con 0x7f16e80c55b0 2023-11-18T19:24:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.322+0000 7f16e77fe640 1 -- 172.21.15.45:0/2212981754 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0031cb0 con 0x7f16e80c55b0 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 -- 172.21.15.45:0/2212981754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80c55b0 msgr2=0x7f16e80702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 --2- 172.21.15.45:0/2212981754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80c55b0 0x7f16e80702c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009870 tx=0x7f16d002b860 comp rx=0 tx=0).stop 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 -- 172.21.15.45:0/2212981754 shutdown_connections 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 --2- 172.21.15.45:0/2212981754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80c55b0 0x7f16e80702c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 --2- 172.21.15.45:0/2212981754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e80a5100 0x7f16e80727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 -- 172.21.15.45:0/2212981754 >> 172.21.15.45:0/2212981754 conn(0x7f16e80a78a0 msgr2=0x7f16e80a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 -- 172.21.15.45:0/2212981754 shutdown_connections 2023-11-18T19:24:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.323+0000 7f16ed24d640 1 -- 172.21.15.45:0/2212981754 wait complete. 2023-11-18T19:24:13.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.325+0000 7f16ed24d640 1 Processor -- start 2023-11-18T19:24:13.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.325+0000 7f16ed24d640 1 -- start start 2023-11-18T19:24:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16ed24d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80a5100 0x7f16e81ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16ed24d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e80c55b0 0x7f16e8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16ed24d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e8155880 0x7f16e814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16ed24d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81ecda0 con 0x7f16e80a5100 2023-11-18T19:24:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16ed24d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80aa840 con 0x7f16e80c55b0 2023-11-18T19:24:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16ed24d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e806bc60 con 0x7f16e8155880 2023-11-18T19:24:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80a5100 0x7f16e81ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80a5100 0x7f16e81ea2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33018/0 (socket says 172.21.15.45:33018) 2023-11-18T19:24:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16e7fff640 1 -- 172.21.15.45:0/1951675936 learned_addr learned my addr 172.21.15.45:0/1951675936 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16df7fe640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e80c55b0 0x7f16e8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16e7fff640 1 -- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e8155880 msgr2=0x7f16e814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.326+0000 7f16eca4c640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e8155880 0x7f16e814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e7fff640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e8155880 0x7f16e814dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e7fff640 1 -- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e80c55b0 msgr2=0x7f16e8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e7fff640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e80c55b0 0x7f16e8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e7fff640 1 -- 172.21.15.45:0/1951675936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00094d0 con 0x7f16e80a5100 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16df7fe640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e80c55b0 0x7f16e8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16eca4c640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e8155880 0x7f16e814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e7fff640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80a5100 0x7f16e81ea2b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f16d800d5f0 tx=0x7f16d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e57fa640 1 -- 172.21.15.45:0/1951675936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80125f0 con 0x7f16e80a5100 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e57fa640 1 -- 172.21.15.45:0/1951675936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8012750 con 0x7f16e80a5100 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16e57fa640 1 -- 172.21.15.45:0/1951675936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8012b00 con 0x7f16e80a5100 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e80aaa50 con 0x7f16e80a5100 2023-11-18T19:24:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.327+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e80ab010 con 0x7f16e80a5100 2023-11-18T19:24:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.329+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e8067940 con 0x7f16e80a5100 2023-11-18T19:24:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.330+0000 7f16e57fa640 1 -- 172.21.15.45:0/1951675936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16d8012c60 con 0x7f16e80a5100 2023-11-18T19:24:13.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.331+0000 7f16e57fa640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16c806ae40 0x7f16c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:13.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.331+0000 7f16e57fa640 1 -- 172.21.15.45:0/1951675936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f16d8089da0 con 0x7f16e80a5100 2023-11-18T19:24:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.331+0000 7f16df7fe640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16c806ae40 0x7f16c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.332+0000 7f16df7fe640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16c806ae40 0x7f16c806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16d0036000 tx=0x7f16d003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.336+0000 7f16e57fa640 1 -- 172.21.15.45:0/1951675936 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16d8054b90 con 0x7f16e80a5100 2023-11-18T19:24:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.545+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f16e80ab1a0 con 0x7f16e80a5100 2023-11-18T19:24:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.546+0000 7f16e57fa640 1 -- 172.21.15.45:0/1951675936 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f16d80581b0 con 0x7f16e80a5100 2023-11-18T19:24:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-18T19:24:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16c806ae40 msgr2=0x7f16c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16c806ae40 0x7f16c806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16d0036000 tx=0x7f16d003d040 comp rx=0 tx=0).stop 2023-11-18T19:24:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80a5100 msgr2=0x7f16e81ea2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80a5100 0x7f16e81ea2b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f16d800d5f0 tx=0x7f16d800dab0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 shutdown_connections 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f16c806ae40 0x7f16c806d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16e8155880 0x7f16e814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e80c55b0 0x7f16e8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 --2- 172.21.15.45:0/1951675936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80a5100 0x7f16e81ea2b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 >> 172.21.15.45:0/1951675936 conn(0x7f16e80a78a0 msgr2=0x7f16e806daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 shutdown_connections 2023-11-18T19:24:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:13.549+0000 7f16ed24d640 1 -- 172.21.15.45:0/1951675936 wait complete. 2023-11-18T19:24:13.570 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-18T19:24:13.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:24:13.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-18T19:24:21.461 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:24:21.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:24:21.461 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-18T19:24:21.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:24:21.511 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-11-18T19:24:21.583 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-18T19:24:21.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:24:21.585 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-18T19:24:21.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:24:21.657 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-11-18T19:24:21.774 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-18T19:24:21.775 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-11-18T19:24:21.775 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-18T19:24:21.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 2023-11-18T19:24:21.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:24:21.818 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-11-18T19:24:21.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-18T19:24:21.898 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-11-18T19:24:22.210 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-11-18T19:24:22.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T19:24:22.215 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi135 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 2023-11-18T19:24:22.283 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bd5c846ee48f44c3bbbdab4332a318e8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi135 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 2023-11-18T19:24:22.286 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-18T19:24:22.296 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-18T19:24:22.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:24:22.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.683+0000 7f8b02fe4640 1 Processor -- start 2023-11-18T19:24:22.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.684+0000 7f8b02fe4640 1 -- start start 2023-11-18T19:24:22.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.686+0000 7f8b02fe4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8af4047470 0x7f8af4006e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:22.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.686+0000 7f8b02fe4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8af40073b0 0x7f8af400a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:22.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.686+0000 7f8b02fe4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af400a3f0 con 0x7f8af40dbcb0 2023-11-18T19:24:22.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.686+0000 7f8b02fe4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af400bb20 con 0x7f8af4047470 2023-11-18T19:24:22.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.686+0000 7f8b02fe4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af4048030 con 0x7f8af40073b0 2023-11-18T19:24:22.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.687+0000 7f8b027e3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8af40073b0 0x7f8af400a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:22.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.687+0000 7f8b027e3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8af40073b0 0x7f8af400a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:33632/0 (socket says 172.21.15.45:33632) 2023-11-18T19:24:22.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.687+0000 7f8b027e3640 1 -- 172.21.15.45:0/747861065 learned_addr learned my addr 172.21.15.45:0/747861065 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:22.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.688+0000 7f8b017e1640 1 --2- 172.21.15.45:0/747861065 >> v2:172.21.15.45:3300/0 conn(0x7f8af4047470 0x7f8af4006e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:22.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.688+0000 7f8b017e1640 1 -- 172.21.15.45:0/747861065 >> v2:172.21.15.135:3300/0 conn(0x7f8af40073b0 msgr2=0x7f8af400a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:22.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.688+0000 7f8b017e1640 1 --2- 172.21.15.45:0/747861065 >> v2:172.21.15.135:3300/0 conn(0x7f8af40073b0 0x7f8af400a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:22.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.688+0000 7f8b017e1640 1 -- 172.21.15.45:0/747861065 >> v1:172.21.15.135:6789/0 conn(0x7f8af40dbcb0 legacy=0x7f8af40df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.688+0000 7f8b017e1640 1 -- 172.21.15.45:0/747861065 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af400a0c0 con 0x7f8af4047470 2023-11-18T19:24:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.690+0000 7f8b017e1640 1 --2- 172.21.15.45:0/747861065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af4047470 0x7f8af4006e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8af4035ef0 tx=0x7f8aec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1878a3e5cebe6d3d server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:22.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.691+0000 7f8b00fe0640 1 -- 172.21.15.45:0/747861065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec02e070 con 0x7f8af4047470 2023-11-18T19:24:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.692+0000 7f8b00fe0640 1 -- 172.21.15.45:0/747861065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec0315a0 con 0x7f8af4047470 2023-11-18T19:24:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.692+0000 7f8b00fe0640 1 -- 172.21.15.45:0/747861065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec031930 con 0x7f8af4047470 2023-11-18T19:24:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.693+0000 7f8b02fe4640 1 -- 172.21.15.45:0/747861065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af4047470 msgr2=0x7f8af4006e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.693+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/747861065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af4047470 0x7f8af4006e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8af4035ef0 tx=0x7f8aec02b840 comp rx=0 tx=0).stop 2023-11-18T19:24:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.694+0000 7f8b02fe4640 1 -- 172.21.15.45:0/747861065 shutdown_connections 2023-11-18T19:24:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.694+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/747861065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af4047470 0x7f8af4006e70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.694+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/747861065 >> v2:172.21.15.135:3300/0 conn(0x7f8af40073b0 0x7f8af400a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.694+0000 7f8b02fe4640 1 -- 172.21.15.45:0/747861065 >> 172.21.15.45:0/747861065 conn(0x7f8af4048220 msgr2=0x7f8af4048630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.694+0000 7f8b02fe4640 1 -- 172.21.15.45:0/747861065 shutdown_connections 2023-11-18T19:24:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.694+0000 7f8b02fe4640 1 -- 172.21.15.45:0/747861065 wait complete. 2023-11-18T19:24:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.697+0000 7f8b02fe4640 1 Processor -- start 2023-11-18T19:24:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.697+0000 7f8b02fe4640 1 -- start start 2023-11-18T19:24:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.699+0000 7f8b02fe4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af40073b0 0x7f8af402f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.700+0000 7f8b02fe4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af4047470 0x7f8af417d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.700+0000 7f8b02fe4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40dbcb0 0x7f8af4043390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:22.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b027e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40dbcb0 0x7f8af4043390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:22.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b01fe2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af40073b0 0x7f8af402f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:22.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b027e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40dbcb0 0x7f8af4043390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33032/0 (socket says 172.21.15.45:33032) 2023-11-18T19:24:22.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b01fe2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af40073b0 0x7f8af402f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:59676/0 (socket says 172.21.15.45:59676) 2023-11-18T19:24:22.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b027e3640 1 -- 172.21.15.45:0/1523918226 learned_addr learned my addr 172.21.15.45:0/1523918226 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4040a30 con 0x7f8af40dbcb0 2023-11-18T19:24:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af417d980 con 0x7f8af4047470 2023-11-18T19:24:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.701+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4040e30 con 0x7f8af40073b0 2023-11-18T19:24:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.702+0000 7f8b027e3640 1 -- 172.21.15.45:0/1523918226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af40073b0 msgr2=0x7f8af402f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.702+0000 7f8b027e3640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af40073b0 0x7f8af402f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:22.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.702+0000 7f8b027e3640 1 -- 172.21.15.45:0/1523918226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af4047470 msgr2=0x7f8af417d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:22.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.702+0000 7f8b027e3640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af4047470 0x7f8af417d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:22.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.702+0000 7f8b027e3640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec009400 con 0x7f8af40dbcb0 2023-11-18T19:24:22.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.703+0000 7f8b027e3640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40dbcb0 0x7f8af4043390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8afc050140 tx=0x7f8afc067f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:22.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.704+0000 7f8af27fc640 1 -- 172.21.15.45:0/1523918226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc06bcc0 con 0x7f8af40dbcb0 2023-11-18T19:24:22.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.704+0000 7f8af27fc640 1 -- 172.21.15.45:0/1523918226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc06be20 con 0x7f8af40dbcb0 2023-11-18T19:24:22.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.704+0000 7f8af27fc640 1 -- 172.21.15.45:0/1523918226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0723d0 con 0x7f8af40dbcb0 2023-11-18T19:24:22.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.704+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af403f440 con 0x7f8af40dbcb0 2023-11-18T19:24:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.707+0000 7f8af27fc640 1 -- 172.21.15.45:0/1523918226 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8afc072530 con 0x7f8af40dbcb0 2023-11-18T19:24:22.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.708+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af40410f0 con 0x7f8af40dbcb0 2023-11-18T19:24:22.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.711+0000 7f8af27fc640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8ae006ae70 0x7f8ae006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.712+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4005360 con 0x7f8af40dbcb0 2023-11-18T19:24:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.712+0000 7f8af27fc640 1 -- 172.21.15.45:0/1523918226 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8afc103320 con 0x7f8af40dbcb0 2023-11-18T19:24:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.712+0000 7f8b01fe2640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8ae006ae70 0x7f8ae006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.717+0000 7f8b01fe2640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8ae006ae70 0x7f8ae006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8af4045af0 tx=0x7f8af8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:22.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:22.725+0000 7f8af27fc640 1 -- 172.21.15.45:0/1523918226 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8afc108060 con 0x7f8af40dbcb0 2023-11-18T19:24:22.959 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:24:22.970 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:24:23.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.178+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8af40dc090 con 0x7f8ae006ae70 2023-11-18T19:24:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.209+0000 7f8af27fc640 1 -- 172.21.15.45:0/1523918226 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372937 (secure 0 0 0) 0x7f8af80014c0 con 0x7f8ae006ae70 2023-11-18T19:24:23.213 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:24:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:24:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8ae006ae70 msgr2=0x7f8ae006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8ae006ae70 0x7f8ae006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8af4045af0 tx=0x7f8af8009040 comp rx=0 tx=0).stop 2023-11-18T19:24:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40dbcb0 msgr2=0x7f8af4043390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40dbcb0 0x7f8af4043390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8afc050140 tx=0x7f8afc067f00 comp rx=0 tx=0).stop 2023-11-18T19:24:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 shutdown_connections 2023-11-18T19:24:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40dbcb0 0x7f8af4043390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8af4047470 0x7f8af417d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8ae006ae70 0x7f8ae006d330 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8af4045af0 tx=0x7f8af8009040 comp rx=0 tx=0).stop 2023-11-18T19:24:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 --2- 172.21.15.45:0/1523918226 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8af40073b0 0x7f8af402f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.220+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 >> 172.21.15.45:0/1523918226 conn(0x7f8af4048220 msgr2=0x7f8af402bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.222+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 shutdown_connections 2023-11-18T19:24:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.222+0000 7f8b02fe4640 1 -- 172.21.15.45:0/1523918226 wait complete. 2023-11-18T19:24:23.263 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":559,"stamp":"2023-11-18T19:24:21.585171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1810840727,"num_objects":120073,"num_object_clones":0,"num_object_copies":384938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120073,"num_whiteouts":0,"num_read":993,"num_read_kb":1908,"num_write":258916,"num_write_kb":2409124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2799,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217027,"ondisk_log_size":217027,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4899532,"kb_used_data":2895436,"kb_used_omap":12,"kb_used_meta":2004019,"kb_avail":750075188,"statfs":{"total":773094113280,"available":768076992512,"internally_reserved":0,"allocated":2964926464,"data_stored":4364156392,"data_compressed":750590521,"data_compressed_allocated":897224704,"data_compressed_original":2297987072,"omap_allocated":12748,"internal_metadata":2052116020},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,0,8,22,65,26,47,207,10],"upper_bound":2048},"perf_stat":{"commit_latency_ms":181,"apply_latency_ms":181,"commit_latency_ns":181000000,"apply_latency_ns":181000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":279281942,"num_objects":1354,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3036,"num_write_kb":250851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004365"},"pg_stats":[{"pgid":"2.1f","version":"29'390","reported_seq":416,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.252156+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:24:16.252156+0000","last_peered":"2023-11-18T19:24:16.252156+0000","last_clean":"2023-11-18T19:24:16.252156+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:16.252156+0000","last_undegraded":"2023-11-18T19:24:16.252156+0000","last_fullsized":"2023-11-18T19:24:16.252156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":564,"num_write_kb":13652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'893","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.017126+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:24:17.017126+0000","last_peered":"2023-11-18T19:24:17.017126+0000","last_clean":"2023-11-18T19:24:17.017126+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:24:17.017126+0000","last_undegraded":"2023-11-18T19:24:17.017126+0000","last_fullsized":"2023-11-18T19:24:17.017126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":673,"num_object_clones":0,"num_object_copies":1346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4427","reported_seq":4450,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.279721+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:24:17.279721+0000","last_peered":"2023-11-18T19:24:17.279721+0000","last_clean":"2023-11-18T19:24:17.279721+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:17.279721+0000","last_undegraded":"2023-11-18T19:24:17.279721+0000","last_fullsized":"2023-11-18T19:24:17.279721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4427,"log_dups_size":0,"ondisk_log_size":4427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47451406,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5911,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'310","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.825011+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:24:16.825011+0000","last_peered":"2023-11-18T19:24:16.825011+0000","last_clean":"2023-11-18T19:24:16.825011+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:16.825011+0000","last_undegraded":"2023-11-18T19:24:16.825011+0000","last_fullsized":"2023-11-18T19:24:16.825011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":458,"num_write_kb":31029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'881","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.847713+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:24:16.847713+0000","last_peered":"2023-11-18T19:24:16.847713+0000","last_clean":"2023-11-18T19:24:16.847713+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:24:16.847713+0000","last_undegraded":"2023-11-18T19:24:16.847713+0000","last_fullsized":"2023-11-18T19:24:16.847713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":676,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4453","reported_seq":4468,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.806857+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:24:16.806857+0000","last_peered":"2023-11-18T19:24:16.806857+0000","last_clean":"2023-11-18T19:24:16.806857+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:16.806857+0000","last_undegraded":"2023-11-18T19:24:16.806857+0000","last_fullsized":"2023-11-18T19:24:16.806857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4453,"log_dups_size":0,"ondisk_log_size":4453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45462821,"num_objects":2276,"num_object_clones":0,"num_object_copies":9104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2276,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5916,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'501","reported_seq":525,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.756644+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:24:16.756644+0000","last_peered":"2023-11-18T19:24:16.756644+0000","last_clean":"2023-11-18T19:24:16.756644+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:16.756644+0000","last_undegraded":"2023-11-18T19:24:16.756644+0000","last_fullsized":"2023-11-18T19:24:16.756644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":681,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'961","reported_seq":984,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678110+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:24:18.678110+0000","last_peered":"2023-11-18T19:24:18.678110+0000","last_clean":"2023-11-18T19:24:18.678110+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:18.678110+0000","last_undegraded":"2023-11-18T19:24:18.678110+0000","last_fullsized":"2023-11-18T19:24:18.678110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4506","reported_seq":4523,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.027260+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:24:17.027260+0000","last_peered":"2023-11-18T19:24:17.027260+0000","last_clean":"2023-11-18T19:24:17.027260+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:24:17.027260+0000","last_undegraded":"2023-11-18T19:24:17.027260+0000","last_fullsized":"2023-11-18T19:24:17.027260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48615182,"num_objects":2249,"num_object_clones":0,"num_object_copies":8996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5980,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:19.771442+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:24:19.771442+0000","last_peered":"2023-11-18T19:24:19.771442+0000","last_clean":"2023-11-18T19:24:19.771442+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:19.771442+0000","last_undegraded":"2023-11-18T19:24:19.771442+0000","last_fullsized":"2023-11-18T19:24:19.771442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":406,"num_write_kb":17263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":80,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'943","reported_seq":967,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.742426+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:24:16.742426+0000","last_peered":"2023-11-18T19:24:16.742426+0000","last_clean":"2023-11-18T19:24:16.742426+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:24:16.742426+0000","last_undegraded":"2023-11-18T19:24:16.742426+0000","last_fullsized":"2023-11-18T19:24:16.742426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":711,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4332","reported_seq":4347,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.903626+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:24:16.903626+0000","last_peered":"2023-11-18T19:24:16.903626+0000","last_clean":"2023-11-18T19:24:16.903626+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:16.903626+0000","last_undegraded":"2023-11-18T19:24:16.903626+0000","last_fullsized":"2023-11-18T19:24:16.903626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44558226,"num_objects":2220,"num_object_clones":0,"num_object_copies":8880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2220,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5690,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'926","reported_seq":951,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.760708+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:24:16.760708+0000","last_peered":"2023-11-18T19:24:16.760708+0000","last_clean":"2023-11-18T19:24:16.760708+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:16.760708+0000","last_undegraded":"2023-11-18T19:24:16.760708+0000","last_fullsized":"2023-11-18T19:24:16.760708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'398","reported_seq":423,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.669953+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:24:16.669953+0000","last_peered":"2023-11-18T19:24:16.669953+0000","last_clean":"2023-11-18T19:24:16.669953+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:24:16.669953+0000","last_undegraded":"2023-11-18T19:24:16.669953+0000","last_fullsized":"2023-11-18T19:24:16.669953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":29794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4486","reported_seq":4501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.903406+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:24:16.903406+0000","last_peered":"2023-11-18T19:24:16.903406+0000","last_clean":"2023-11-18T19:24:16.903406+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:16.903406+0000","last_undegraded":"2023-11-18T19:24:16.903406+0000","last_fullsized":"2023-11-18T19:24:16.903406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50703405,"num_objects":2306,"num_object_clones":0,"num_object_copies":9224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5962,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'956","reported_seq":979,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.075935+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:24:17.075935+0000","last_peered":"2023-11-18T19:24:17.075935+0000","last_clean":"2023-11-18T19:24:17.075935+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:17.075935+0000","last_undegraded":"2023-11-18T19:24:17.075935+0000","last_fullsized":"2023-11-18T19:24:17.075935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":956,"log_dups_size":0,"ondisk_log_size":956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'425","reported_seq":451,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.146384+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:24:17.146384+0000","last_peered":"2023-11-18T19:24:17.146384+0000","last_clean":"2023-11-18T19:24:17.146384+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:17.146384+0000","last_undegraded":"2023-11-18T19:24:17.146384+0000","last_fullsized":"2023-11-18T19:24:17.146384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":591,"num_write_kb":29973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4482","reported_seq":4504,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.286812+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:24:17.286812+0000","last_peered":"2023-11-18T19:24:17.286812+0000","last_clean":"2023-11-18T19:24:17.286812+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:24:17.286812+0000","last_undegraded":"2023-11-18T19:24:17.286812+0000","last_fullsized":"2023-11-18T19:24:17.286812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4482,"log_dups_size":0,"ondisk_log_size":4482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5947,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'981","reported_seq":1006,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.963594+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:24:16.963594+0000","last_peered":"2023-11-18T19:24:16.963594+0000","last_clean":"2023-11-18T19:24:16.963594+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:16.963594+0000","last_undegraded":"2023-11-18T19:24:16.963594+0000","last_fullsized":"2023-11-18T19:24:16.963594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":744,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'414","reported_seq":440,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:23:56.384891+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:23:56.384891+0000","last_peered":"2023-11-18T19:23:56.384891+0000","last_clean":"2023-11-18T19:23:56.384891+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:23:56.384891+0000","last_undegraded":"2023-11-18T19:23:56.384891+0000","last_fullsized":"2023-11-18T19:23:56.384891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":17421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":98,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4506","reported_seq":4525,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.269040+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:24:17.269040+0000","last_peered":"2023-11-18T19:24:17.269040+0000","last_clean":"2023-11-18T19:24:17.269040+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:24:17.269040+0000","last_undegraded":"2023-11-18T19:24:17.269040+0000","last_fullsized":"2023-11-18T19:24:17.269040+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6027,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'927","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.811182+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:24:16.811182+0000","last_peered":"2023-11-18T19:24:16.811182+0000","last_clean":"2023-11-18T19:24:16.811182+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:24:16.811182+0000","last_undegraded":"2023-11-18T19:24:16.811182+0000","last_fullsized":"2023-11-18T19:24:16.811182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":681,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'456","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.589972+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:24:16.589972+0000","last_peered":"2023-11-18T19:24:16.589972+0000","last_clean":"2023-11-18T19:24:16.589972+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:16.589972+0000","last_undegraded":"2023-11-18T19:24:16.589972+0000","last_fullsized":"2023-11-18T19:24:16.589972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":13018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4433","reported_seq":4454,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.931308+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:24:16.931308+0000","last_peered":"2023-11-18T19:24:16.931308+0000","last_clean":"2023-11-18T19:24:16.931308+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:24:16.931308+0000","last_undegraded":"2023-11-18T19:24:16.931308+0000","last_fullsized":"2023-11-18T19:24:16.931308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4433,"log_dups_size":0,"ondisk_log_size":4433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53745506,"num_objects":2314,"num_object_clones":0,"num_object_copies":9256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5904,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'922","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.940215+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:24:16.940215+0000","last_peered":"2023-11-18T19:24:16.940215+0000","last_clean":"2023-11-18T19:24:16.940215+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:16.940215+0000","last_undegraded":"2023-11-18T19:24:16.940215+0000","last_fullsized":"2023-11-18T19:24:16.940215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":712,"num_object_clones":0,"num_object_copies":1424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'282","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.930334+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:24:16.930334+0000","last_peered":"2023-11-18T19:24:16.930334+0000","last_clean":"2023-11-18T19:24:16.930334+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:24:16.930334+0000","last_undegraded":"2023-11-18T19:24:16.930334+0000","last_fullsized":"2023-11-18T19:24:16.930334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":445,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4464","reported_seq":4482,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.886971+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:24:16.886971+0000","last_peered":"2023-11-18T19:24:16.886971+0000","last_clean":"2023-11-18T19:24:16.886971+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:16.886971+0000","last_undegraded":"2023-11-18T19:24:16.886971+0000","last_fullsized":"2023-11-18T19:24:16.886971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58464801,"num_objects":2266,"num_object_clones":0,"num_object_copies":9064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5933,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'875","reported_seq":900,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.790632+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:24:16.790632+0000","last_peered":"2023-11-18T19:24:16.790632+0000","last_clean":"2023-11-18T19:24:16.790632+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:16.790632+0000","last_undegraded":"2023-11-18T19:24:16.790632+0000","last_fullsized":"2023-11-18T19:24:16.790632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":653,"num_object_clones":0,"num_object_copies":1306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'521","reported_seq":547,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.569391+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:24:16.569391+0000","last_peered":"2023-11-18T19:24:16.569391+0000","last_clean":"2023-11-18T19:24:16.569391+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:16.569391+0000","last_undegraded":"2023-11-18T19:24:16.569391+0000","last_fullsized":"2023-11-18T19:24:16.569391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1032,"num_write_kb":20768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4454","reported_seq":4477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.921267+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:24:16.921267+0000","last_peered":"2023-11-18T19:24:16.921267+0000","last_clean":"2023-11-18T19:24:16.921267+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:24:16.921267+0000","last_undegraded":"2023-11-18T19:24:16.921267+0000","last_fullsized":"2023-11-18T19:24:16.921267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4454,"log_dups_size":0,"ondisk_log_size":4454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41934269,"num_objects":2268,"num_object_clones":0,"num_object_copies":9072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2268,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5915,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'901","reported_seq":926,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.586883+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:24:16.586883+0000","last_peered":"2023-11-18T19:24:16.586883+0000","last_clean":"2023-11-18T19:24:16.586883+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:16.586883+0000","last_undegraded":"2023-11-18T19:24:16.586883+0000","last_fullsized":"2023-11-18T19:24:16.586883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":710,"num_object_clones":0,"num_object_copies":1420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":762,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'290","reported_seq":316,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.245000+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:24:16.245000+0000","last_peered":"2023-11-18T19:24:16.245000+0000","last_clean":"2023-11-18T19:24:16.245000+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:24:16.245000+0000","last_undegraded":"2023-11-18T19:24:16.245000+0000","last_fullsized":"2023-11-18T19:24:16.245000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":21523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4489","reported_seq":4507,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.261239+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:24:17.261239+0000","last_peered":"2023-11-18T19:24:17.261239+0000","last_clean":"2023-11-18T19:24:17.261239+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:24:17.261239+0000","last_undegraded":"2023-11-18T19:24:17.261239+0000","last_fullsized":"2023-11-18T19:24:17.261239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4489,"log_dups_size":0,"ondisk_log_size":4489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41013963,"num_objects":2289,"num_object_clones":0,"num_object_copies":9156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5941,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'893","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.000054+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:24:17.000054+0000","last_peered":"2023-11-18T19:24:17.000054+0000","last_clean":"2023-11-18T19:24:17.000054+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:17.000054+0000","last_undegraded":"2023-11-18T19:24:17.000054+0000","last_fullsized":"2023-11-18T19:24:17.000054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":684,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'460","reported_seq":483,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.570868+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:24:16.570868+0000","last_peered":"2023-11-18T19:24:16.570868+0000","last_clean":"2023-11-18T19:24:16.570868+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:16.570868+0000","last_undegraded":"2023-11-18T19:24:16.570868+0000","last_fullsized":"2023-11-18T19:24:16.570868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":17286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":72,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4422","reported_seq":4444,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.159564+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:24:17.159564+0000","last_peered":"2023-11-18T19:24:17.159564+0000","last_clean":"2023-11-18T19:24:17.159564+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:24:17.159564+0000","last_undegraded":"2023-11-18T19:24:17.159564+0000","last_fullsized":"2023-11-18T19:24:17.159564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4422,"log_dups_size":0,"ondisk_log_size":4422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47550464,"num_objects":2249,"num_object_clones":0,"num_object_copies":8996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5888,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'938","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674306+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:24:18.674306+0000","last_peered":"2023-11-18T19:24:18.674306+0000","last_clean":"2023-11-18T19:24:18.674306+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:18.674306+0000","last_undegraded":"2023-11-18T19:24:18.674306+0000","last_fullsized":"2023-11-18T19:24:18.674306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1167","reported_seq":1193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.890563+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:24:16.890563+0000","last_peered":"2023-11-18T19:24:16.890563+0000","last_clean":"2023-11-18T19:24:16.890563+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:24:16.890563+0000","last_undegraded":"2023-11-18T19:24:16.890563+0000","last_fullsized":"2023-11-18T19:24:16.890563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1329,"num_write_kb":42534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4414","reported_seq":4440,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.708466+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:24:16.708466+0000","last_peered":"2023-11-18T19:24:16.708466+0000","last_clean":"2023-11-18T19:24:16.708466+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:24:16.708466+0000","last_undegraded":"2023-11-18T19:24:16.708466+0000","last_fullsized":"2023-11-18T19:24:16.708466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4414,"log_dups_size":0,"ondisk_log_size":4414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645816,"num_objects":2306,"num_object_clones":0,"num_object_copies":9224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2306,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5871,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'926","reported_seq":950,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.881504+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:24:16.881504+0000","last_peered":"2023-11-18T19:24:16.881504+0000","last_clean":"2023-11-18T19:24:16.881504+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:16.881504+0000","last_undegraded":"2023-11-18T19:24:16.881504+0000","last_fullsized":"2023-11-18T19:24:16.881504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":723,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1366","reported_seq":2225,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.264159+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:24:17.264159+0000","last_peered":"2023-11-18T19:24:17.264159+0000","last_clean":"2023-11-18T19:24:17.264159+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:17.264159+0000","last_undegraded":"2023-11-18T19:24:17.264159+0000","last_fullsized":"2023-11-18T19:24:17.264159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1366,"log_dups_size":0,"ondisk_log_size":1366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8762201,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":834,"num_read_kb":1808,"num_write":1547,"num_write_kb":22465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4359","reported_seq":4378,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.198479+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:24:17.198479+0000","last_peered":"2023-11-18T19:24:17.198479+0000","last_clean":"2023-11-18T19:24:17.198479+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:24:17.198479+0000","last_undegraded":"2023-11-18T19:24:17.198479+0000","last_fullsized":"2023-11-18T19:24:17.198479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4359,"log_dups_size":0,"ondisk_log_size":4359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52643045,"num_objects":2220,"num_object_clones":0,"num_object_copies":8880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2220,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5734,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'876","reported_seq":900,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.302672+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:24:17.302672+0000","last_peered":"2023-11-18T19:24:17.302672+0000","last_clean":"2023-11-18T19:24:17.302672+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:17.302672+0000","last_undegraded":"2023-11-18T19:24:17.302672+0000","last_fullsized":"2023-11-18T19:24:17.302672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":682,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'475","reported_seq":501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.840415+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:24:16.840415+0000","last_peered":"2023-11-18T19:24:16.840415+0000","last_clean":"2023-11-18T19:24:16.840415+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:24:16.840415+0000","last_undegraded":"2023-11-18T19:24:16.840415+0000","last_fullsized":"2023-11-18T19:24:16.840415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":29626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":84,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4536","reported_seq":4559,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.928341+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:24:16.928341+0000","last_peered":"2023-11-18T19:24:16.928341+0000","last_clean":"2023-11-18T19:24:16.928341+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:24:16.928341+0000","last_undegraded":"2023-11-18T19:24:16.928341+0000","last_fullsized":"2023-11-18T19:24:16.928341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43898707,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'919","reported_seq":944,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.915966+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:24:16.915966+0000","last_peered":"2023-11-18T19:24:16.915966+0000","last_clean":"2023-11-18T19:24:16.915966+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:16.915966+0000","last_undegraded":"2023-11-18T19:24:16.915966+0000","last_fullsized":"2023-11-18T19:24:16.915966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":712,"num_object_clones":0,"num_object_copies":1424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'395","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.465313+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:24:16.465313+0000","last_peered":"2023-11-18T19:24:16.465313+0000","last_clean":"2023-11-18T19:24:16.465313+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:24:16.465313+0000","last_undegraded":"2023-11-18T19:24:16.465313+0000","last_fullsized":"2023-11-18T19:24:16.465313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":17537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:20:35.780144+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:20:35.780144+0000","last_peered":"2023-11-18T19:20:35.780144+0000","last_clean":"2023-11-18T19:20:35.780144+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:20:35.780144+0000","last_undegraded":"2023-11-18T19:20:35.780144+0000","last_fullsized":"2023-11-18T19:20:35.780144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:24:48.318265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4358","reported_seq":4377,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.824340+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:24:16.824340+0000","last_peered":"2023-11-18T19:24:16.824340+0000","last_clean":"2023-11-18T19:24:16.824340+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:24:16.824340+0000","last_undegraded":"2023-11-18T19:24:16.824340+0000","last_fullsized":"2023-11-18T19:24:16.824340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4358,"log_dups_size":0,"ondisk_log_size":4358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47905440,"num_objects":2232,"num_object_clones":0,"num_object_copies":8928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5771,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'905","reported_seq":926,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.840016+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:24:16.840016+0000","last_peered":"2023-11-18T19:24:16.840016+0000","last_clean":"2023-11-18T19:24:16.840016+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:24:16.840016+0000","last_undegraded":"2023-11-18T19:24:16.840016+0000","last_fullsized":"2023-11-18T19:24:16.840016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":905,"log_dups_size":0,"ondisk_log_size":905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":692,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'445","reported_seq":470,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:23:56.209404+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:23:56.209404+0000","last_peered":"2023-11-18T19:23:56.209404+0000","last_clean":"2023-11-18T19:23:56.209404+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:23:56.209404+0000","last_undegraded":"2023-11-18T19:23:56.209404+0000","last_fullsized":"2023-11-18T19:23:56.209404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":622,"num_write_kb":29765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4505","reported_seq":4525,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.958711+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:24:16.958711+0000","last_peered":"2023-11-18T19:24:16.958711+0000","last_clean":"2023-11-18T19:24:16.958711+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:24:16.958711+0000","last_undegraded":"2023-11-18T19:24:16.958711+0000","last_fullsized":"2023-11-18T19:24:16.958711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54574360,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'912","reported_seq":935,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.683557+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:24:18.683557+0000","last_peered":"2023-11-18T19:24:18.683557+0000","last_clean":"2023-11-18T19:24:18.683557+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:18.683557+0000","last_undegraded":"2023-11-18T19:24:18.683557+0000","last_fullsized":"2023-11-18T19:24:18.683557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":677,"num_object_clones":0,"num_object_copies":1354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":735,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'871","reported_seq":895,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.222577+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:24:16.222577+0000","last_peered":"2023-11-18T19:24:16.222577+0000","last_clean":"2023-11-18T19:24:16.222577+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:24:16.222577+0000","last_undegraded":"2023-11-18T19:24:16.222577+0000","last_fullsized":"2023-11-18T19:24:16.222577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":34254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":101,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4534","reported_seq":4551,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.020699+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:24:17.020699+0000","last_peered":"2023-11-18T19:24:17.020699+0000","last_clean":"2023-11-18T19:24:17.020699+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:24:17.020699+0000","last_undegraded":"2023-11-18T19:24:17.020699+0000","last_fullsized":"2023-11-18T19:24:17.020699+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4534,"log_dups_size":0,"ondisk_log_size":4534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46932754,"num_objects":2321,"num_object_clones":0,"num_object_copies":9284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2321,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6003,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'923","reported_seq":946,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.681245+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:24:18.681245+0000","last_peered":"2023-11-18T19:24:18.681245+0000","last_clean":"2023-11-18T19:24:18.681245+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:24:18.681245+0000","last_undegraded":"2023-11-18T19:24:18.681245+0000","last_fullsized":"2023-11-18T19:24:18.681245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'580","reported_seq":605,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.944147+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:24:16.944147+0000","last_peered":"2023-11-18T19:24:16.944147+0000","last_clean":"2023-11-18T19:24:16.944147+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:16.944147+0000","last_undegraded":"2023-11-18T19:24:16.944147+0000","last_fullsized":"2023-11-18T19:24:16.944147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":725,"num_write_kb":21480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":76,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4669","reported_seq":4686,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.712054+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:24:16.712054+0000","last_peered":"2023-11-18T19:24:16.712054+0000","last_clean":"2023-11-18T19:24:16.712054+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:24:16.712054+0000","last_undegraded":"2023-11-18T19:24:16.712054+0000","last_fullsized":"2023-11-18T19:24:16.712054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4669,"log_dups_size":0,"ondisk_log_size":4669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53456575,"num_objects":2316,"num_object_clones":0,"num_object_copies":9264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2316,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6196,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'917","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.913883+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:24:16.913883+0000","last_peered":"2023-11-18T19:24:16.913883+0000","last_clean":"2023-11-18T19:24:16.913883+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:16.913883+0000","last_undegraded":"2023-11-18T19:24:16.913883+0000","last_fullsized":"2023-11-18T19:24:16.913883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'289","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.527795+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:24:16.527795+0000","last_peered":"2023-11-18T19:24:16.527795+0000","last_clean":"2023-11-18T19:24:16.527795+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:16.527795+0000","last_undegraded":"2023-11-18T19:24:16.527795+0000","last_fullsized":"2023-11-18T19:24:16.527795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":439,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4440","reported_seq":4465,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.166110+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:24:18.166110+0000","last_peered":"2023-11-18T19:24:18.166110+0000","last_clean":"2023-11-18T19:24:18.166110+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:18.166110+0000","last_undegraded":"2023-11-18T19:24:18.166110+0000","last_fullsized":"2023-11-18T19:24:18.166110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:03.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5875,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'966","reported_seq":988,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.739608+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:24:16.739608+0000","last_peered":"2023-11-18T19:24:16.739608+0000","last_clean":"2023-11-18T19:24:16.739608+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:16.739608+0000","last_undegraded":"2023-11-18T19:24:16.739608+0000","last_fullsized":"2023-11-18T19:24:16.739608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":724,"num_object_clones":0,"num_object_copies":1448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":798,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'350","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.963748+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:24:16.963748+0000","last_peered":"2023-11-18T19:24:16.963748+0000","last_clean":"2023-11-18T19:24:16.963748+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:16.963748+0000","last_undegraded":"2023-11-18T19:24:16.963748+0000","last_fullsized":"2023-11-18T19:24:16.963748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":555,"num_write_kb":13205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4379","reported_seq":4407,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.942037+0000","last_change":"2023-11-18T19:07:25.182659+0000","last_active":"2023-11-18T19:24:16.942037+0000","last_peered":"2023-11-18T19:24:16.942037+0000","last_clean":"2023-11-18T19:24:16.942037+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:24:16.942037+0000","last_undegraded":"2023-11-18T19:24:16.942037+0000","last_fullsized":"2023-11-18T19:24:16.942037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4379,"log_dups_size":0,"ondisk_log_size":4379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40898824,"num_objects":2245,"num_object_clones":0,"num_object_copies":8980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5780,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'917","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.150031+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:24:18.150031+0000","last_peered":"2023-11-18T19:24:18.150031+0000","last_clean":"2023-11-18T19:24:18.150031+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:18.150031+0000","last_undegraded":"2023-11-18T19:24:18.150031+0000","last_fullsized":"2023-11-18T19:24:18.150031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'268","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.413179+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:24:16.413179+0000","last_peered":"2023-11-18T19:24:16.413179+0000","last_clean":"2023-11-18T19:24:16.413179+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:16.413179+0000","last_undegraded":"2023-11-18T19:24:16.413179+0000","last_fullsized":"2023-11-18T19:24:16.413179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":457,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4516","reported_seq":4532,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.060828+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:24:17.060828+0000","last_peered":"2023-11-18T19:24:17.060828+0000","last_clean":"2023-11-18T19:24:17.060828+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:24:17.060828+0000","last_undegraded":"2023-11-18T19:24:17.060828+0000","last_fullsized":"2023-11-18T19:24:17.060828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4516,"log_dups_size":0,"ondisk_log_size":4516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44082423,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5989,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'918","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.864569+0000","last_change":"2023-11-18T19:07:25.179515+0000","last_active":"2023-11-18T19:24:16.864569+0000","last_peered":"2023-11-18T19:24:16.864569+0000","last_clean":"2023-11-18T19:24:16.864569+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:16.864569+0000","last_undegraded":"2023-11-18T19:24:16.864569+0000","last_fullsized":"2023-11-18T19:24:16.864569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:56.657976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":713,"num_object_clones":0,"num_object_copies":1426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'418","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.466544+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:24:16.466544+0000","last_peered":"2023-11-18T19:24:16.466544+0000","last_clean":"2023-11-18T19:24:16.466544+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:24:16.466544+0000","last_undegraded":"2023-11-18T19:24:16.466544+0000","last_fullsized":"2023-11-18T19:24:16.466544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":638,"num_write_kb":5589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":111,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4306","reported_seq":4328,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.708612+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:24:16.708612+0000","last_peered":"2023-11-18T19:24:16.708612+0000","last_clean":"2023-11-18T19:24:16.708612+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:24:16.708612+0000","last_undegraded":"2023-11-18T19:24:16.708612+0000","last_fullsized":"2023-11-18T19:24:16.708612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4306,"log_dups_size":0,"ondisk_log_size":4306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54110137,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5716,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'862","reported_seq":886,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.020426+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:24:17.020426+0000","last_peered":"2023-11-18T19:24:17.020426+0000","last_clean":"2023-11-18T19:24:17.020426+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:17.020426+0000","last_undegraded":"2023-11-18T19:24:17.020426+0000","last_fullsized":"2023-11-18T19:24:17.020426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":665,"num_object_clones":0,"num_object_copies":1330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'362","reported_seq":386,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.816615+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:24:16.816615+0000","last_peered":"2023-11-18T19:24:16.816615+0000","last_clean":"2023-11-18T19:24:16.816615+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:16.816615+0000","last_undegraded":"2023-11-18T19:24:16.816615+0000","last_fullsized":"2023-11-18T19:24:16.816615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":563,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4309","reported_seq":4323,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.874360+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:24:16.874360+0000","last_peered":"2023-11-18T19:24:16.874360+0000","last_clean":"2023-11-18T19:24:16.874360+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:24:16.874360+0000","last_undegraded":"2023-11-18T19:24:16.874360+0000","last_fullsized":"2023-11-18T19:24:16.874360+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46170530,"num_objects":2201,"num_object_clones":0,"num_object_copies":8804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5759,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'898","reported_seq":921,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.682351+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:24:18.682351+0000","last_peered":"2023-11-18T19:24:18.682351+0000","last_clean":"2023-11-18T19:24:18.682351+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:18.682351+0000","last_undegraded":"2023-11-18T19:24:18.682351+0000","last_fullsized":"2023-11-18T19:24:18.682351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":687,"num_object_clones":0,"num_object_copies":1374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'588","reported_seq":612,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.768096+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:24:16.768096+0000","last_peered":"2023-11-18T19:24:16.768096+0000","last_clean":"2023-11-18T19:24:16.768096+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:16.768096+0000","last_undegraded":"2023-11-18T19:24:16.768096+0000","last_fullsized":"2023-11-18T19:24:16.768096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":787,"num_write_kb":29986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4297","reported_seq":4317,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.033683+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:24:17.033683+0000","last_peered":"2023-11-18T19:24:17.033683+0000","last_clean":"2023-11-18T19:24:17.033683+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:24:17.033683+0000","last_undegraded":"2023-11-18T19:24:17.033683+0000","last_fullsized":"2023-11-18T19:24:17.033683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4297,"log_dups_size":0,"ondisk_log_size":4297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53116071,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5664,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'903","reported_seq":925,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.687812+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:24:16.687812+0000","last_peered":"2023-11-18T19:24:16.687812+0000","last_clean":"2023-11-18T19:24:16.687812+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:16.687812+0000","last_undegraded":"2023-11-18T19:24:16.687812+0000","last_fullsized":"2023-11-18T19:24:16.687812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'753","reported_seq":777,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.312199+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:24:17.312199+0000","last_peered":"2023-11-18T19:24:17.312199+0000","last_clean":"2023-11-18T19:24:17.312199+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:17.312199+0000","last_undegraded":"2023-11-18T19:24:17.312199+0000","last_fullsized":"2023-11-18T19:24:17.312199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":938,"num_write_kb":22039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":97,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4405","reported_seq":4427,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.893875+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:24:16.893875+0000","last_peered":"2023-11-18T19:24:16.893875+0000","last_clean":"2023-11-18T19:24:16.893875+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:16.893875+0000","last_undegraded":"2023-11-18T19:24:16.893875+0000","last_fullsized":"2023-11-18T19:24:16.893875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4405,"log_dups_size":0,"ondisk_log_size":4405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37891744,"num_objects":2282,"num_object_clones":0,"num_object_copies":9128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2282,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5891,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'904","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.857043+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:24:16.857043+0000","last_peered":"2023-11-18T19:24:16.857043+0000","last_clean":"2023-11-18T19:24:16.857043+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:16.857043+0000","last_undegraded":"2023-11-18T19:24:16.857043+0000","last_fullsized":"2023-11-18T19:24:16.857043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'360","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.592044+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:24:16.592044+0000","last_peered":"2023-11-18T19:24:16.592044+0000","last_clean":"2023-11-18T19:24:16.592044+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:24:16.592044+0000","last_undegraded":"2023-11-18T19:24:16.592044+0000","last_fullsized":"2023-11-18T19:24:16.592044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":532,"num_write_kb":25814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4339","reported_seq":4354,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.271060+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:24:17.271060+0000","last_peered":"2023-11-18T19:24:17.271060+0000","last_clean":"2023-11-18T19:24:17.271060+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:17.271060+0000","last_undegraded":"2023-11-18T19:24:17.271060+0000","last_fullsized":"2023-11-18T19:24:17.271060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4339,"log_dups_size":0,"ondisk_log_size":4339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66642488,"num_objects":2175,"num_object_clones":0,"num_object_copies":8700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2175,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5753,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'899","reported_seq":922,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.993227+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:24:16.993227+0000","last_peered":"2023-11-18T19:24:16.993227+0000","last_clean":"2023-11-18T19:24:16.993227+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:16.993227+0000","last_undegraded":"2023-11-18T19:24:16.993227+0000","last_fullsized":"2023-11-18T19:24:16.993227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":670,"num_object_clones":0,"num_object_copies":1340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1205","reported_seq":1229,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.350366+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:24:17.350366+0000","last_peered":"2023-11-18T19:24:17.350366+0000","last_clean":"2023-11-18T19:24:17.350366+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:17.350366+0000","last_undegraded":"2023-11-18T19:24:17.350366+0000","last_fullsized":"2023-11-18T19:24:17.350366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:08.678189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1356,"num_write_kb":21994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4535","reported_seq":4566,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.908262+0000","last_change":"2023-11-18T19:07:25.179857+0000","last_active":"2023-11-18T19:24:16.908262+0000","last_peered":"2023-11-18T19:24:16.908262+0000","last_clean":"2023-11-18T19:24:16.908262+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:24:16.908262+0000","last_undegraded":"2023-11-18T19:24:16.908262+0000","last_fullsized":"2023-11-18T19:24:16.908262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4535,"log_dups_size":0,"ondisk_log_size":4535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111251,"num_objects":2319,"num_object_clones":0,"num_object_copies":9276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4327","reported_seq":4347,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.219407+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:24:17.219407+0000","last_peered":"2023-11-18T19:24:17.219407+0000","last_clean":"2023-11-18T19:24:17.219407+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:24:17.219407+0000","last_undegraded":"2023-11-18T19:24:17.219407+0000","last_fullsized":"2023-11-18T19:24:17.219407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4327,"log_dups_size":0,"ondisk_log_size":4327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32964791,"num_objects":2173,"num_object_clones":0,"num_object_copies":8692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2173,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5724,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'909","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.387981+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:24:16.387981+0000","last_peered":"2023-11-18T19:24:16.387981+0000","last_clean":"2023-11-18T19:24:16.387981+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:16.387981+0000","last_undegraded":"2023-11-18T19:24:16.387981+0000","last_fullsized":"2023-11-18T19:24:16.387981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'516","reported_seq":541,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.801907+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:24:16.801907+0000","last_peered":"2023-11-18T19:24:16.801907+0000","last_clean":"2023-11-18T19:24:16.801907+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:24:16.801907+0000","last_undegraded":"2023-11-18T19:24:16.801907+0000","last_fullsized":"2023-11-18T19:24:16.801907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":681,"num_write_kb":37722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4279","reported_seq":4302,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.661984+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:24:16.661984+0000","last_peered":"2023-11-18T19:24:16.661984+0000","last_clean":"2023-11-18T19:24:16.661984+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:24:16.661984+0000","last_undegraded":"2023-11-18T19:24:16.661984+0000","last_fullsized":"2023-11-18T19:24:16.661984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4279,"log_dups_size":0,"ondisk_log_size":4279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48991010,"num_objects":2172,"num_object_clones":0,"num_object_copies":8688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5654,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'980","reported_seq":1003,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.881724+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:24:16.881724+0000","last_peered":"2023-11-18T19:24:16.881724+0000","last_clean":"2023-11-18T19:24:16.881724+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:16.881724+0000","last_undegraded":"2023-11-18T19:24:16.881724+0000","last_fullsized":"2023-11-18T19:24:16.881724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":746,"num_object_clones":0,"num_object_copies":1492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'299","reported_seq":324,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.274740+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:24:17.274740+0000","last_peered":"2023-11-18T19:24:17.274740+0000","last_clean":"2023-11-18T19:24:17.274740+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:17.274740+0000","last_undegraded":"2023-11-18T19:24:17.274740+0000","last_fullsized":"2023-11-18T19:24:17.274740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'663","reported_seq":688,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:23:56.458428+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:23:56.458428+0000","last_peered":"2023-11-18T19:23:56.458428+0000","last_clean":"2023-11-18T19:23:56.458428+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:23:56.458428+0000","last_undegraded":"2023-11-18T19:23:56.458428+0000","last_fullsized":"2023-11-18T19:23:56.458428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":33791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'917","reported_seq":941,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.828906+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:24:16.828906+0000","last_peered":"2023-11-18T19:24:16.828906+0000","last_clean":"2023-11-18T19:24:16.828906+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:16.828906+0000","last_undegraded":"2023-11-18T19:24:16.828906+0000","last_fullsized":"2023-11-18T19:24:16.828906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4499","reported_seq":4520,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.810612+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:24:16.810612+0000","last_peered":"2023-11-18T19:24:16.810612+0000","last_clean":"2023-11-18T19:24:16.810612+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:24:16.810612+0000","last_undegraded":"2023-11-18T19:24:16.810612+0000","last_fullsized":"2023-11-18T19:24:16.810612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4499,"log_dups_size":0,"ondisk_log_size":4499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50818792,"num_objects":2331,"num_object_clones":0,"num_object_copies":9324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5982,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'239","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:23:56.132388+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:23:56.132388+0000","last_peered":"2023-11-18T19:23:56.132388+0000","last_clean":"2023-11-18T19:23:56.132388+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:23:56.132388+0000","last_undegraded":"2023-11-18T19:23:56.132388+0000","last_fullsized":"2023-11-18T19:23:56.132388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":17245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":80,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'924","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.660411+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:24:18.660411+0000","last_peered":"2023-11-18T19:24:18.660411+0000","last_clean":"2023-11-18T19:24:18.660411+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:18.660411+0000","last_undegraded":"2023-11-18T19:24:18.660411+0000","last_fullsized":"2023-11-18T19:24:18.660411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4544","reported_seq":4561,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.312896+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:24:17.312896+0000","last_peered":"2023-11-18T19:24:17.312896+0000","last_clean":"2023-11-18T19:24:17.312896+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:24:17.312896+0000","last_undegraded":"2023-11-18T19:24:17.312896+0000","last_fullsized":"2023-11-18T19:24:17.312896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38526255,"num_objects":2294,"num_object_clones":0,"num_object_copies":9176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2294,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6062,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'926","reported_seq":950,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.581795+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:24:16.581795+0000","last_peered":"2023-11-18T19:24:16.581795+0000","last_clean":"2023-11-18T19:24:16.581795+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:16.581795+0000","last_undegraded":"2023-11-18T19:24:16.581795+0000","last_fullsized":"2023-11-18T19:24:16.581795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'979","reported_seq":1003,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.096470+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:24:17.096470+0000","last_peered":"2023-11-18T19:24:17.096470+0000","last_clean":"2023-11-18T19:24:17.096470+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:17.096470+0000","last_undegraded":"2023-11-18T19:24:17.096470+0000","last_fullsized":"2023-11-18T19:24:17.096470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'922","reported_seq":937,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.886433+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:24:16.886433+0000","last_peered":"2023-11-18T19:24:16.886433+0000","last_clean":"2023-11-18T19:24:16.886433+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:16.886433+0000","last_undegraded":"2023-11-18T19:24:16.886433+0000","last_fullsized":"2023-11-18T19:24:16.886433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":696,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'927","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.845845+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:24:16.845845+0000","last_peered":"2023-11-18T19:24:16.845845+0000","last_clean":"2023-11-18T19:24:16.845845+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:16.845845+0000","last_undegraded":"2023-11-18T19:24:16.845845+0000","last_fullsized":"2023-11-18T19:24:16.845845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":713,"num_object_clones":0,"num_object_copies":1426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'890","reported_seq":915,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.567183+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:24:16.567183+0000","last_peered":"2023-11-18T19:24:16.567183+0000","last_clean":"2023-11-18T19:24:16.567183+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:24:16.567183+0000","last_undegraded":"2023-11-18T19:24:16.567183+0000","last_fullsized":"2023-11-18T19:24:16.567183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'909","reported_seq":928,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.289371+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:24:17.289371+0000","last_peered":"2023-11-18T19:24:17.289371+0000","last_clean":"2023-11-18T19:24:17.289371+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:24:17.289371+0000","last_undegraded":"2023-11-18T19:24:17.289371+0000","last_fullsized":"2023-11-18T19:24:17.289371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'965","reported_seq":989,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.879199+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:24:16.879199+0000","last_peered":"2023-11-18T19:24:16.879199+0000","last_clean":"2023-11-18T19:24:16.879199+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:16.879199+0000","last_undegraded":"2023-11-18T19:24:16.879199+0000","last_fullsized":"2023-11-18T19:24:16.879199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'884","reported_seq":908,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.970744+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:24:16.970744+0000","last_peered":"2023-11-18T19:24:16.970744+0000","last_clean":"2023-11-18T19:24:16.970744+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:24:16.970744+0000","last_undegraded":"2023-11-18T19:24:16.970744+0000","last_fullsized":"2023-11-18T19:24:16.970744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":653,"num_object_clones":0,"num_object_copies":1306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":709,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'931","reported_seq":954,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.856916+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:24:16.856916+0000","last_peered":"2023-11-18T19:24:16.856916+0000","last_clean":"2023-11-18T19:24:16.856916+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:16.856916+0000","last_undegraded":"2023-11-18T19:24:16.856916+0000","last_fullsized":"2023-11-18T19:24:16.856916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'880","reported_seq":903,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.644186+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:24:16.644186+0000","last_peered":"2023-11-18T19:24:16.644186+0000","last_clean":"2023-11-18T19:24:16.644186+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:16.644186+0000","last_undegraded":"2023-11-18T19:24:16.644186+0000","last_fullsized":"2023-11-18T19:24:16.644186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":693,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":735,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'933","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678232+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:24:18.678232+0000","last_peered":"2023-11-18T19:24:18.678232+0000","last_clean":"2023-11-18T19:24:18.678232+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:18.678232+0000","last_undegraded":"2023-11-18T19:24:18.678232+0000","last_fullsized":"2023-11-18T19:24:18.678232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":703,"num_object_clones":0,"num_object_copies":1406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'924","reported_seq":948,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.795634+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:24:16.795634+0000","last_peered":"2023-11-18T19:24:16.795634+0000","last_clean":"2023-11-18T19:24:16.795634+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:16.795634+0000","last_undegraded":"2023-11-18T19:24:16.795634+0000","last_fullsized":"2023-11-18T19:24:16.795634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'948","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678688+0000","last_change":"2023-11-18T19:06:37.568642+0000","last_active":"2023-11-18T19:24:18.678688+0000","last_peered":"2023-11-18T19:24:18.678688+0000","last_clean":"2023-11-18T19:24:18.678688+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:18.678688+0000","last_undegraded":"2023-11-18T19:24:18.678688+0000","last_fullsized":"2023-11-18T19:24:18.678688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":703,"num_object_clones":0,"num_object_copies":1406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'931","reported_seq":955,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.742561+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:24:16.742561+0000","last_peered":"2023-11-18T19:24:16.742561+0000","last_clean":"2023-11-18T19:24:16.742561+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:24:16.742561+0000","last_undegraded":"2023-11-18T19:24:16.742561+0000","last_fullsized":"2023-11-18T19:24:16.742561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'882","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.253509+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:24:17.253509+0000","last_peered":"2023-11-18T19:24:17.253509+0000","last_clean":"2023-11-18T19:24:17.253509+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:17.253509+0000","last_undegraded":"2023-11-18T19:24:17.253509+0000","last_fullsized":"2023-11-18T19:24:17.253509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'953","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.930550+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:24:16.930550+0000","last_peered":"2023-11-18T19:24:16.930550+0000","last_clean":"2023-11-18T19:24:16.930550+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:16.930550+0000","last_undegraded":"2023-11-18T19:24:16.930550+0000","last_fullsized":"2023-11-18T19:24:16.930550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":740,"num_object_clones":0,"num_object_copies":1480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'887","reported_seq":908,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.727189+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:24:16.727189+0000","last_peered":"2023-11-18T19:24:16.727189+0000","last_clean":"2023-11-18T19:24:16.727189+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:16.727189+0000","last_undegraded":"2023-11-18T19:24:16.727189+0000","last_fullsized":"2023-11-18T19:24:16.727189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":668,"num_object_clones":0,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":722,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'929","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.945183+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:24:16.945183+0000","last_peered":"2023-11-18T19:24:16.945183+0000","last_clean":"2023-11-18T19:24:16.945183+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:16.945183+0000","last_undegraded":"2023-11-18T19:24:16.945183+0000","last_fullsized":"2023-11-18T19:24:16.945183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'861","reported_seq":885,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.159860+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:24:17.159860+0000","last_peered":"2023-11-18T19:24:17.159860+0000","last_clean":"2023-11-18T19:24:17.159860+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:17.159860+0000","last_undegraded":"2023-11-18T19:24:17.159860+0000","last_fullsized":"2023-11-18T19:24:17.159860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":658,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'892","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:03.114588+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:24:03.114588+0000","last_peered":"2023-11-18T19:24:03.114588+0000","last_clean":"2023-11-18T19:24:03.114588+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:03.114588+0000","last_undegraded":"2023-11-18T19:24:03.114588+0000","last_fullsized":"2023-11-18T19:24:03.114588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":691,"num_object_clones":0,"num_object_copies":1382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'891","reported_seq":914,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.671452+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:24:18.671452+0000","last_peered":"2023-11-18T19:24:18.671452+0000","last_clean":"2023-11-18T19:24:18.671452+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:18.671452+0000","last_undegraded":"2023-11-18T19:24:18.671452+0000","last_fullsized":"2023-11-18T19:24:18.671452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":691,"num_object_clones":0,"num_object_copies":1382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'915","reported_seq":938,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678923+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:24:18.678923+0000","last_peered":"2023-11-18T19:24:18.678923+0000","last_clean":"2023-11-18T19:24:18.678923+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:24:18.678923+0000","last_undegraded":"2023-11-18T19:24:18.678923+0000","last_fullsized":"2023-11-18T19:24:18.678923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'899","reported_seq":922,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674409+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:24:18.674409+0000","last_peered":"2023-11-18T19:24:18.674409+0000","last_clean":"2023-11-18T19:24:18.674409+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:24:18.674409+0000","last_undegraded":"2023-11-18T19:24:18.674409+0000","last_fullsized":"2023-11-18T19:24:18.674409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'964","reported_seq":987,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.664810+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:24:18.664810+0000","last_peered":"2023-11-18T19:24:18.664810+0000","last_clean":"2023-11-18T19:24:18.664810+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:18.664810+0000","last_undegraded":"2023-11-18T19:24:18.664810+0000","last_fullsized":"2023-11-18T19:24:18.664810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'877","reported_seq":900,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.896711+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:24:16.896711+0000","last_peered":"2023-11-18T19:24:16.896711+0000","last_clean":"2023-11-18T19:24:16.896711+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:16.896711+0000","last_undegraded":"2023-11-18T19:24:16.896711+0000","last_fullsized":"2023-11-18T19:24:16.896711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":690,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'929","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.672747+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:24:18.672747+0000","last_peered":"2023-11-18T19:24:18.672747+0000","last_clean":"2023-11-18T19:24:18.672747+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:18.672747+0000","last_undegraded":"2023-11-18T19:24:18.672747+0000","last_fullsized":"2023-11-18T19:24:18.672747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'854","reported_seq":873,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.959014+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:24:16.959014+0000","last_peered":"2023-11-18T19:24:16.959014+0000","last_clean":"2023-11-18T19:24:16.959014+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:16.959014+0000","last_undegraded":"2023-11-18T19:24:16.959014+0000","last_fullsized":"2023-11-18T19:24:16.959014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":639,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":639,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'962","reported_seq":985,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.683616+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:24:18.683616+0000","last_peered":"2023-11-18T19:24:18.683616+0000","last_clean":"2023-11-18T19:24:18.683616+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:18.683616+0000","last_undegraded":"2023-11-18T19:24:18.683616+0000","last_fullsized":"2023-11-18T19:24:18.683616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'904","reported_seq":926,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.984966+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:24:16.984966+0000","last_peered":"2023-11-18T19:24:16.984966+0000","last_clean":"2023-11-18T19:24:16.984966+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:16.984966+0000","last_undegraded":"2023-11-18T19:24:16.984966+0000","last_fullsized":"2023-11-18T19:24:16.984966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":706,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'940","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.753602+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:24:16.753602+0000","last_peered":"2023-11-18T19:24:16.753602+0000","last_clean":"2023-11-18T19:24:16.753602+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:16.753602+0000","last_undegraded":"2023-11-18T19:24:16.753602+0000","last_fullsized":"2023-11-18T19:24:16.753602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'867","reported_seq":891,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.756594+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:24:16.756594+0000","last_peered":"2023-11-18T19:24:16.756594+0000","last_clean":"2023-11-18T19:24:16.756594+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:24:16.756594+0000","last_undegraded":"2023-11-18T19:24:16.756594+0000","last_fullsized":"2023-11-18T19:24:16.756594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":652,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":700,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'875","reported_seq":899,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674270+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:24:18.674270+0000","last_peered":"2023-11-18T19:24:18.674270+0000","last_clean":"2023-11-18T19:24:18.674270+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:24:18.674270+0000","last_undegraded":"2023-11-18T19:24:18.674270+0000","last_fullsized":"2023-11-18T19:24:18.674270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":651,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":697,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1541439840,"num_objects":72396,"num_object_clones":0,"num_object_copies":289584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72396,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":188411,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2823647232,"data_stored":3834732544,"data_compressed":666878211,"data_compressed_allocated":793718784,"data_compressed_original":1804804096,"omap_allocated":0,"internal_metadata":0},"log_size":142004,"ondisk_log_size":142004,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":44804,"num_object_clones":0,"num_object_copies":89608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58602,"ondisk_log_size":58602,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":268810519,"num_objects":2871,"num_object_clones":0,"num_object_copies":5742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2871,"num_whiteouts":0,"num_read":862,"num_read_kb":1808,"num_write":22114,"num_write_kb":716716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2799,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":141275136,"data_stored":541360294,"data_compressed":85712523,"data_compressed_allocated":105963520,"data_compressed_original":506109952,"omap_allocated":0,"internal_metadata":0},"log_size":16304,"ondisk_log_size":16304,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509654,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":625384,"kb_used_data":377632,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93746456,"statfs":{"total":96636764160,"available":95996370944,"internally_reserved":0,"allocated":386695168,"data_stored":577176370,"data_compressed":101972753,"data_compressed_allocated":122486784,"data_compressed_original":313151488,"omap_allocated":1594,"internal_metadata":253688262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":4.327,"15min":4.8049999999999997},"min":{"1min":0.65100000000000002,"5min":0.45800000000000002,"15min":0.372},"max":{"1min":2.4529999999999998,"5min":248.00800000000001,"15min":248.00800000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":4.516,"15min":5.0270000000000001},"min":{"1min":0.72899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.4210000000000003,"5min":175.095,"15min":384.19499999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":2.4630000000000001,"15min":4.0839999999999996},"min":{"1min":0.748,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":4.681,"5min":53.398000000000003,"15min":199.179},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.587,"5min":4.5679999999999996,"15min":5.2869999999999999},"min":{"1min":0.72399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":6.4619999999999997,"5min":175.06800000000001,"15min":384.09699999999998},"last":0.76800000000000002}]},{"osd":2,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.952,"15min":3.2559999999999998},"min":{"1min":0.63600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.8279999999999998,"5min":15.159000000000001,"15min":207.149},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.357,"5min":2.4900000000000002,"15min":5.4939999999999998},"min":{"1min":0.71299999999999997,"5min":0.51800000000000002,"15min":0.47299999999999998},"max":{"1min":2.4969999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":1.048}]},{"osd":3,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":4.593,"15min":5.6929999999999996},"min":{"1min":0.73299999999999998,"5min":0.51400000000000001,"15min":0.44600000000000001},"max":{"1min":6.4909999999999997,"5min":175.02600000000001,"15min":384.04700000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.472,"5min":2.4580000000000002,"15min":3.4009999999999998},"min":{"1min":0.755,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":2.8700000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":1.268}]},{"osd":4,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":3.1269999999999998,"15min":5.0049999999999999},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":4.9420000000000002,"5min":86.346999999999994,"15min":199.393},"last":1.014},{"interface":"front","average":{"1min":2.8420000000000001,"5min":5.4690000000000003,"15min":6.5700000000000003},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":26.733000000000001,"5min":204.786,"15min":384.161},"last":0.81499999999999995}]},{"osd":5,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":3.1309999999999998,"15min":4.4429999999999996},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":2.8959999999999999,"5min":79.472999999999999,"15min":220.36500000000001},"last":1.101},{"interface":"front","average":{"1min":2.0169999999999999,"5min":4.9050000000000002,"15min":5.5800000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":6.2699999999999996,"5min":160.107,"15min":212.68100000000001},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":5.1760000000000002,"15min":8.9359999999999999},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":6.8769999999999998,"5min":205.01400000000001,"15min":410.60000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":2.8530000000000002,"5min":2.6150000000000002,"15min":4.0279999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":21.158000000000001,"5min":28.329999999999998,"15min":207.85300000000001},"last":1.488}]}]},{"osd":5,"up_from":15,"seq":64424509655,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":572348,"kb_used_data":328756,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93799492,"statfs":{"total":96636764160,"available":96050679808,"internally_reserved":0,"allocated":336646144,"data_stored":502603772,"data_compressed":82384345,"data_compressed_allocated":99233792,"data_compressed_original":265388032,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.5720000000000001,"15min":4.1859999999999999},"min":{"1min":0.73999999999999999,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":8.1440000000000001,"5min":14.576000000000001,"15min":248.32400000000001},"last":1.54},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.7689999999999999,"15min":2.7909999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.3959999999999999,"5min":26.890000000000001,"15min":93.090999999999994},"last":1.0549999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":2.113,"15min":5.3600000000000003},"min":{"1min":0.84199999999999997,"5min":0.49199999999999999,"15min":0.47899999999999998},"max":{"1min":7.9390000000000001,"5min":41.881,"15min":335.11799999999999},"last":1.893},{"interface":"front","average":{"1min":2.8999999999999999,"5min":2.0619999999999998,"15min":3.9340000000000002},"min":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.432},"max":{"1min":22.524000000000001,"5min":22.524000000000001,"15min":278.17700000000002},"last":1.6339999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":2.3849999999999998,"15min":3.5470000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":36.954999999999998,"5min":50.735999999999997,"15min":144.68700000000001},"last":1.181},{"interface":"front","average":{"1min":1.893,"5min":2.0230000000000001,"15min":3.7120000000000002},"min":{"1min":0.77200000000000002,"5min":0.56499999999999995,"15min":0.504},"max":{"1min":7.8840000000000003,"5min":24.286999999999999,"15min":247.267},"last":2.1890000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.0209999999999999,"5min":1.9750000000000001,"15min":4.819},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":12.032,"5min":30.957999999999998,"15min":207.93799999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.887,"5min":2.1139999999999999,"15min":4.5300000000000002},"min":{"1min":0.73099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":7.976,"5min":24.491,"15min":265.82600000000002},"last":2.2549999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7,"5min":2.3250000000000002,"15min":4.633},"min":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.42199999999999999},"max":{"1min":8.1039999999999992,"5min":28.951000000000001,"15min":303.19200000000001},"last":2.052},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.1360000000000001,"15min":4.7229999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":12.207000000000001,"5min":31.018999999999998,"15min":210.78899999999999},"last":1.421}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.577,"5min":2.5600000000000001,"15min":6.6859999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":41.378,"5min":41.378,"15min":308.47500000000002},"last":2.1040000000000001},{"interface":"front","average":{"1min":2.9550000000000001,"5min":2.226,"15min":4.1150000000000002},"min":{"1min":0.58999999999999997,"5min":0.44400000000000001,"15min":0.34000000000000002},"max":{"1min":22.57,"5min":24.411000000000001,"15min":303.23599999999999},"last":2.1520000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2429999999999999,"5min":2.7789999999999999,"15min":5.2800000000000002},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.41199999999999998},"max":{"1min":11.987,"5min":63.313000000000002,"15min":252.18299999999999},"last":1.6830000000000001},{"interface":"front","average":{"1min":2.0499999999999998,"5min":1.9259999999999999,"15min":4.8479999999999999},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.437},"max":{"1min":8.0169999999999995,"5min":14.84,"15min":309.029},"last":2.339}]}]},{"osd":4,"up_from":15,"seq":64424509655,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555976,"kb_used_data":326272,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93815864,"statfs":{"total":96636764160,"available":96067444736,"internally_reserved":0,"allocated":334102528,"data_stored":516946034,"data_compressed":94624244,"data_compressed_allocated":114061312,"data_compressed_original":297103360,"omap_allocated":1592,"internal_metadata":235207112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,0,8,22,65,26,47,207,10],"upper_bound":2048},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.6660000000000004,"5min":3.8220000000000001,"15min":2.5840000000000001},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":51.582999999999998,"5min":51.582999999999998,"15min":58.200000000000003},"last":23.077999999999999},{"interface":"front","average":{"1min":5.0609999999999999,"5min":2.6120000000000001,"15min":2.3540000000000001},"min":{"1min":0.52900000000000003,"5min":0.40999999999999998,"15min":0.35999999999999999},"max":{"1min":56.402999999999999,"5min":56.402999999999999,"15min":56.402999999999999},"last":1.704}]},{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":2.3559999999999999,"15min":2.1949999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":11.771000000000001,"5min":36.024999999999999,"15min":36.024999999999999},"last":23.396000000000001},{"interface":"front","average":{"1min":7.2030000000000003,"5min":3.851,"15min":2.7309999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":51.542999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":22.565999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":5.6900000000000004,"5min":3.0270000000000001,"15min":2.6070000000000002},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":56.494,"5min":56.494,"15min":56.494},"last":16.777000000000001},{"interface":"front","average":{"1min":3.4809999999999999,"5min":2.8319999999999999,"15min":2.605},"min":{"1min":0.622,"5min":0.622,"15min":0.42799999999999999},"max":{"1min":18.276,"5min":36.057000000000002,"15min":36.057000000000002},"last":52.454000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":6.9779999999999998,"5min":3.8759999999999999,"15min":2.9460000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":51.643000000000001,"5min":51.643000000000001,"15min":58.039999999999999},"last":2.8039999999999998},{"interface":"front","average":{"1min":5.2889999999999997,"5min":2.8999999999999999,"15min":2.7719999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46500000000000002},"max":{"1min":56.530999999999999,"5min":56.530999999999999,"15min":56.530999999999999},"last":1.607}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.0039999999999996,"5min":4.5250000000000004,"15min":3.7200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.33200000000000002},"max":{"1min":68.007000000000005,"5min":68.007000000000005,"15min":68.007000000000005},"last":46.289999999999999},{"interface":"front","average":{"1min":10.465999999999999,"5min":4.702,"15min":3.8290000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38600000000000001},"max":{"1min":72.611000000000004,"5min":72.611000000000004,"15min":72.611000000000004},"last":34.197000000000003}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.811,"5min":4.2919999999999998,"15min":3.911},"min":{"1min":0.52700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":72.915999999999997,"5min":72.915999999999997,"15min":161.898},"last":1.504},{"interface":"front","average":{"1min":14.786,"5min":6.0739999999999998,"15min":4.7030000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":105.387,"5min":105.387,"15min":163.33600000000001},"last":23.273}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.2610000000000001,"5min":4.6710000000000003,"15min":4.1390000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":51.615000000000002,"5min":66.341999999999999,"15min":66.341999999999999},"last":22.099},{"interface":"front","average":{"1min":6.8499999999999996,"5min":4.1790000000000003,"15min":4.101},"min":{"1min":0.65800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":56.454000000000001,"5min":58.427999999999997,"15min":66.665000000000006},"last":16.263000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509656,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":707320,"kb_used_data":427696,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":93664520,"statfs":{"total":96636764160,"available":95912468480,"internally_reserved":0,"allocated":437960704,"data_stored":653219192,"data_compressed":113163069,"data_compressed_allocated":134516736,"data_compressed_original":349962240,"omap_allocated":1593,"internal_metadata":286325191},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.538,"15min":1.1679999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6919999999999999,"5min":44.363,"15min":44.363},"last":1.5760000000000001},{"interface":"front","average":{"1min":2.3540000000000001,"5min":1.992,"15min":1.956},"min":{"1min":0.44500000000000001,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":27.032,"5min":58.844999999999999,"15min":62.512999999999998},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.861,"15min":3.1539999999999999},"min":{"1min":0.626,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":11.923,"5min":33.281999999999996,"15min":202.65000000000001},"last":0.75},{"interface":"front","average":{"1min":1.996,"5min":2.2909999999999999,"15min":2.5369999999999999},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":16.783999999999999,"5min":84.191999999999993,"15min":114.221},"last":0.93300000000000005}]},{"osd":2,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.8799999999999999,"5min":1.712,"15min":1.5669999999999999},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":15.013,"5min":27.433,"15min":43.747999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":2.524,"15min":2.3660000000000001},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":1.98,"5min":50.006,"15min":50.006},"last":1.1619999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":3,"15min":4.2930000000000001},"min":{"1min":0.91900000000000004,"5min":0.66400000000000003,"15min":0.42499999999999999},"max":{"1min":12.43,"5min":51.384,"15min":202.821},"last":1.27},{"interface":"front","average":{"1min":2.3180000000000001,"5min":2.5089999999999999,"15min":3.2570000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":23.635000000000002,"5min":53.720999999999997,"15min":234.68700000000001},"last":1.7070000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.782,"5min":3.8900000000000001,"15min":4.3440000000000003},"min":{"1min":0.94199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":57.360999999999997,"5min":57.360999999999997,"15min":190.827},"last":1.0660000000000001},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.9550000000000001,"15min":4.6980000000000004},"min":{"1min":0.97799999999999998,"5min":0.58199999999999996,"15min":0.54700000000000004},"max":{"1min":39.981999999999999,"5min":70.242000000000004,"15min":213.03999999999999},"last":1.1140000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":6.0220000000000002,"5min":3.335,"15min":3.0529999999999999},"min":{"1min":0.93000000000000005,"5min":0.78300000000000003,"15min":0.46800000000000003},"max":{"1min":89.710999999999999,"5min":89.710999999999999,"15min":89.710999999999999},"last":1.319},{"interface":"front","average":{"1min":1.9610000000000001,"5min":3.2839999999999998,"15min":3.9489999999999998},"min":{"1min":1.093,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":12.269,"5min":50.899000000000001,"15min":202.78299999999999},"last":1.4339999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.625,"5min":3.2719999999999998,"15min":4.1950000000000003},"min":{"1min":1.014,"5min":0.745,"15min":0.58299999999999996},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":82.248000000000005},"last":1.3919999999999999},{"interface":"front","average":{"1min":4.0449999999999999,"5min":4.6319999999999997,"15min":6.069},"min":{"1min":1.087,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":42.883000000000003,"5min":113.44,"15min":233.44800000000001},"last":1.629}]}]},{"osd":2,"up_from":15,"seq":64424509656,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":574292,"kb_used_data":344588,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93797548,"statfs":{"total":96636764160,"available":96048689152,"internally_reserved":0,"allocated":352858112,"data_stored":499754450,"data_compressed":87594667,"data_compressed_allocated":103432192,"data_compressed_original":250519552,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.2029999999999998,"15min":1.9870000000000001},"min":{"1min":0.58999999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":15.622,"5min":83.817999999999998,"15min":83.817999999999998},"last":0.86299999999999999},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.448,"15min":3.4689999999999999},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":16.433,"5min":83.266999999999996,"15min":248.16999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":1.7709999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":15.384,"5min":19.004999999999999,"15min":30.504999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.157,"15min":3.3540000000000001},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.28100000000000003},"max":{"1min":14.863,"5min":47.768999999999998,"15min":255.315},"last":0.82899999999999996}]},{"osd":3,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":4.7300000000000004,"5min":1.98,"15min":1.976},"min":{"1min":0.77300000000000002,"5min":0.40799999999999997,"15min":0.315},"max":{"1min":30.062999999999999,"5min":30.062999999999999,"15min":84.840999999999994},"last":0.80400000000000005},{"interface":"front","average":{"1min":2.899,"5min":2.145,"15min":2.7589999999999999},"min":{"1min":0.73699999999999999,"5min":0.54700000000000004,"15min":0.36599999999999999},"max":{"1min":15.587,"5min":27.283000000000001,"15min":128.976},"last":1.1339999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":5.9710000000000001,"5min":3.0840000000000001,"15min":4.9109999999999996},"min":{"1min":1.0669999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":37.795000000000002,"5min":47.432000000000002,"15min":255.25700000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":3.7160000000000002,"5min":2.4159999999999999,"15min":3.4340000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.48299999999999998},"max":{"1min":15.198,"5min":34.531999999999996,"15min":128.655},"last":1.044}]},{"osd":5,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.7000000000000002,"15min":4.7380000000000004},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.53300000000000003},"max":{"1min":24.016999999999999,"5min":138.905,"15min":153.417},"last":1.375},{"interface":"front","average":{"1min":7.109,"5min":3.3610000000000002,"15min":5.6150000000000002},"min":{"1min":0.97999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":59.981000000000002,"5min":63.884,"15min":255.34899999999999},"last":1.109}]},{"osd":6,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.2330000000000001,"5min":2.5209999999999999,"15min":3.492},"min":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.55400000000000005},"max":{"1min":10.231,"5min":82.388999999999996,"15min":138.33099999999999},"last":1.173},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.835,"15min":5.0419999999999998},"min":{"1min":0.85099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":15.726000000000001,"5min":127.44799999999999,"15min":187.29599999999999},"last":1.2969999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":8.3079999999999998,"5min":4.3659999999999997,"15min":6.3360000000000003},"min":{"1min":1.026,"5min":0.95499999999999996,"15min":0.60899999999999999},"max":{"1min":67.837999999999994,"5min":81.165999999999997,"15min":211.17500000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":8.5269999999999992,"5min":3.2949999999999999,"15min":4.7069999999999999},"min":{"1min":0.92000000000000004,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":72.992999999999995,"5min":72.992999999999995,"15min":173.53999999999999},"last":1.325}]}]},{"osd":1,"up_from":15,"seq":64424509657,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686800,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93685040,"statfs":{"total":96636764160,"available":95933480960,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106207472,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.968,"5min":1.617,"15min":1.478},"min":{"1min":0.76500000000000001,"5min":0.30199999999999999,"15min":0.22500000000000001},"max":{"1min":21.655999999999999,"5min":21.655999999999999,"15min":51.420999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":3.3959999999999999,"5min":1.768,"15min":1.722},"min":{"1min":0.59899999999999998,"5min":0.34200000000000003,"15min":0.255},"max":{"1min":22.587,"5min":22.587,"15min":48.802999999999997},"last":1.466}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.768,"15min":2.544},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.308},"max":{"1min":24.036999999999999,"5min":24.036999999999999,"15min":131.321},"last":1.028},{"interface":"front","average":{"1min":4.6660000000000004,"5min":1.962,"15min":1.635},"min":{"1min":0.61499999999999999,"5min":0.40699999999999997,"15min":0.27800000000000002},"max":{"1min":26.029,"5min":26.029,"15min":26.029},"last":1.2090000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.343,"5min":2.2610000000000001,"15min":2.6800000000000002},"min":{"1min":0.65800000000000003,"5min":0.42799999999999999,"15min":0.26700000000000002},"max":{"1min":43.832999999999998,"5min":43.832999999999998,"15min":197.43899999999999},"last":1.712},{"interface":"front","average":{"1min":5.843,"5min":2.4249999999999998,"15min":2.5129999999999999},"min":{"1min":0.54600000000000004,"5min":0.39600000000000002,"15min":0.32100000000000001},"max":{"1min":54.316000000000003,"5min":54.316000000000003,"15min":156.316},"last":1.319}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.0209999999999999,"5min":2.722,"15min":3.3300000000000001},"min":{"1min":0.83899999999999997,"5min":0.64900000000000002,"15min":0.44800000000000001},"max":{"1min":48.799999999999997,"5min":48.799999999999997,"15min":159.84299999999999},"last":1.147},{"interface":"front","average":{"1min":5.1520000000000001,"5min":3.214,"15min":3.1389999999999998},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.51700000000000002},"max":{"1min":28.405999999999999,"5min":43.418999999999997,"15min":62.978999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":10.071,"5min":3.726,"15min":3.347},"min":{"1min":0.90400000000000003,"5min":0.72999999999999998,"15min":0.50600000000000001},"max":{"1min":107.88500000000001,"5min":107.88500000000001,"15min":107.88500000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.6800000000000002,"15min":3.1150000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":19.553999999999998,"5min":24.309999999999999,"15min":133.685},"last":1.2669999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":7.4649999999999999,"5min":3.1819999999999999,"15min":3.5950000000000002},"min":{"1min":1.1140000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":54.220999999999997,"5min":54.220999999999997,"15min":142.84100000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":3.8700000000000001,"5min":2.278,"15min":3.706},"min":{"1min":1.006,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":23.998999999999999,"5min":23.998999999999999,"15min":146.69900000000001},"last":1.4099999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.3479999999999999,"5min":3.0499999999999998,"15min":2.7200000000000002},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":31.096,"5min":31.096,"15min":35.783999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":7.819,"5min":3.5209999999999999,"15min":3.359},"min":{"1min":1.351,"5min":0.997,"15min":0.63600000000000001},"max":{"1min":34.281999999999996,"5min":34.281999999999996,"15min":57.134999999999998},"last":1.6779999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509658,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":492604,"kb_used_data":250484,"kb_used_omap":1,"kb_used_meta":242110,"kb_avail":93879236,"statfs":{"total":96636764160,"available":96132337664,"internally_reserved":0,"allocated":256495616,"data_stored":421311338,"data_compressed":70178109,"data_compressed_allocated":85630976,"data_compressed_original":250638336,"omap_allocated":1594,"internal_metadata":247921094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":3.3330000000000002,"5min":1.859,"15min":1.7569999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.21099999999999999},"max":{"1min":30.565000000000001,"5min":30.565000000000001,"15min":74.326999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":3.9260000000000002,"5min":2.1829999999999998,"15min":1.5900000000000001},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.25700000000000001},"max":{"1min":32.871000000000002,"5min":33.957999999999998,"15min":43.518000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":14.217000000000001,"5min":4.2910000000000004,"15min":2.282},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":181.27099999999999,"5min":181.27099999999999,"15min":181.27099999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":4.3620000000000001,"5min":2.4119999999999999,"15min":1.827},"min":{"1min":0.504,"5min":0.436,"15min":0.24099999999999999},"max":{"1min":41.810000000000002,"5min":41.810000000000002,"15min":46.984999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.7089999999999996,"5min":2.3239999999999998,"15min":1.788},"min":{"1min":0.53000000000000003,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":31.562000000000001,"5min":31.562000000000001,"15min":36.642000000000003},"last":0.433},{"interface":"front","average":{"1min":12.118,"5min":3.8759999999999999,"15min":2.5350000000000001},"min":{"1min":1.2010000000000001,"5min":0.48599999999999999,"15min":0.28799999999999998},"max":{"1min":94.373000000000005,"5min":94.373000000000005,"15min":94.373000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.656000000000001,"5min":4.141,"15min":3.3159999999999998},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":135.547,"5min":135.547,"15min":135.547},"last":0.55900000000000005},{"interface":"front","average":{"1min":10.077999999999999,"5min":3.8639999999999999,"15min":3.3370000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":131.07599999999999,"5min":131.07599999999999,"15min":131.07599999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.5460000000000003,"5min":2.9660000000000002,"15min":2.6829999999999998},"min":{"1min":1.1619999999999999,"5min":0.56699999999999995,"15min":0.38700000000000001},"max":{"1min":41.412999999999997,"5min":63.134999999999998,"15min":63.134999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":4.5469999999999997,"5min":3.2389999999999999,"15min":2.7890000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":42.020000000000003,"5min":63.185000000000002,"15min":63.185000000000002},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.8239999999999998,"15min":3.5699999999999998},"min":{"1min":0.95899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.548999999999999,"5min":105.974,"15min":203.92699999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":4.6369999999999996,"5min":4.0860000000000003,"15min":3.806},"min":{"1min":1.0529999999999999,"5min":0.627,"15min":0.42899999999999999},"max":{"1min":28.646000000000001,"5min":160.84700000000001,"15min":203.56899999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":9.5519999999999996,"5min":4.3310000000000004,"15min":3.0489999999999999},"min":{"1min":0.996,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":91.418000000000006,"5min":91.418000000000006,"15min":91.418000000000006},"last":0.66600000000000004},{"interface":"front","average":{"1min":5.2549999999999999,"5min":3.8029999999999999,"15min":3.0139999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":31.756,"5min":68.608000000000004,"15min":68.608000000000004},"last":0.68799999999999994}]}]},{"osd":7,"up_from":13,"seq":55834575063,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":684808,"kb_used_data":419008,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93687032,"statfs":{"total":96636764160,"available":95935520768,"internally_reserved":0,"allocated":429064192,"data_stored":575360508,"data_compressed":94465862,"data_compressed_allocated":110575616,"data_compressed_original":257064960,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.3539999999999992,"5min":5.5549999999999997,"15min":4.4649999999999999},"min":{"1min":0.58199999999999996,"5min":0.501,"15min":0.39300000000000002},"max":{"1min":69.191999999999993,"5min":221.768,"15min":221.768},"last":0.93999999999999995},{"interface":"front","average":{"1min":7.1609999999999996,"5min":4.2290000000000001,"15min":3.3039999999999998},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.40699999999999997},"max":{"1min":63.854999999999997,"5min":93.781000000000006,"15min":93.781000000000006},"last":1.329}]},{"osd":1,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.5009999999999994,"5min":5.7460000000000004,"15min":4.3810000000000002},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.374},"max":{"1min":69.061999999999998,"5min":221.715,"15min":221.715},"last":1.524},{"interface":"front","average":{"1min":7.3419999999999996,"5min":4.3179999999999996,"15min":3.3969999999999998},"min":{"1min":0.74399999999999999,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":67.930999999999997,"5min":93.825000000000003,"15min":93.825000000000003},"last":1.474}]},{"osd":2,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.0329999999999999,"15min":4.3170000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47999999999999998},"max":{"1min":21.026,"5min":27.303000000000001,"15min":189.01400000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":8.5289999999999999,"5min":5.7249999999999996,"15min":4.5910000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.48799999999999999},"max":{"1min":69.156999999999996,"5min":221.80600000000001,"15min":221.80600000000001},"last":0.79800000000000004}]},{"osd":3,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":6.9409999999999998,"5min":3.3420000000000001,"15min":4.4829999999999997},"min":{"1min":0.82799999999999996,"5min":0.747,"15min":0.57399999999999995},"max":{"1min":64.206000000000003,"5min":64.206000000000003,"15min":198.696},"last":1.1819999999999999},{"interface":"front","average":{"1min":8.4770000000000003,"5min":5.7590000000000003,"15min":5.3120000000000003},"min":{"1min":0.78400000000000003,"5min":0.66200000000000003,"15min":0.46100000000000002},"max":{"1min":69.585999999999999,"5min":221.846,"15min":221.846},"last":1.23}]},{"osd":4,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":7.4640000000000004,"5min":4.5199999999999996,"15min":5.0640000000000001},"min":{"1min":0.48199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":63.634,"5min":93.890000000000001,"15min":245.36000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":5.5899999999999999,"5min":3.3530000000000002,"15min":4.7130000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.443},"max":{"1min":43.292000000000002,"5min":56.325000000000003,"15min":190.40799999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.4879999999999995,"5min":6.4530000000000003,"15min":6.3959999999999999},"min":{"1min":0.46400000000000002,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":69.122,"5min":222.85499999999999,"15min":222.85499999999999},"last":1.363},{"interface":"front","average":{"1min":9.5709999999999997,"5min":5.2539999999999996,"15min":6.181},"min":{"1min":0.63400000000000001,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":83.078000000000003,"5min":93.858000000000004,"15min":215.16900000000001},"last":1.5760000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.6600000000000001,"5min":4.9820000000000002,"15min":4.9980000000000002},"min":{"1min":0.80400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":68.109999999999999,"5min":94.079999999999998,"15min":94.079999999999998},"last":1.6699999999999999},{"interface":"front","average":{"1min":8.0809999999999995,"5min":4.0359999999999996,"15min":5.0140000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":63.673000000000002,"5min":63.673000000000002,"15min":188.935},"last":1.4119999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24195072,"data_stored":104857656,"data_compressed":16682123,"data_compressed_allocated":20328448,"data_compressed_original":100999168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16805888,"data_stored":62914630,"data_compressed":9779731,"data_compressed_allocated":12054528,"data_compressed_original":58167296,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8126464,"data_stored":33555104,"data_compressed":5171825,"data_compressed_allocated":6344704,"data_compressed_original":31780864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26079232,"data_stored":100663878,"data_compressed":16005942,"data_compressed_allocated":19640320,"data_compressed_original":94228480,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17113088,"data_stored":62915904,"data_compressed":9796281,"data_compressed_allocated":12075008,"data_compressed_original":57892864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21094400,"data_stored":75407089,"data_compressed":12014001,"data_compressed_allocated":15126528,"data_compressed_original":69451776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20377600,"data_stored":75497472,"data_compressed":12342714,"data_compressed_allocated":15323136,"data_compressed_original":70443008,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":25548561,"data_compressed":3919906,"data_compressed_allocated":5070848,"data_compressed_original":23146496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344424448,"data_stored":466075648,"data_compressed":82422842,"data_compressed_allocated":97087488,"data_compressed_original":218738688,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":411574272,"data_stored":552431616,"data_compressed":97157127,"data_compressed_allocated":114876416,"data_compressed_original":255733760,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":316682240,"data_stored":453906432,"data_compressed":84827963,"data_compressed_allocated":101986304,"data_compressed_original":239210496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":315281408,"data_stored":427008000,"data_compressed":70412890,"data_compressed_allocated":84160512,"data_compressed_original":195887104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":366010368,"data_stored":501555200,"data_compressed":89630039,"data_compressed_allocated":107163648,"data_compressed_original":242708480,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":421490688,"data_stored":550686720,"data_compressed":90694832,"data_compressed_allocated":105689088,"data_compressed_original":234885120,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:24:23.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:24:23.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.679+0000 7fd99b59e640 1 Processor -- start 2023-11-18T19:24:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.682+0000 7fd99b59e640 1 -- start start 2023-11-18T19:24:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.684+0000 7fd99b59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 0x7fd99404ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.684+0000 7fd99b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd994047630 con 0x7fd99404b180 2023-11-18T19:24:23.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.684+0000 7fd99b59e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9940d65a0 con 0x7fd99400b0a0 2023-11-18T19:24:23.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.684+0000 7fd99b59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd994046550 con 0x7fd9940d3c10 2023-11-18T19:24:23.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.685+0000 7fd999d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd99404b180 0x7fd9940d6a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56224/0 (socket says 172.21.15.45:56224) 2023-11-18T19:24:23.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.685+0000 7fd999d9b640 1 -- 172.21.15.45:0/1480610213 learned_addr learned my addr 172.21.15.45:0/1480610213 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:23.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.686+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386606246 0 0) 0x7fd990001110 con 0x7fd99404b180 2023-11-18T19:24:23.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.686+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd984005730 con 0x7fd99404b180 2023-11-18T19:24:23.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.687+0000 7fd99a59c640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 0x7fd99404ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.689+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3577947738 0 0) 0x7fd984005730 con 0x7fd99404b180 2023-11-18T19:24:23.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 msgr2=0x7fd99404ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:23.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 0x7fd99404ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 >> v1:172.21.15.135:6789/0 conn(0x7fd99400b0a0 legacy=0x7fd9940e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940468a0 con 0x7fd99404b180 2023-11-18T19:24:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fd990001800 con 0x7fd99404b180 2023-11-18T19:24:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 >> v1:172.21.15.45:6789/0 conn(0x7fd99404b180 legacy=0x7fd9940d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 0x7fd984005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9840060f0 0x7fd9840069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.691+0000 7fd99959a640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984006f10 0x7fd984007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.692+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd994046550 con 0x7fd9840060f0 2023-11-18T19:24:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.692+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd984006820 con 0x7fd984006f10 2023-11-18T19:24:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.692+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd984007be0 con 0x7fd9940d3c10 2023-11-18T19:24:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.693+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984006f10 0x7fd984007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.695+0000 7fd999d9b640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9840060f0 0x7fd9840069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.695+0000 7fd99a59c640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 0x7fd984005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.696+0000 7fd99ad9d640 1 -- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 msgr2=0x7fd984005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:23.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.696+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9940d3c10 0x7fd984005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.696+0000 7fd99ad9d640 1 -- 172.21.15.45:0/1480610213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9840060f0 msgr2=0x7fd9840069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.697+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9840060f0 0x7fd9840069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.697+0000 7fd99ad9d640 1 -- 172.21.15.45:0/1480610213 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984005730 con 0x7fd984006f10 2023-11-18T19:24:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.697+0000 7fd999d9b640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9840060f0 0x7fd9840069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:24:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.702+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984006f10 0x7fd984007390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd99c04f5f0 tx=0x7fd984007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8f5f9d335f3ea7e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.708+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0a6aa0 con 0x7fd984006f10 2023-11-18T19:24:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.708+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c0a6c20 con 0x7fd984006f10 2023-11-18T19:24:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.708+0000 7fd99959a640 1 -- 172.21.15.45:0/1480610213 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0ae680 con 0x7fd984006f10 2023-11-18T19:24:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.709+0000 7fd99b59e640 1 -- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984006f10 msgr2=0x7fd984007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.709+0000 7fd99b59e640 1 --2- 172.21.15.45:0/1480610213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd984006f10 0x7fd984007390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd99c04f5f0 tx=0x7fd984007a00 comp rx=0 tx=0).stop 2023-11-18T19:24:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.709+0000 7fd99ad9d640 1 -- 172.21.15.45:0/1480610213 reap_dead start 2023-11-18T19:24:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.712+0000 7fd99b59e640 1 -- 172.21.15.45:0/1480610213 shutdown_connections 2023-11-18T19:24:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.712+0000 7fd99b59e640 1 -- 172.21.15.45:0/1480610213 >> 172.21.15.45:0/1480610213 conn(0x7fd994005e60 msgr2=0x7fd994006270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.712+0000 7fd99b59e640 1 -- 172.21.15.45:0/1480610213 shutdown_connections 2023-11-18T19:24:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.712+0000 7fd99b59e640 1 -- 172.21.15.45:0/1480610213 wait complete. 2023-11-18T19:24:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.721+0000 7fd99b59e640 1 Processor -- start 2023-11-18T19:24:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.721+0000 7fd99b59e640 1 -- start start 2023-11-18T19:24:23.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.727+0000 7fd99b59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd984006f10 0x7fd9940da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.729+0000 7fd99b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd994041630 0x7fd99402fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.731+0000 7fd99b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9940cfbb0 0x7fd9940d0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.731+0000 7fd99b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940445f0 con 0x7fd9940cfbb0 2023-11-18T19:24:23.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.731+0000 7fd99b59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940d7a10 con 0x7fd994041630 2023-11-18T19:24:23.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.731+0000 7fd99b59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd994043de0 con 0x7fd984006f10 2023-11-18T19:24:23.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.730+0000 7fd999d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd994041630 0x7fd99402fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.732+0000 7fd999d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd994041630 0x7fd99402fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:37954/0 (socket says 172.21.15.45:37954) 2023-11-18T19:24:23.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.733+0000 7fd999d9b640 1 -- 172.21.15.45:0/1085531181 learned_addr learned my addr 172.21.15.45:0/1085531181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:23.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.733+0000 7fd99a59c640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd984006f10 0x7fd9940da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.734+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9940cfbb0 0x7fd9940d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.738+0000 7fd99ad9d640 1 -- 172.21.15.45:0/1085531181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd984006f10 msgr2=0x7fd9940da0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:23.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.738+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd984006f10 0x7fd9940da0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.738+0000 7fd99ad9d640 1 -- 172.21.15.45:0/1085531181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd994041630 msgr2=0x7fd99402fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:23.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.738+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd994041630 0x7fd99402fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:23.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.738+0000 7fd99ad9d640 1 -- 172.21.15.45:0/1085531181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940da610 con 0x7fd9940cfbb0 2023-11-18T19:24:23.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.739+0000 7fd99ad9d640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9940cfbb0 0x7fd9940d0030 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd99c050140 tx=0x7fd99c04ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:23.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.740+0000 7fd98affd640 1 -- 172.21.15.45:0/1085531181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0ba450 con 0x7fd9940cfbb0 2023-11-18T19:24:23.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.740+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd994030b50 con 0x7fd9940cfbb0 2023-11-18T19:24:23.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.740+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd994044310 con 0x7fd9940cfbb0 2023-11-18T19:24:23.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.741+0000 7fd98affd640 1 -- 172.21.15.45:0/1085531181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c0ba5b0 con 0x7fd9940cfbb0 2023-11-18T19:24:23.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.741+0000 7fd98affd640 1 -- 172.21.15.45:0/1085531181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0ba920 con 0x7fd9940cfbb0 2023-11-18T19:24:23.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.744+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd980005250 con 0x7fd9940cfbb0 2023-11-18T19:24:23.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.747+0000 7fd98affd640 1 -- 172.21.15.45:0/1085531181 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd99c0baa80 con 0x7fd9940cfbb0 2023-11-18T19:24:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.749+0000 7fd98affd640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd97c06af10 0x7fd97c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.749+0000 7fd98affd640 1 -- 172.21.15.45:0/1085531181 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fd99c1251a0 con 0x7fd9940cfbb0 2023-11-18T19:24:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.750+0000 7fd99a59c640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd97c06af10 0x7fd97c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:23.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.754+0000 7fd99a59c640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd97c06af10 0x7fd97c06d3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009c10 tx=0x7fd98c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:23.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:23.757+0000 7fd98affd640 1 -- 172.21.15.45:0/1085531181 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd99c0f0020 con 0x7fd9940cfbb0 2023-11-18T19:24:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.142+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd980000bc0 con 0x7fd97c06af10 2023-11-18T19:24:24.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.161+0000 7fd98affd640 1 -- 172.21.15.45:0/1085531181 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372964 (secure 0 0 0) 0x7fd980000bc0 con 0x7fd97c06af10 2023-11-18T19:24:24.167 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:24:24.170 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:24:24.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd97c06af10 msgr2=0x7fd97c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd97c06af10 0x7fd97c06d3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009c10 tx=0x7fd98c009190 comp rx=0 tx=0).stop 2023-11-18T19:24:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9940cfbb0 msgr2=0x7fd9940d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9940cfbb0 0x7fd9940d0030 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd99c050140 tx=0x7fd99c04ef00 comp rx=0 tx=0).stop 2023-11-18T19:24:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 shutdown_connections 2023-11-18T19:24:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9940cfbb0 0x7fd9940d0030 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd994041630 0x7fd99402fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fd97c06af10 0x7fd97c06d3d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 --2- 172.21.15.45:0/1085531181 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd984006f10 0x7fd9940da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.177+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 >> 172.21.15.45:0/1085531181 conn(0x7fd994005e60 msgr2=0x7fd9940d53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:24.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.178+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 shutdown_connections 2023-11-18T19:24:24.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.178+0000 7fd99b59e640 1 -- 172.21.15.45:0/1085531181 wait complete. 2023-11-18T19:24:24.218 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2023-11-18T19:24:23.586059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1811035976,"num_objects":120430,"num_object_clones":0,"num_object_copies":385536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120430,"num_whiteouts":0,"num_read":995,"num_read_kb":1916,"num_write":260841,"num_write_kb":2418263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2811,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218519,"ondisk_log_size":218519,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4918936,"kb_used_data":2884312,"kb_used_omap":12,"kb_used_meta":2034547,"kb_avail":750055784,"statfs":{"total":773094113280,"available":768057122816,"internally_reserved":0,"allocated":2953535488,"data_stored":4366285182,"data_compressed":752587762,"data_compressed_allocated":899575808,"data_compressed_original":2313859072,"omap_allocated":12748,"internal_metadata":2083376692},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":94,"apply_latency_ms":94,"commit_latency_ns":94000000,"apply_latency_ns":94000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":271088583,"num_objects":1709,"num_object_clones":0,"num_object_copies":3860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1709,"num_whiteouts":0,"num_read":4,"num_read_kb":10,"num_write":4959,"num_write_kb":251798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004601"},"pg_stats":[{"pgid":"2.1f","version":"29'394","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.441071+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:24:17.441071+0000","last_peered":"2023-11-18T19:24:17.441071+0000","last_clean":"2023-11-18T19:24:17.441071+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:17.441071+0000","last_undegraded":"2023-11-18T19:24:17.441071+0000","last_fullsized":"2023-11-18T19:24:17.441071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":572,"num_write_kb":13668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'902","reported_seq":926,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.540603+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:24:17.540603+0000","last_peered":"2023-11-18T19:24:17.540603+0000","last_clean":"2023-11-18T19:24:17.540603+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:24:17.540603+0000","last_undegraded":"2023-11-18T19:24:17.540603+0000","last_fullsized":"2023-11-18T19:24:17.540603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":681,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4429","reported_seq":4452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.228185+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:24:18.228185+0000","last_peered":"2023-11-18T19:24:18.228185+0000","last_clean":"2023-11-18T19:24:18.228185+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:18.228185+0000","last_undegraded":"2023-11-18T19:24:18.228185+0000","last_fullsized":"2023-11-18T19:24:18.228185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4429,"log_dups_size":0,"ondisk_log_size":4429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47448745,"num_objects":2214,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5913,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'310","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.825011+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:24:16.825011+0000","last_peered":"2023-11-18T19:24:16.825011+0000","last_clean":"2023-11-18T19:24:16.825011+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:16.825011+0000","last_undegraded":"2023-11-18T19:24:16.825011+0000","last_fullsized":"2023-11-18T19:24:16.825011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":458,"num_write_kb":31029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'912","reported_seq":936,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.664966+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:24:18.664966+0000","last_peered":"2023-11-18T19:24:18.664966+0000","last_clean":"2023-11-18T19:24:18.664966+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:24:18.664966+0000","last_undegraded":"2023-11-18T19:24:18.664966+0000","last_fullsized":"2023-11-18T19:24:18.664966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4485","reported_seq":4509,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.211313+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:24:18.211313+0000","last_peered":"2023-11-18T19:24:18.211313+0000","last_clean":"2023-11-18T19:24:18.211313+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:18.211313+0000","last_undegraded":"2023-11-18T19:24:18.211313+0000","last_fullsized":"2023-11-18T19:24:18.211313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":0,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45442855,"num_objects":2273,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5975,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'501","reported_seq":525,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.756644+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:24:16.756644+0000","last_peered":"2023-11-18T19:24:16.756644+0000","last_clean":"2023-11-18T19:24:16.756644+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:16.756644+0000","last_undegraded":"2023-11-18T19:24:16.756644+0000","last_fullsized":"2023-11-18T19:24:16.756644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":681,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'961","reported_seq":984,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678110+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:24:18.678110+0000","last_peered":"2023-11-18T19:24:18.678110+0000","last_clean":"2023-11-18T19:24:18.678110+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:18.678110+0000","last_undegraded":"2023-11-18T19:24:18.678110+0000","last_fullsized":"2023-11-18T19:24:18.678110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4526","reported_seq":4548,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.452711+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:24:17.452711+0000","last_peered":"2023-11-18T19:24:17.452711+0000","last_clean":"2023-11-18T19:24:17.452711+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:24:17.452711+0000","last_undegraded":"2023-11-18T19:24:17.452711+0000","last_fullsized":"2023-11-18T19:24:17.452711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4526,"log_dups_size":0,"ondisk_log_size":4526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48597389,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6019,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:19.771442+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:24:19.771442+0000","last_peered":"2023-11-18T19:24:19.771442+0000","last_clean":"2023-11-18T19:24:19.771442+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:19.771442+0000","last_undegraded":"2023-11-18T19:24:19.771442+0000","last_fullsized":"2023-11-18T19:24:19.771442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":406,"num_write_kb":17263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":80,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'953","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.677474+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:24:18.677474+0000","last_peered":"2023-11-18T19:24:18.677474+0000","last_clean":"2023-11-18T19:24:18.677474+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:24:18.677474+0000","last_undegraded":"2023-11-18T19:24:18.677474+0000","last_fullsized":"2023-11-18T19:24:18.677474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4361","reported_seq":4384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.211402+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:24:18.211402+0000","last_peered":"2023-11-18T19:24:18.211402+0000","last_clean":"2023-11-18T19:24:18.211402+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:18.211402+0000","last_undegraded":"2023-11-18T19:24:18.211402+0000","last_fullsized":"2023-11-18T19:24:18.211402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4361,"log_dups_size":0,"ondisk_log_size":4361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44553589,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5746,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'935","reported_seq":960,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668247+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:24:18.668247+0000","last_peered":"2023-11-18T19:24:18.668247+0000","last_clean":"2023-11-18T19:24:18.668247+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:18.668247+0000","last_undegraded":"2023-11-18T19:24:18.668247+0000","last_fullsized":"2023-11-18T19:24:18.668247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'401","reported_seq":426,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.014033+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:24:17.014033+0000","last_peered":"2023-11-18T19:24:17.014033+0000","last_clean":"2023-11-18T19:24:17.014033+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:24:17.014033+0000","last_undegraded":"2023-11-18T19:24:17.014033+0000","last_fullsized":"2023-11-18T19:24:17.014033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":589,"num_write_kb":29794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4511","reported_seq":4533,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.423236+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:24:17.423236+0000","last_peered":"2023-11-18T19:24:17.423236+0000","last_clean":"2023-11-18T19:24:17.423236+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:17.423236+0000","last_undegraded":"2023-11-18T19:24:17.423236+0000","last_fullsized":"2023-11-18T19:24:17.423236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50701125,"num_objects":2305,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6011,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'963","reported_seq":986,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656931+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:24:18.656931+0000","last_peered":"2023-11-18T19:24:18.656931+0000","last_clean":"2023-11-18T19:24:18.656931+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:18.656931+0000","last_undegraded":"2023-11-18T19:24:18.656931+0000","last_fullsized":"2023-11-18T19:24:18.656931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'426","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.159723+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:24:17.159723+0000","last_peered":"2023-11-18T19:24:17.159723+0000","last_clean":"2023-11-18T19:24:17.159723+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:17.159723+0000","last_undegraded":"2023-11-18T19:24:17.159723+0000","last_fullsized":"2023-11-18T19:24:17.159723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":29973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4482","reported_seq":4504,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.286812+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:24:17.286812+0000","last_peered":"2023-11-18T19:24:17.286812+0000","last_clean":"2023-11-18T19:24:17.286812+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:24:17.286812+0000","last_undegraded":"2023-11-18T19:24:17.286812+0000","last_fullsized":"2023-11-18T19:24:17.286812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4482,"log_dups_size":0,"ondisk_log_size":4482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5947,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'1006","reported_seq":1031,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.653285+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:24:18.653285+0000","last_peered":"2023-11-18T19:24:18.653285+0000","last_clean":"2023-11-18T19:24:18.653285+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:18.653285+0000","last_undegraded":"2023-11-18T19:24:18.653285+0000","last_fullsized":"2023-11-18T19:24:18.653285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":763,"num_object_clones":0,"num_object_copies":1526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'418","reported_seq":444,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.608296+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:24:17.608296+0000","last_peered":"2023-11-18T19:24:17.608296+0000","last_clean":"2023-11-18T19:24:17.608296+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:24:17.608296+0000","last_undegraded":"2023-11-18T19:24:17.608296+0000","last_fullsized":"2023-11-18T19:24:17.608296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":102,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":17433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":100,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4506","reported_seq":4528,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.359027+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:24:17.359027+0000","last_peered":"2023-11-18T19:24:17.359027+0000","last_clean":"2023-11-18T19:24:17.359027+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:24:17.359027+0000","last_undegraded":"2023-11-18T19:24:17.359027+0000","last_fullsized":"2023-11-18T19:24:17.359027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6027,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'937","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.671091+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:24:18.671091+0000","last_peered":"2023-11-18T19:24:18.671091+0000","last_clean":"2023-11-18T19:24:18.671091+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:24:18.671091+0000","last_undegraded":"2023-11-18T19:24:18.671091+0000","last_fullsized":"2023-11-18T19:24:18.671091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":681,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'456","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.589972+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:24:16.589972+0000","last_peered":"2023-11-18T19:24:16.589972+0000","last_clean":"2023-11-18T19:24:16.589972+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:16.589972+0000","last_undegraded":"2023-11-18T19:24:16.589972+0000","last_fullsized":"2023-11-18T19:24:16.589972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":13018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4450","reported_seq":4472,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.212131+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:24:18.212131+0000","last_peered":"2023-11-18T19:24:18.212131+0000","last_clean":"2023-11-18T19:24:18.212131+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:24:18.212131+0000","last_undegraded":"2023-11-18T19:24:18.212131+0000","last_fullsized":"2023-11-18T19:24:18.212131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53723490,"num_objects":2311,"num_object_clones":0,"num_object_copies":9244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5935,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'928","reported_seq":953,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.637353+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:24:18.637353+0000","last_peered":"2023-11-18T19:24:18.637353+0000","last_clean":"2023-11-18T19:24:18.637353+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:18.637353+0000","last_undegraded":"2023-11-18T19:24:18.637353+0000","last_fullsized":"2023-11-18T19:24:18.637353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":714,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'282","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.930334+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:24:16.930334+0000","last_peered":"2023-11-18T19:24:16.930334+0000","last_clean":"2023-11-18T19:24:16.930334+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:24:16.930334+0000","last_undegraded":"2023-11-18T19:24:16.930334+0000","last_fullsized":"2023-11-18T19:24:16.930334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":445,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4486","reported_seq":4509,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.191198+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:24:18.191198+0000","last_peered":"2023-11-18T19:24:18.191198+0000","last_clean":"2023-11-18T19:24:18.191198+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:18.191198+0000","last_undegraded":"2023-11-18T19:24:18.191198+0000","last_fullsized":"2023-11-18T19:24:18.191198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58452634,"num_objects":2264,"num_object_clones":0,"num_object_copies":9056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5975,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'899","reported_seq":924,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.657490+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:24:18.657490+0000","last_peered":"2023-11-18T19:24:18.657490+0000","last_clean":"2023-11-18T19:24:18.657490+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:18.657490+0000","last_undegraded":"2023-11-18T19:24:18.657490+0000","last_fullsized":"2023-11-18T19:24:18.657490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":673,"num_object_clones":0,"num_object_copies":1346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'523","reported_seq":549,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:20.290597+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:24:20.290597+0000","last_peered":"2023-11-18T19:24:20.290597+0000","last_clean":"2023-11-18T19:24:20.290597+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:20.290597+0000","last_undegraded":"2023-11-18T19:24:20.290597+0000","last_fullsized":"2023-11-18T19:24:20.290597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1034,"num_write_kb":20768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4478","reported_seq":4501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.817787+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:24:17.817787+0000","last_peered":"2023-11-18T19:24:17.817787+0000","last_clean":"2023-11-18T19:24:17.817787+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:24:17.817787+0000","last_undegraded":"2023-11-18T19:24:17.817787+0000","last_fullsized":"2023-11-18T19:24:17.817787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4478,"log_dups_size":0,"ondisk_log_size":4478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41932084,"num_objects":2267,"num_object_clones":0,"num_object_copies":9068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5962,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'926","reported_seq":951,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.658697+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:24:18.658697+0000","last_peered":"2023-11-18T19:24:18.658697+0000","last_clean":"2023-11-18T19:24:18.658697+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:18.658697+0000","last_undegraded":"2023-11-18T19:24:18.658697+0000","last_fullsized":"2023-11-18T19:24:18.658697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'290","reported_seq":316,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.245000+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:24:16.245000+0000","last_peered":"2023-11-18T19:24:16.245000+0000","last_clean":"2023-11-18T19:24:16.245000+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:24:16.245000+0000","last_undegraded":"2023-11-18T19:24:16.245000+0000","last_fullsized":"2023-11-18T19:24:16.245000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":21523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4524","reported_seq":4547,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.151065+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:24:18.151065+0000","last_peered":"2023-11-18T19:24:18.151065+0000","last_clean":"2023-11-18T19:24:18.151065+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:24:18.151065+0000","last_undegraded":"2023-11-18T19:24:18.151065+0000","last_fullsized":"2023-11-18T19:24:18.151065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41011562,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6009,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'901","reported_seq":925,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.660928+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:24:18.660928+0000","last_peered":"2023-11-18T19:24:18.660928+0000","last_clean":"2023-11-18T19:24:18.660928+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:18.660928+0000","last_undegraded":"2023-11-18T19:24:18.660928+0000","last_fullsized":"2023-11-18T19:24:18.660928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":685,"num_object_clones":0,"num_object_copies":1370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'461","reported_seq":486,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.158176+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:24:17.158176+0000","last_peered":"2023-11-18T19:24:17.158176+0000","last_clean":"2023-11-18T19:24:17.158176+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:17.158176+0000","last_undegraded":"2023-11-18T19:24:17.158176+0000","last_fullsized":"2023-11-18T19:24:17.158176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":17286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":72,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4455","reported_seq":4478,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.881164+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:24:17.881164+0000","last_peered":"2023-11-18T19:24:17.881164+0000","last_clean":"2023-11-18T19:24:17.881164+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:24:17.881164+0000","last_undegraded":"2023-11-18T19:24:17.881164+0000","last_fullsized":"2023-11-18T19:24:17.881164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4455,"log_dups_size":0,"ondisk_log_size":4455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47540604,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5953,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'938","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674306+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:24:18.674306+0000","last_peered":"2023-11-18T19:24:18.674306+0000","last_clean":"2023-11-18T19:24:18.674306+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:18.674306+0000","last_undegraded":"2023-11-18T19:24:18.674306+0000","last_fullsized":"2023-11-18T19:24:18.674306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1168","reported_seq":1194,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.910696+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:24:16.910696+0000","last_peered":"2023-11-18T19:24:16.910696+0000","last_clean":"2023-11-18T19:24:16.910696+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:24:16.910696+0000","last_undegraded":"2023-11-18T19:24:16.910696+0000","last_fullsized":"2023-11-18T19:24:16.910696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1168,"log_dups_size":0,"ondisk_log_size":1168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":46630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4463","reported_seq":4489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.226725+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:24:18.226725+0000","last_peered":"2023-11-18T19:24:18.226725+0000","last_clean":"2023-11-18T19:24:18.226725+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:24:18.226725+0000","last_undegraded":"2023-11-18T19:24:18.226725+0000","last_fullsized":"2023-11-18T19:24:18.226725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39429542,"num_objects":2302,"num_object_clones":0,"num_object_copies":9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5965,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'934","reported_seq":958,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.643656+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:24:18.643656+0000","last_peered":"2023-11-18T19:24:18.643656+0000","last_clean":"2023-11-18T19:24:18.643656+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:18.643656+0000","last_undegraded":"2023-11-18T19:24:18.643656+0000","last_fullsized":"2023-11-18T19:24:18.643656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":724,"num_object_clones":0,"num_object_copies":1448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1376","reported_seq":2237,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.604572+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:24:18.604572+0000","last_peered":"2023-11-18T19:24:18.604572+0000","last_clean":"2023-11-18T19:24:18.604572+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:18.604572+0000","last_undegraded":"2023-11-18T19:24:18.604572+0000","last_fullsized":"2023-11-18T19:24:18.604572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1376,"log_dups_size":0,"ondisk_log_size":1376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9652249,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":836,"num_read_kb":1816,"num_write":1557,"num_write_kb":23339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4389","reported_seq":4413,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.185051+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:24:18.185051+0000","last_peered":"2023-11-18T19:24:18.185051+0000","last_clean":"2023-11-18T19:24:18.185051+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:24:18.185051+0000","last_undegraded":"2023-11-18T19:24:18.185051+0000","last_fullsized":"2023-11-18T19:24:18.185051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4389,"log_dups_size":0,"ondisk_log_size":4389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52629501,"num_objects":2217,"num_object_clones":0,"num_object_copies":8868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5791,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'883","reported_seq":908,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.662620+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:24:18.662620+0000","last_peered":"2023-11-18T19:24:18.662620+0000","last_clean":"2023-11-18T19:24:18.662620+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:18.662620+0000","last_undegraded":"2023-11-18T19:24:18.662620+0000","last_fullsized":"2023-11-18T19:24:18.662620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":684,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'475","reported_seq":501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.840415+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:24:16.840415+0000","last_peered":"2023-11-18T19:24:16.840415+0000","last_clean":"2023-11-18T19:24:16.840415+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:24:16.840415+0000","last_undegraded":"2023-11-18T19:24:16.840415+0000","last_fullsized":"2023-11-18T19:24:16.840415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":29626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":84,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4557","reported_seq":4580,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.592298+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:24:17.592298+0000","last_peered":"2023-11-18T19:24:17.592298+0000","last_clean":"2023-11-18T19:24:17.592298+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:24:17.592298+0000","last_undegraded":"2023-11-18T19:24:17.592298+0000","last_fullsized":"2023-11-18T19:24:17.592298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4557,"log_dups_size":0,"ondisk_log_size":4557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43888851,"num_objects":2286,"num_object_clones":0,"num_object_copies":9144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6057,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'939","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.665073+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:24:18.665073+0000","last_peered":"2023-11-18T19:24:18.665073+0000","last_clean":"2023-11-18T19:24:18.665073+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:18.665073+0000","last_undegraded":"2023-11-18T19:24:18.665073+0000","last_fullsized":"2023-11-18T19:24:18.665073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":727,"num_object_clones":0,"num_object_copies":1454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'395","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.465313+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:24:16.465313+0000","last_peered":"2023-11-18T19:24:16.465313+0000","last_clean":"2023-11-18T19:24:16.465313+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:24:16.465313+0000","last_undegraded":"2023-11-18T19:24:16.465313+0000","last_fullsized":"2023-11-18T19:24:16.465313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":17537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:20:35.780144+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:20:35.780144+0000","last_peered":"2023-11-18T19:20:35.780144+0000","last_clean":"2023-11-18T19:20:35.780144+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:20:35.780144+0000","last_undegraded":"2023-11-18T19:20:35.780144+0000","last_fullsized":"2023-11-18T19:20:35.780144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:24:48.318265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4382","reported_seq":4405,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.285278+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:24:17.285278+0000","last_peered":"2023-11-18T19:24:17.285278+0000","last_clean":"2023-11-18T19:24:17.285278+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:24:17.285278+0000","last_undegraded":"2023-11-18T19:24:17.285278+0000","last_fullsized":"2023-11-18T19:24:17.285278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4382,"log_dups_size":0,"ondisk_log_size":4382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47903098,"num_objects":2231,"num_object_clones":0,"num_object_copies":8924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5818,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'928","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668320+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:24:18.668320+0000","last_peered":"2023-11-18T19:24:18.668320+0000","last_clean":"2023-11-18T19:24:18.668320+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:24:18.668320+0000","last_undegraded":"2023-11-18T19:24:18.668320+0000","last_fullsized":"2023-11-18T19:24:18.668320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'449","reported_seq":474,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.852043+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:24:17.852043+0000","last_peered":"2023-11-18T19:24:17.852043+0000","last_clean":"2023-11-18T19:24:17.852043+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:24:17.852043+0000","last_undegraded":"2023-11-18T19:24:17.852043+0000","last_fullsized":"2023-11-18T19:24:17.852043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":630,"num_write_kb":29777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4528","reported_seq":4551,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.183204+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:24:18.183204+0000","last_peered":"2023-11-18T19:24:18.183204+0000","last_clean":"2023-11-18T19:24:18.183204+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:24:18.183204+0000","last_undegraded":"2023-11-18T19:24:18.183204+0000","last_fullsized":"2023-11-18T19:24:18.183204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54570935,"num_objects":2278,"num_object_clones":0,"num_object_copies":9112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5986,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'912","reported_seq":935,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.683557+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:24:18.683557+0000","last_peered":"2023-11-18T19:24:18.683557+0000","last_clean":"2023-11-18T19:24:18.683557+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:18.683557+0000","last_undegraded":"2023-11-18T19:24:18.683557+0000","last_fullsized":"2023-11-18T19:24:18.683557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":677,"num_object_clones":0,"num_object_copies":1354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":735,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'882","reported_seq":906,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.495810+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:24:17.495810+0000","last_peered":"2023-11-18T19:24:17.495810+0000","last_clean":"2023-11-18T19:24:17.495810+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:24:17.495810+0000","last_undegraded":"2023-11-18T19:24:17.495810+0000","last_fullsized":"2023-11-18T19:24:17.495810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":34274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4569","reported_seq":4592,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.188274+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:24:18.188274+0000","last_peered":"2023-11-18T19:24:18.188274+0000","last_clean":"2023-11-18T19:24:18.188274+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:24:18.188274+0000","last_undegraded":"2023-11-18T19:24:18.188274+0000","last_fullsized":"2023-11-18T19:24:18.188274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4569,"log_dups_size":0,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46904542,"num_objects":2317,"num_object_clones":0,"num_object_copies":9268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2317,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6069,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'923","reported_seq":946,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.681245+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:24:18.681245+0000","last_peered":"2023-11-18T19:24:18.681245+0000","last_clean":"2023-11-18T19:24:18.681245+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:24:18.681245+0000","last_undegraded":"2023-11-18T19:24:18.681245+0000","last_fullsized":"2023-11-18T19:24:18.681245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'581","reported_seq":606,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.078076+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:24:17.078076+0000","last_peered":"2023-11-18T19:24:17.078076+0000","last_clean":"2023-11-18T19:24:17.078076+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:17.078076+0000","last_undegraded":"2023-11-18T19:24:17.078076+0000","last_fullsized":"2023-11-18T19:24:17.078076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":727,"num_write_kb":21480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":76,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4687","reported_seq":4712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.329251+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:24:17.329251+0000","last_peered":"2023-11-18T19:24:17.329251+0000","last_clean":"2023-11-18T19:24:17.329251+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:24:17.329251+0000","last_undegraded":"2023-11-18T19:24:17.329251+0000","last_fullsized":"2023-11-18T19:24:17.329251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4687,"log_dups_size":0,"ondisk_log_size":4687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53454220,"num_objects":2315,"num_object_clones":0,"num_object_copies":9260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2315,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6231,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'933","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.680285+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:24:18.680285+0000","last_peered":"2023-11-18T19:24:18.680285+0000","last_clean":"2023-11-18T19:24:18.680285+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:18.680285+0000","last_undegraded":"2023-11-18T19:24:18.680285+0000","last_fullsized":"2023-11-18T19:24:18.680285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'289","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.527795+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:24:16.527795+0000","last_peered":"2023-11-18T19:24:16.527795+0000","last_clean":"2023-11-18T19:24:16.527795+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:16.527795+0000","last_undegraded":"2023-11-18T19:24:16.527795+0000","last_fullsized":"2023-11-18T19:24:16.527795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":439,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4440","reported_seq":4465,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.166110+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:24:18.166110+0000","last_peered":"2023-11-18T19:24:18.166110+0000","last_clean":"2023-11-18T19:24:18.166110+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:18.166110+0000","last_undegraded":"2023-11-18T19:24:18.166110+0000","last_fullsized":"2023-11-18T19:24:18.166110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:03.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5875,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'974","reported_seq":998,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.672213+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:24:18.672213+0000","last_peered":"2023-11-18T19:24:18.672213+0000","last_clean":"2023-11-18T19:24:18.672213+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:18.672213+0000","last_undegraded":"2023-11-18T19:24:18.672213+0000","last_fullsized":"2023-11-18T19:24:18.672213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'351","reported_seq":376,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.963933+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:24:16.963933+0000","last_peered":"2023-11-18T19:24:16.963933+0000","last_clean":"2023-11-18T19:24:16.963933+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:16.963933+0000","last_undegraded":"2023-11-18T19:24:16.963933+0000","last_fullsized":"2023-11-18T19:24:16.963933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":555,"num_write_kb":13205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4401","reported_seq":4432,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.202893+0000","last_change":"2023-11-18T19:07:25.182659+0000","last_active":"2023-11-18T19:24:18.202893+0000","last_peered":"2023-11-18T19:24:18.202893+0000","last_clean":"2023-11-18T19:24:18.202893+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:24:18.202893+0000","last_undegraded":"2023-11-18T19:24:18.202893+0000","last_fullsized":"2023-11-18T19:24:18.202893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40895696,"num_objects":2243,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5822,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'917","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.150031+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:24:18.150031+0000","last_peered":"2023-11-18T19:24:18.150031+0000","last_clean":"2023-11-18T19:24:18.150031+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:18.150031+0000","last_undegraded":"2023-11-18T19:24:18.150031+0000","last_fullsized":"2023-11-18T19:24:18.150031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'268","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.413179+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:24:16.413179+0000","last_peered":"2023-11-18T19:24:16.413179+0000","last_clean":"2023-11-18T19:24:16.413179+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:16.413179+0000","last_undegraded":"2023-11-18T19:24:16.413179+0000","last_fullsized":"2023-11-18T19:24:16.413179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":457,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4553","reported_seq":4575,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.202932+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:24:18.202932+0000","last_peered":"2023-11-18T19:24:18.202932+0000","last_clean":"2023-11-18T19:24:18.202932+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:24:18.202932+0000","last_undegraded":"2023-11-18T19:24:18.202932+0000","last_fullsized":"2023-11-18T19:24:18.202932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4553,"log_dups_size":0,"ondisk_log_size":4553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39856077,"num_objects":2313,"num_object_clones":0,"num_object_copies":9252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6058,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'926","reported_seq":957,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.639637+0000","last_change":"2023-11-18T19:07:25.179515+0000","last_active":"2023-11-18T19:24:18.639637+0000","last_peered":"2023-11-18T19:24:18.639637+0000","last_clean":"2023-11-18T19:24:18.639637+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:18.639637+0000","last_undegraded":"2023-11-18T19:24:18.639637+0000","last_fullsized":"2023-11-18T19:24:18.639637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:56.657976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":713,"num_object_clones":0,"num_object_copies":1426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'418","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.466544+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:24:16.466544+0000","last_peered":"2023-11-18T19:24:16.466544+0000","last_clean":"2023-11-18T19:24:16.466544+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:24:16.466544+0000","last_undegraded":"2023-11-18T19:24:16.466544+0000","last_fullsized":"2023-11-18T19:24:16.466544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":638,"num_write_kb":5589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":111,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4341","reported_seq":4363,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.230685+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:24:18.230685+0000","last_peered":"2023-11-18T19:24:18.230685+0000","last_clean":"2023-11-18T19:24:18.230685+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:24:18.230685+0000","last_undegraded":"2023-11-18T19:24:18.230685+0000","last_fullsized":"2023-11-18T19:24:18.230685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4341,"log_dups_size":0,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54095014,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5784,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'881","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.662992+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:24:18.662992+0000","last_peered":"2023-11-18T19:24:18.662992+0000","last_clean":"2023-11-18T19:24:18.662992+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:18.662992+0000","last_undegraded":"2023-11-18T19:24:18.662992+0000","last_fullsized":"2023-11-18T19:24:18.662992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":676,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'363","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.816745+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:24:16.816745+0000","last_peered":"2023-11-18T19:24:16.816745+0000","last_clean":"2023-11-18T19:24:16.816745+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:16.816745+0000","last_undegraded":"2023-11-18T19:24:16.816745+0000","last_fullsized":"2023-11-18T19:24:16.816745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":563,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4331","reported_seq":4353,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.152919+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:24:18.152919+0000","last_peered":"2023-11-18T19:24:18.152919+0000","last_clean":"2023-11-18T19:24:18.152919+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:24:18.152919+0000","last_undegraded":"2023-11-18T19:24:18.152919+0000","last_fullsized":"2023-11-18T19:24:18.152919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":0,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46166125,"num_objects":2199,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5801,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'898","reported_seq":921,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.682351+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:24:18.682351+0000","last_peered":"2023-11-18T19:24:18.682351+0000","last_clean":"2023-11-18T19:24:18.682351+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:18.682351+0000","last_undegraded":"2023-11-18T19:24:18.682351+0000","last_fullsized":"2023-11-18T19:24:18.682351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":687,"num_object_clones":0,"num_object_copies":1374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'589","reported_seq":613,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.900589+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:24:16.900589+0000","last_peered":"2023-11-18T19:24:16.900589+0000","last_clean":"2023-11-18T19:24:16.900589+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:16.900589+0000","last_undegraded":"2023-11-18T19:24:16.900589+0000","last_fullsized":"2023-11-18T19:24:16.900589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":789,"num_write_kb":29986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4332","reported_seq":4354,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.167860+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:24:18.167860+0000","last_peered":"2023-11-18T19:24:18.167860+0000","last_clean":"2023-11-18T19:24:18.167860+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:24:18.167860+0000","last_undegraded":"2023-11-18T19:24:18.167860+0000","last_fullsized":"2023-11-18T19:24:18.167860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53099612,"num_objects":2240,"num_object_clones":0,"num_object_copies":8960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5730,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'909","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668923+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:24:18.668923+0000","last_peered":"2023-11-18T19:24:18.668923+0000","last_clean":"2023-11-18T19:24:18.668923+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:18.668923+0000","last_undegraded":"2023-11-18T19:24:18.668923+0000","last_fullsized":"2023-11-18T19:24:18.668923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'758","reported_seq":782,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.966795+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:24:17.966795+0000","last_peered":"2023-11-18T19:24:17.966795+0000","last_clean":"2023-11-18T19:24:17.966795+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:17.966795+0000","last_undegraded":"2023-11-18T19:24:17.966795+0000","last_fullsized":"2023-11-18T19:24:17.966795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":946,"num_write_kb":22041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":97,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4430","reported_seq":4452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.211353+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:24:18.211353+0000","last_peered":"2023-11-18T19:24:18.211353+0000","last_clean":"2023-11-18T19:24:18.211353+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:18.211353+0000","last_undegraded":"2023-11-18T19:24:18.211353+0000","last_fullsized":"2023-11-18T19:24:18.211353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879149,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5939,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'926","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.650913+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:24:18.650913+0000","last_peered":"2023-11-18T19:24:18.650913+0000","last_clean":"2023-11-18T19:24:18.650913+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:18.650913+0000","last_undegraded":"2023-11-18T19:24:18.650913+0000","last_fullsized":"2023-11-18T19:24:18.650913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'360","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.592044+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:24:16.592044+0000","last_peered":"2023-11-18T19:24:16.592044+0000","last_clean":"2023-11-18T19:24:16.592044+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:24:16.592044+0000","last_undegraded":"2023-11-18T19:24:16.592044+0000","last_fullsized":"2023-11-18T19:24:16.592044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":532,"num_write_kb":25814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4341","reported_seq":4364,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.391367+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:24:17.391367+0000","last_peered":"2023-11-18T19:24:17.391367+0000","last_clean":"2023-11-18T19:24:17.391367+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:17.391367+0000","last_undegraded":"2023-11-18T19:24:17.391367+0000","last_fullsized":"2023-11-18T19:24:17.391367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4341,"log_dups_size":0,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66632640,"num_objects":2174,"num_object_clones":0,"num_object_copies":8696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5756,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'914","reported_seq":937,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674590+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:24:18.674590+0000","last_peered":"2023-11-18T19:24:18.674590+0000","last_clean":"2023-11-18T19:24:18.674590+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:18.674590+0000","last_undegraded":"2023-11-18T19:24:18.674590+0000","last_fullsized":"2023-11-18T19:24:18.674590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":914,"log_dups_size":0,"ondisk_log_size":914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":677,"num_object_clones":0,"num_object_copies":1354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":741,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1205","reported_seq":1229,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.350366+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:24:17.350366+0000","last_peered":"2023-11-18T19:24:17.350366+0000","last_clean":"2023-11-18T19:24:17.350366+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:17.350366+0000","last_undegraded":"2023-11-18T19:24:17.350366+0000","last_fullsized":"2023-11-18T19:24:17.350366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:08.678189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1356,"num_write_kb":21994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4581","reported_seq":4612,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.760373+0000","last_change":"2023-11-18T19:07:25.179857+0000","last_active":"2023-11-18T19:24:17.760373+0000","last_peered":"2023-11-18T19:24:17.760373+0000","last_clean":"2023-11-18T19:24:17.760373+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:24:17.760373+0000","last_undegraded":"2023-11-18T19:24:17.760373+0000","last_fullsized":"2023-11-18T19:24:17.760373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4581,"log_dups_size":0,"ondisk_log_size":4581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111025,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6106,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4330","reported_seq":4354,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.474658+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:24:17.474658+0000","last_peered":"2023-11-18T19:24:17.474658+0000","last_clean":"2023-11-18T19:24:17.474658+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:24:17.474658+0000","last_undegraded":"2023-11-18T19:24:17.474658+0000","last_fullsized":"2023-11-18T19:24:17.474658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4330,"log_dups_size":0,"ondisk_log_size":4330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32576492,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5728,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'928","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.218048+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:24:18.218048+0000","last_peered":"2023-11-18T19:24:18.218048+0000","last_clean":"2023-11-18T19:24:18.218048+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:18.218048+0000","last_undegraded":"2023-11-18T19:24:18.218048+0000","last_fullsized":"2023-11-18T19:24:18.218048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":711,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'518","reported_seq":543,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.918781+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:24:16.918781+0000","last_peered":"2023-11-18T19:24:16.918781+0000","last_clean":"2023-11-18T19:24:16.918781+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:24:16.918781+0000","last_undegraded":"2023-11-18T19:24:16.918781+0000","last_fullsized":"2023-11-18T19:24:16.918781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":685,"num_write_kb":37722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4318","reported_seq":4341,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.222818+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:24:17.222818+0000","last_peered":"2023-11-18T19:24:17.222818+0000","last_clean":"2023-11-18T19:24:17.222818+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:24:17.222818+0000","last_undegraded":"2023-11-18T19:24:17.222818+0000","last_fullsized":"2023-11-18T19:24:17.222818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4318,"log_dups_size":0,"ondisk_log_size":4318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48972751,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5731,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'988","reported_seq":1011,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.657158+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:24:18.657158+0000","last_peered":"2023-11-18T19:24:18.657158+0000","last_clean":"2023-11-18T19:24:18.657158+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:18.657158+0000","last_undegraded":"2023-11-18T19:24:18.657158+0000","last_fullsized":"2023-11-18T19:24:18.657158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":793,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'301","reported_seq":326,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.531564+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:24:17.531564+0000","last_peered":"2023-11-18T19:24:17.531564+0000","last_clean":"2023-11-18T19:24:17.531564+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:17.531564+0000","last_undegraded":"2023-11-18T19:24:17.531564+0000","last_fullsized":"2023-11-18T19:24:17.531564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'663","reported_seq":688,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:23:56.458428+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:23:56.458428+0000","last_peered":"2023-11-18T19:23:56.458428+0000","last_clean":"2023-11-18T19:23:56.458428+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:23:56.458428+0000","last_undegraded":"2023-11-18T19:23:56.458428+0000","last_fullsized":"2023-11-18T19:23:56.458428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":33791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'925","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.676895+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:24:18.676895+0000","last_peered":"2023-11-18T19:24:18.676895+0000","last_clean":"2023-11-18T19:24:18.676895+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:18.676895+0000","last_undegraded":"2023-11-18T19:24:18.676895+0000","last_fullsized":"2023-11-18T19:24:18.676895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4528","reported_seq":4550,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.232806+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:24:18.232806+0000","last_peered":"2023-11-18T19:24:18.232806+0000","last_clean":"2023-11-18T19:24:18.232806+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:24:18.232806+0000","last_undegraded":"2023-11-18T19:24:18.232806+0000","last_fullsized":"2023-11-18T19:24:18.232806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50816520,"num_objects":2330,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6037,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'243","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.574935+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:24:17.574935+0000","last_peered":"2023-11-18T19:24:17.574935+0000","last_clean":"2023-11-18T19:24:17.574935+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:24:17.574935+0000","last_undegraded":"2023-11-18T19:24:17.574935+0000","last_fullsized":"2023-11-18T19:24:17.574935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":17256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":82,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'924","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.660411+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:24:18.660411+0000","last_peered":"2023-11-18T19:24:18.660411+0000","last_clean":"2023-11-18T19:24:18.660411+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:18.660411+0000","last_undegraded":"2023-11-18T19:24:18.660411+0000","last_fullsized":"2023-11-18T19:24:18.660411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4556","reported_seq":4578,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.162952+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:24:18.162952+0000","last_peered":"2023-11-18T19:24:18.162952+0000","last_clean":"2023-11-18T19:24:18.162952+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:24:18.162952+0000","last_undegraded":"2023-11-18T19:24:18.162952+0000","last_fullsized":"2023-11-18T19:24:18.162952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38511782,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6085,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'942","reported_seq":966,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.659248+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:24:18.659248+0000","last_peered":"2023-11-18T19:24:18.659248+0000","last_clean":"2023-11-18T19:24:18.659248+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:18.659248+0000","last_undegraded":"2023-11-18T19:24:18.659248+0000","last_fullsized":"2023-11-18T19:24:18.659248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":707,"num_object_clones":0,"num_object_copies":1414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":707,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'983","reported_seq":1007,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.652053+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:24:18.652053+0000","last_peered":"2023-11-18T19:24:18.652053+0000","last_clean":"2023-11-18T19:24:18.652053+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:18.652053+0000","last_undegraded":"2023-11-18T19:24:18.652053+0000","last_fullsized":"2023-11-18T19:24:18.652053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'931","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656415+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:24:18.656415+0000","last_peered":"2023-11-18T19:24:18.656415+0000","last_clean":"2023-11-18T19:24:18.656415+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:18.656415+0000","last_undegraded":"2023-11-18T19:24:18.656415+0000","last_fullsized":"2023-11-18T19:24:18.656415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":696,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'948","reported_seq":972,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.647998+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:24:18.647998+0000","last_peered":"2023-11-18T19:24:18.647998+0000","last_clean":"2023-11-18T19:24:18.647998+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:18.647998+0000","last_undegraded":"2023-11-18T19:24:18.647998+0000","last_fullsized":"2023-11-18T19:24:18.647998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'927","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.680319+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:24:18.680319+0000","last_peered":"2023-11-18T19:24:18.680319+0000","last_clean":"2023-11-18T19:24:18.680319+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:24:18.680319+0000","last_undegraded":"2023-11-18T19:24:18.680319+0000","last_fullsized":"2023-11-18T19:24:18.680319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":722,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'914","reported_seq":939,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.655077+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:24:18.655077+0000","last_peered":"2023-11-18T19:24:18.655077+0000","last_clean":"2023-11-18T19:24:18.655077+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:24:18.655077+0000","last_undegraded":"2023-11-18T19:24:18.655077+0000","last_fullsized":"2023-11-18T19:24:18.655077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":914,"log_dups_size":0,"ondisk_log_size":914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'978","reported_seq":1002,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.673713+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:24:18.673713+0000","last_peered":"2023-11-18T19:24:18.673713+0000","last_clean":"2023-11-18T19:24:18.673713+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:18.673713+0000","last_undegraded":"2023-11-18T19:24:18.673713+0000","last_fullsized":"2023-11-18T19:24:18.673713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":790,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'911","reported_seq":935,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.666221+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:24:18.666221+0000","last_peered":"2023-11-18T19:24:18.666221+0000","last_clean":"2023-11-18T19:24:18.666221+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:24:18.666221+0000","last_undegraded":"2023-11-18T19:24:18.666221+0000","last_fullsized":"2023-11-18T19:24:18.666221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":670,"num_object_clones":0,"num_object_copies":1340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'936","reported_seq":961,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.652337+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:24:18.652337+0000","last_peered":"2023-11-18T19:24:18.652337+0000","last_clean":"2023-11-18T19:24:18.652337+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:18.652337+0000","last_undegraded":"2023-11-18T19:24:18.652337+0000","last_fullsized":"2023-11-18T19:24:18.652337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":700,"num_object_clones":0,"num_object_copies":1400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":700,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'895","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.165722+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:24:18.165722+0000","last_peered":"2023-11-18T19:24:18.165722+0000","last_clean":"2023-11-18T19:24:18.165722+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:18.165722+0000","last_undegraded":"2023-11-18T19:24:18.165722+0000","last_fullsized":"2023-11-18T19:24:18.165722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'933","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678232+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:24:18.678232+0000","last_peered":"2023-11-18T19:24:18.678232+0000","last_clean":"2023-11-18T19:24:18.678232+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:18.678232+0000","last_undegraded":"2023-11-18T19:24:18.678232+0000","last_fullsized":"2023-11-18T19:24:18.678232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":703,"num_object_clones":0,"num_object_copies":1406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'934","reported_seq":958,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.665083+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:24:18.665083+0000","last_peered":"2023-11-18T19:24:18.665083+0000","last_clean":"2023-11-18T19:24:18.665083+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:18.665083+0000","last_undegraded":"2023-11-18T19:24:18.665083+0000","last_fullsized":"2023-11-18T19:24:18.665083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'948","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678688+0000","last_change":"2023-11-18T19:06:37.568642+0000","last_active":"2023-11-18T19:24:18.678688+0000","last_peered":"2023-11-18T19:24:18.678688+0000","last_clean":"2023-11-18T19:24:18.678688+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:18.678688+0000","last_undegraded":"2023-11-18T19:24:18.678688+0000","last_fullsized":"2023-11-18T19:24:18.678688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":703,"num_object_clones":0,"num_object_copies":1406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'946","reported_seq":970,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.664244+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:24:18.664244+0000","last_peered":"2023-11-18T19:24:18.664244+0000","last_clean":"2023-11-18T19:24:18.664244+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:24:18.664244+0000","last_undegraded":"2023-11-18T19:24:18.664244+0000","last_fullsized":"2023-11-18T19:24:18.664244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'886","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.666814+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:24:18.666814+0000","last_peered":"2023-11-18T19:24:18.666814+0000","last_clean":"2023-11-18T19:24:18.666814+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:18.666814+0000","last_undegraded":"2023-11-18T19:24:18.666814+0000","last_fullsized":"2023-11-18T19:24:18.666814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'967","reported_seq":991,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.675162+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:24:18.675162+0000","last_peered":"2023-11-18T19:24:18.675162+0000","last_clean":"2023-11-18T19:24:18.675162+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:18.675162+0000","last_undegraded":"2023-11-18T19:24:18.675162+0000","last_fullsized":"2023-11-18T19:24:18.675162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'893","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668601+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:24:18.668601+0000","last_peered":"2023-11-18T19:24:18.668601+0000","last_clean":"2023-11-18T19:24:18.668601+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:18.668601+0000","last_undegraded":"2023-11-18T19:24:18.668601+0000","last_fullsized":"2023-11-18T19:24:18.668601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'938","reported_seq":961,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.680678+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:24:18.680678+0000","last_peered":"2023-11-18T19:24:18.680678+0000","last_clean":"2023-11-18T19:24:18.680678+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:18.680678+0000","last_undegraded":"2023-11-18T19:24:18.680678+0000","last_fullsized":"2023-11-18T19:24:18.680678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":723,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'884","reported_seq":908,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656604+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:24:18.656604+0000","last_peered":"2023-11-18T19:24:18.656604+0000","last_clean":"2023-11-18T19:24:18.656604+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:18.656604+0000","last_undegraded":"2023-11-18T19:24:18.656604+0000","last_fullsized":"2023-11-18T19:24:18.656604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":676,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'909","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.677535+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:24:18.677535+0000","last_peered":"2023-11-18T19:24:18.677535+0000","last_clean":"2023-11-18T19:24:18.677535+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:18.677535+0000","last_undegraded":"2023-11-18T19:24:18.677535+0000","last_fullsized":"2023-11-18T19:24:18.677535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'891","reported_seq":914,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.671452+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:24:18.671452+0000","last_peered":"2023-11-18T19:24:18.671452+0000","last_clean":"2023-11-18T19:24:18.671452+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:18.671452+0000","last_undegraded":"2023-11-18T19:24:18.671452+0000","last_fullsized":"2023-11-18T19:24:18.671452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":691,"num_object_clones":0,"num_object_copies":1382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'915","reported_seq":938,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678923+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:24:18.678923+0000","last_peered":"2023-11-18T19:24:18.678923+0000","last_clean":"2023-11-18T19:24:18.678923+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:24:18.678923+0000","last_undegraded":"2023-11-18T19:24:18.678923+0000","last_fullsized":"2023-11-18T19:24:18.678923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'899","reported_seq":922,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674409+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:24:18.674409+0000","last_peered":"2023-11-18T19:24:18.674409+0000","last_clean":"2023-11-18T19:24:18.674409+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:24:18.674409+0000","last_undegraded":"2023-11-18T19:24:18.674409+0000","last_fullsized":"2023-11-18T19:24:18.674409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'964","reported_seq":987,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.664810+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:24:18.664810+0000","last_peered":"2023-11-18T19:24:18.664810+0000","last_clean":"2023-11-18T19:24:18.664810+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:18.664810+0000","last_undegraded":"2023-11-18T19:24:18.664810+0000","last_fullsized":"2023-11-18T19:24:18.664810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'884","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.679404+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:24:18.679404+0000","last_peered":"2023-11-18T19:24:18.679404+0000","last_clean":"2023-11-18T19:24:18.679404+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:18.679404+0000","last_undegraded":"2023-11-18T19:24:18.679404+0000","last_fullsized":"2023-11-18T19:24:18.679404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":693,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'929","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.672747+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:24:18.672747+0000","last_peered":"2023-11-18T19:24:18.672747+0000","last_clean":"2023-11-18T19:24:18.672747+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:18.672747+0000","last_undegraded":"2023-11-18T19:24:18.672747+0000","last_fullsized":"2023-11-18T19:24:18.672747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'874","reported_seq":897,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.663072+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:24:18.663072+0000","last_peered":"2023-11-18T19:24:18.663072+0000","last_clean":"2023-11-18T19:24:18.663072+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:18.663072+0000","last_undegraded":"2023-11-18T19:24:18.663072+0000","last_fullsized":"2023-11-18T19:24:18.663072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":653,"num_object_clones":0,"num_object_copies":1306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'962","reported_seq":985,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.683616+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:24:18.683616+0000","last_peered":"2023-11-18T19:24:18.683616+0000","last_clean":"2023-11-18T19:24:18.683616+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:18.683616+0000","last_undegraded":"2023-11-18T19:24:18.683616+0000","last_fullsized":"2023-11-18T19:24:18.683616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'915","reported_seq":939,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.673251+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:24:18.673251+0000","last_peered":"2023-11-18T19:24:18.673251+0000","last_clean":"2023-11-18T19:24:18.673251+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:18.673251+0000","last_undegraded":"2023-11-18T19:24:18.673251+0000","last_fullsized":"2023-11-18T19:24:18.673251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":706,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'967","reported_seq":991,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.652586+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:24:18.652586+0000","last_peered":"2023-11-18T19:24:18.652586+0000","last_clean":"2023-11-18T19:24:18.652586+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:18.652586+0000","last_undegraded":"2023-11-18T19:24:18.652586+0000","last_fullsized":"2023-11-18T19:24:18.652586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":753,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'889","reported_seq":913,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656778+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:24:18.656778+0000","last_peered":"2023-11-18T19:24:18.656778+0000","last_clean":"2023-11-18T19:24:18.656778+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:24:18.656778+0000","last_undegraded":"2023-11-18T19:24:18.656778+0000","last_fullsized":"2023-11-18T19:24:18.656778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":666,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'875","reported_seq":899,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674270+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:24:18.674270+0000","last_peered":"2023-11-18T19:24:18.674270+0000","last_clean":"2023-11-18T19:24:18.674270+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:24:18.674270+0000","last_undegraded":"2023-11-18T19:24:18.674270+0000","last_fullsized":"2023-11-18T19:24:18.674270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":651,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":697,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1532356433,"num_objects":72338,"num_object_clones":0,"num_object_copies":289352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72338,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":189841,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2809622528,"data_stored":3820519424,"data_compressed":666760082,"data_compressed_allocated":793534464,"data_compressed_original":1804431360,"omap_allocated":0,"internal_metadata":0},"log_size":142750,"ondisk_log_size":142750,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":45205,"num_object_clones":0,"num_object_copies":90410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45205,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59290,"ondisk_log_size":59290,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":278089175,"num_objects":2885,"num_object_clones":0,"num_object_copies":5770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2885,"num_whiteouts":0,"num_read":864,"num_read_kb":1816,"num_write":22208,"num_write_kb":725855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2811,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143589376,"data_stored":556178350,"data_compressed":87603958,"data_compressed_allocated":108216320,"data_compressed_original":520863744,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509655,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":622388,"kb_used_data":374636,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93749452,"statfs":{"total":96636764160,"available":95999438848,"internally_reserved":0,"allocated":383627264,"data_stored":581182258,"data_compressed":103018895,"data_compressed_allocated":123727872,"data_compressed_original":321466368,"omap_allocated":1594,"internal_metadata":253688262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":4.327,"15min":4.8049999999999997},"min":{"1min":0.65100000000000002,"5min":0.45800000000000002,"15min":0.372},"max":{"1min":2.4529999999999998,"5min":248.00800000000001,"15min":248.00800000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.5469999999999999,"5min":4.516,"15min":5.0270000000000001},"min":{"1min":0.72899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.4210000000000003,"5min":175.095,"15min":384.19499999999999},"last":0.93999999999999995}]},{"osd":1,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":2.4630000000000001,"15min":4.0839999999999996},"min":{"1min":0.748,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":4.681,"5min":53.398000000000003,"15min":199.179},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.587,"5min":4.5679999999999996,"15min":5.2869999999999999},"min":{"1min":0.72399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":6.4619999999999997,"5min":175.06800000000001,"15min":384.09699999999998},"last":1.2}]},{"osd":2,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.952,"15min":3.2559999999999998},"min":{"1min":0.63600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.8279999999999998,"5min":15.159000000000001,"15min":207.149},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.357,"5min":2.4900000000000002,"15min":5.4939999999999998},"min":{"1min":0.71299999999999997,"5min":0.51800000000000002,"15min":0.47299999999999998},"max":{"1min":2.4969999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":1.071}]},{"osd":3,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":4.593,"15min":5.6929999999999996},"min":{"1min":0.73299999999999998,"5min":0.51400000000000001,"15min":0.44600000000000001},"max":{"1min":6.4909999999999997,"5min":175.02600000000001,"15min":384.04700000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.472,"5min":2.4580000000000002,"15min":3.4009999999999998},"min":{"1min":0.755,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":2.8700000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":3.1269999999999998,"15min":5.0049999999999999},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":4.9420000000000002,"5min":86.346999999999994,"15min":199.393},"last":0.92100000000000004},{"interface":"front","average":{"1min":2.8420000000000001,"5min":5.4690000000000003,"15min":6.5700000000000003},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":26.733000000000001,"5min":204.786,"15min":384.161},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":3.1309999999999998,"15min":4.4429999999999996},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":2.8959999999999999,"5min":79.472999999999999,"15min":220.36500000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":2.0169999999999999,"5min":4.9050000000000002,"15min":5.5800000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":6.2699999999999996,"5min":160.107,"15min":212.68100000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":5.1760000000000002,"15min":8.9359999999999999},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":6.8769999999999998,"5min":205.01400000000001,"15min":410.60000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":2.8530000000000002,"5min":2.6150000000000002,"15min":4.0279999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":21.158000000000001,"5min":28.329999999999998,"15min":207.85300000000001},"last":0.53500000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509656,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":574512,"kb_used_data":326760,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93797328,"statfs":{"total":96636764160,"available":96048463872,"internally_reserved":0,"allocated":334602240,"data_stored":502017479,"data_compressed":82625659,"data_compressed_allocated":99524608,"data_compressed_original":267137024,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.5720000000000001,"15min":4.1859999999999999},"min":{"1min":0.73999999999999999,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":8.1440000000000001,"5min":14.576000000000001,"15min":248.32400000000001},"last":0.625},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.7689999999999999,"15min":2.7909999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.3959999999999999,"5min":26.890000000000001,"15min":93.090999999999994},"last":1.2190000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":2.113,"15min":5.3600000000000003},"min":{"1min":0.84199999999999997,"5min":0.49199999999999999,"15min":0.47899999999999998},"max":{"1min":7.9390000000000001,"5min":41.881,"15min":335.11799999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":2.8999999999999999,"5min":2.0619999999999998,"15min":3.9340000000000002},"min":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.432},"max":{"1min":22.524000000000001,"5min":22.524000000000001,"15min":278.17700000000002},"last":0.69299999999999995}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":2.3849999999999998,"15min":3.5470000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":36.954999999999998,"5min":50.735999999999997,"15min":144.68700000000001},"last":1.135},{"interface":"front","average":{"1min":1.893,"5min":2.0230000000000001,"15min":3.7120000000000002},"min":{"1min":0.77200000000000002,"5min":0.56499999999999995,"15min":0.504},"max":{"1min":7.8840000000000003,"5min":24.286999999999999,"15min":247.267},"last":0.89300000000000002}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.0209999999999999,"5min":1.9750000000000001,"15min":4.819},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":12.032,"5min":30.957999999999998,"15min":207.93799999999999},"last":1.3},{"interface":"front","average":{"1min":1.887,"5min":2.1139999999999999,"15min":4.5300000000000002},"min":{"1min":0.73099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":7.976,"5min":24.491,"15min":265.82600000000002},"last":0.85999999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7,"5min":2.3250000000000002,"15min":4.633},"min":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.42199999999999999},"max":{"1min":8.1039999999999992,"5min":28.951000000000001,"15min":303.19200000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.1360000000000001,"15min":4.7229999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":12.207000000000001,"5min":31.018999999999998,"15min":210.78899999999999},"last":1.03}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.577,"5min":2.5600000000000001,"15min":6.6859999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":41.378,"5min":41.378,"15min":308.47500000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":2.9550000000000001,"5min":2.226,"15min":4.1150000000000002},"min":{"1min":0.58999999999999997,"5min":0.44400000000000001,"15min":0.34000000000000002},"max":{"1min":22.57,"5min":24.411000000000001,"15min":303.23599999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2429999999999999,"5min":2.7789999999999999,"15min":5.2800000000000002},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.41199999999999998},"max":{"1min":11.987,"5min":63.313000000000002,"15min":252.18299999999999},"last":1.387},{"interface":"front","average":{"1min":2.0499999999999998,"5min":1.9259999999999999,"15min":4.8479999999999999},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.437},"max":{"1min":8.0169999999999995,"5min":14.84,"15min":309.029},"last":0.91800000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509656,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571648,"kb_used_data":323896,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93800192,"statfs":{"total":96636764160,"available":96051396608,"internally_reserved":0,"allocated":331669504,"data_stored":514492530,"data_compressed":94607921,"data_compressed_allocated":114036736,"data_compressed_original":297058304,"omap_allocated":1592,"internal_metadata":253688264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.6660000000000004,"5min":3.8220000000000001,"15min":2.5840000000000001},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":51.582999999999998,"5min":51.582999999999998,"15min":58.200000000000003},"last":0.93100000000000005},{"interface":"front","average":{"1min":5.0609999999999999,"5min":2.6120000000000001,"15min":2.3540000000000001},"min":{"1min":0.52900000000000003,"5min":0.40999999999999998,"15min":0.35999999999999999},"max":{"1min":56.402999999999999,"5min":56.402999999999999,"15min":56.402999999999999},"last":1.6890000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":2.3559999999999999,"15min":2.1949999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":11.771000000000001,"5min":36.024999999999999,"15min":36.024999999999999},"last":1.391},{"interface":"front","average":{"1min":7.2030000000000003,"5min":3.851,"15min":2.7309999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":51.542999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":1.125}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":5.6900000000000004,"5min":3.0270000000000001,"15min":2.6070000000000002},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":56.494,"5min":56.494,"15min":56.494},"last":1.9399999999999999},{"interface":"front","average":{"1min":3.4809999999999999,"5min":2.8319999999999999,"15min":2.605},"min":{"1min":0.622,"5min":0.622,"15min":0.42799999999999999},"max":{"1min":18.276,"5min":36.057000000000002,"15min":36.057000000000002},"last":1.482}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":6.9779999999999998,"5min":3.8759999999999999,"15min":2.9460000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":51.643000000000001,"5min":51.643000000000001,"15min":58.039999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":5.2889999999999997,"5min":2.8999999999999999,"15min":2.7719999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46500000000000002},"max":{"1min":56.530999999999999,"5min":56.530999999999999,"15min":56.530999999999999},"last":1.8140000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.0039999999999996,"5min":4.5250000000000004,"15min":3.7200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.33200000000000002},"max":{"1min":68.007000000000005,"5min":68.007000000000005,"15min":68.007000000000005},"last":1.274},{"interface":"front","average":{"1min":10.465999999999999,"5min":4.702,"15min":3.8290000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38600000000000001},"max":{"1min":72.611000000000004,"5min":72.611000000000004,"15min":72.611000000000004},"last":1.3360000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.811,"5min":4.2919999999999998,"15min":3.911},"min":{"1min":0.52700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":72.915999999999997,"5min":72.915999999999997,"15min":161.898},"last":1.175},{"interface":"front","average":{"1min":14.786,"5min":6.0739999999999998,"15min":4.7030000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":105.387,"5min":105.387,"15min":163.33600000000001},"last":1.5589999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.2610000000000001,"5min":4.6710000000000003,"15min":4.1390000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":51.615000000000002,"5min":66.341999999999999,"15min":66.341999999999999},"last":1.659},{"interface":"front","average":{"1min":6.8499999999999996,"5min":4.1790000000000003,"15min":4.101},"min":{"1min":0.65800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":56.454000000000001,"5min":58.427999999999997,"15min":66.665000000000006},"last":2.2530000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509657,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":709656,"kb_used_data":425872,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":93662184,"statfs":{"total":96636764160,"available":95910076416,"internally_reserved":0,"allocated":436092928,"data_stored":654931320,"data_compressed":113651503,"data_compressed_allocated":135081984,"data_compressed_original":354107392,"omap_allocated":1593,"internal_metadata":290585031},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.538,"15min":1.1679999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6919999999999999,"5min":44.363,"15min":44.363},"last":0.23200000000000001},{"interface":"front","average":{"1min":2.3540000000000001,"5min":1.992,"15min":1.956},"min":{"1min":0.44500000000000001,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":27.032,"5min":58.844999999999999,"15min":62.512999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.861,"15min":3.1539999999999999},"min":{"1min":0.626,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":11.923,"5min":33.281999999999996,"15min":202.65000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.996,"5min":2.2909999999999999,"15min":2.5369999999999999},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":16.783999999999999,"5min":84.191999999999993,"15min":114.221},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.8799999999999999,"5min":1.712,"15min":1.5669999999999999},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":15.013,"5min":27.433,"15min":43.747999999999998},"last":0.504},{"interface":"front","average":{"1min":1.4279999999999999,"5min":2.524,"15min":2.3660000000000001},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":1.98,"5min":50.006,"15min":50.006},"last":0.47099999999999997}]},{"osd":4,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":3,"15min":4.2930000000000001},"min":{"1min":0.91900000000000004,"5min":0.66400000000000003,"15min":0.42499999999999999},"max":{"1min":12.43,"5min":51.384,"15min":202.821},"last":4.0250000000000004},{"interface":"front","average":{"1min":2.3180000000000001,"5min":2.5089999999999999,"15min":3.2570000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":23.635000000000002,"5min":53.720999999999997,"15min":234.68700000000001},"last":2.7149999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.782,"5min":3.8900000000000001,"15min":4.3440000000000003},"min":{"1min":0.94199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":57.360999999999997,"5min":57.360999999999997,"15min":190.827},"last":0.52400000000000002},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.9550000000000001,"15min":4.6980000000000004},"min":{"1min":0.97799999999999998,"5min":0.58199999999999996,"15min":0.54700000000000004},"max":{"1min":39.981999999999999,"5min":70.242000000000004,"15min":213.03999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":6.0220000000000002,"5min":3.335,"15min":3.0529999999999999},"min":{"1min":0.93000000000000005,"5min":0.78300000000000003,"15min":0.46800000000000003},"max":{"1min":89.710999999999999,"5min":89.710999999999999,"15min":89.710999999999999},"last":2.5840000000000001},{"interface":"front","average":{"1min":1.9610000000000001,"5min":3.2839999999999998,"15min":3.9489999999999998},"min":{"1min":1.093,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":12.269,"5min":50.899000000000001,"15min":202.78299999999999},"last":7.8689999999999998}]},{"osd":7,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.625,"5min":3.2719999999999998,"15min":4.1950000000000003},"min":{"1min":1.014,"5min":0.745,"15min":0.58299999999999996},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":82.248000000000005},"last":2.0190000000000001},{"interface":"front","average":{"1min":4.0449999999999999,"5min":4.6319999999999997,"15min":6.069},"min":{"1min":1.087,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":42.883000000000003,"5min":113.44,"15min":233.44800000000001},"last":7.8220000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509657,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":578344,"kb_used_data":344480,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93793496,"statfs":{"total":96636764160,"available":96044539904,"internally_reserved":0,"allocated":352747520,"data_stored":499602898,"data_compressed":87576742,"data_compressed_allocated":103403520,"data_compressed_original":250449920,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.2029999999999998,"15min":1.9870000000000001},"min":{"1min":0.58999999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":15.622,"5min":83.817999999999998,"15min":83.817999999999998},"last":1.24},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.448,"15min":3.4689999999999999},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":16.433,"5min":83.266999999999996,"15min":248.16999999999999},"last":1.1719999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":1.7709999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":15.384,"5min":19.004999999999999,"15min":30.504999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.157,"15min":3.3540000000000001},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.28100000000000003},"max":{"1min":14.863,"5min":47.768999999999998,"15min":255.315},"last":1.4830000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":4.7300000000000004,"5min":1.98,"15min":1.976},"min":{"1min":0.77300000000000002,"5min":0.40799999999999997,"15min":0.315},"max":{"1min":30.062999999999999,"5min":30.062999999999999,"15min":84.840999999999994},"last":1.6080000000000001},{"interface":"front","average":{"1min":2.899,"5min":2.145,"15min":2.7589999999999999},"min":{"1min":0.73699999999999999,"5min":0.54700000000000004,"15min":0.36599999999999999},"max":{"1min":15.587,"5min":27.283000000000001,"15min":128.976},"last":1.651}]},{"osd":4,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":5.9710000000000001,"5min":3.0840000000000001,"15min":4.9109999999999996},"min":{"1min":1.0669999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":37.795000000000002,"5min":47.432000000000002,"15min":255.25700000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":3.7160000000000002,"5min":2.4159999999999999,"15min":3.4340000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.48299999999999998},"max":{"1min":15.198,"5min":34.531999999999996,"15min":128.655},"last":1.351}]},{"osd":5,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.7000000000000002,"15min":4.7380000000000004},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.53300000000000003},"max":{"1min":24.016999999999999,"5min":138.905,"15min":153.417},"last":2.0409999999999999},{"interface":"front","average":{"1min":7.109,"5min":3.3610000000000002,"15min":5.6150000000000002},"min":{"1min":0.97999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":59.981000000000002,"5min":63.884,"15min":255.34899999999999},"last":1.633}]},{"osd":6,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.2330000000000001,"5min":2.5209999999999999,"15min":3.492},"min":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.55400000000000005},"max":{"1min":10.231,"5min":82.388999999999996,"15min":138.33099999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.835,"15min":5.0419999999999998},"min":{"1min":0.85099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":15.726000000000001,"5min":127.44799999999999,"15min":187.29599999999999},"last":2.165}]},{"osd":7,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":8.3079999999999998,"5min":4.3659999999999997,"15min":6.3360000000000003},"min":{"1min":1.026,"5min":0.95499999999999996,"15min":0.60899999999999999},"max":{"1min":67.837999999999994,"5min":81.165999999999997,"15min":211.17500000000001},"last":1.7609999999999999},{"interface":"front","average":{"1min":8.5269999999999992,"5min":3.2949999999999999,"15min":4.7069999999999999},"min":{"1min":0.92000000000000004,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":72.992999999999995,"5min":72.992999999999995,"15min":173.53999999999999},"last":1.802}]}]},{"osd":1,"up_from":15,"seq":64424509657,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686800,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93685040,"statfs":{"total":96636764160,"available":95933480960,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106207472,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.968,"5min":1.617,"15min":1.478},"min":{"1min":0.76500000000000001,"5min":0.30199999999999999,"15min":0.22500000000000001},"max":{"1min":21.655999999999999,"5min":21.655999999999999,"15min":51.420999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":3.3959999999999999,"5min":1.768,"15min":1.722},"min":{"1min":0.59899999999999998,"5min":0.34200000000000003,"15min":0.255},"max":{"1min":22.587,"5min":22.587,"15min":48.802999999999997},"last":1.466}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.768,"15min":2.544},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.308},"max":{"1min":24.036999999999999,"5min":24.036999999999999,"15min":131.321},"last":1.028},{"interface":"front","average":{"1min":4.6660000000000004,"5min":1.962,"15min":1.635},"min":{"1min":0.61499999999999999,"5min":0.40699999999999997,"15min":0.27800000000000002},"max":{"1min":26.029,"5min":26.029,"15min":26.029},"last":1.2090000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.343,"5min":2.2610000000000001,"15min":2.6800000000000002},"min":{"1min":0.65800000000000003,"5min":0.42799999999999999,"15min":0.26700000000000002},"max":{"1min":43.832999999999998,"5min":43.832999999999998,"15min":197.43899999999999},"last":1.712},{"interface":"front","average":{"1min":5.843,"5min":2.4249999999999998,"15min":2.5129999999999999},"min":{"1min":0.54600000000000004,"5min":0.39600000000000002,"15min":0.32100000000000001},"max":{"1min":54.316000000000003,"5min":54.316000000000003,"15min":156.316},"last":1.319}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.0209999999999999,"5min":2.722,"15min":3.3300000000000001},"min":{"1min":0.83899999999999997,"5min":0.64900000000000002,"15min":0.44800000000000001},"max":{"1min":48.799999999999997,"5min":48.799999999999997,"15min":159.84299999999999},"last":1.147},{"interface":"front","average":{"1min":5.1520000000000001,"5min":3.214,"15min":3.1389999999999998},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.51700000000000002},"max":{"1min":28.405999999999999,"5min":43.418999999999997,"15min":62.978999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":10.071,"5min":3.726,"15min":3.347},"min":{"1min":0.90400000000000003,"5min":0.72999999999999998,"15min":0.50600000000000001},"max":{"1min":107.88500000000001,"5min":107.88500000000001,"15min":107.88500000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.6800000000000002,"15min":3.1150000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":19.553999999999998,"5min":24.309999999999999,"15min":133.685},"last":1.2669999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":7.4649999999999999,"5min":3.1819999999999999,"15min":3.5950000000000002},"min":{"1min":1.1140000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":54.220999999999997,"5min":54.220999999999997,"15min":142.84100000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":3.8700000000000001,"5min":2.278,"15min":3.706},"min":{"1min":1.006,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":23.998999999999999,"5min":23.998999999999999,"15min":146.69900000000001},"last":1.4099999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.3479999999999999,"5min":3.0499999999999998,"15min":2.7200000000000002},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":31.096,"5min":31.096,"15min":35.783999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":7.819,"5min":3.5209999999999999,"15min":3.359},"min":{"1min":1.351,"5min":0.997,"15min":0.63600000000000001},"max":{"1min":34.281999999999996,"5min":34.281999999999996,"15min":57.134999999999998},"last":1.6779999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509658,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":492604,"kb_used_data":250484,"kb_used_omap":1,"kb_used_meta":242110,"kb_avail":93879236,"statfs":{"total":96636764160,"available":96132337664,"internally_reserved":0,"allocated":256495616,"data_stored":421311338,"data_compressed":70178109,"data_compressed_allocated":85630976,"data_compressed_original":250638336,"omap_allocated":1594,"internal_metadata":247921094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":3.3330000000000002,"5min":1.859,"15min":1.7569999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.21099999999999999},"max":{"1min":30.565000000000001,"5min":30.565000000000001,"15min":74.326999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":3.9260000000000002,"5min":2.1829999999999998,"15min":1.5900000000000001},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.25700000000000001},"max":{"1min":32.871000000000002,"5min":33.957999999999998,"15min":43.518000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":14.217000000000001,"5min":4.2910000000000004,"15min":2.282},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":181.27099999999999,"5min":181.27099999999999,"15min":181.27099999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":4.3620000000000001,"5min":2.4119999999999999,"15min":1.827},"min":{"1min":0.504,"5min":0.436,"15min":0.24099999999999999},"max":{"1min":41.810000000000002,"5min":41.810000000000002,"15min":46.984999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.7089999999999996,"5min":2.3239999999999998,"15min":1.788},"min":{"1min":0.53000000000000003,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":31.562000000000001,"5min":31.562000000000001,"15min":36.642000000000003},"last":0.433},{"interface":"front","average":{"1min":12.118,"5min":3.8759999999999999,"15min":2.5350000000000001},"min":{"1min":1.2010000000000001,"5min":0.48599999999999999,"15min":0.28799999999999998},"max":{"1min":94.373000000000005,"5min":94.373000000000005,"15min":94.373000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.656000000000001,"5min":4.141,"15min":3.3159999999999998},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":135.547,"5min":135.547,"15min":135.547},"last":0.55900000000000005},{"interface":"front","average":{"1min":10.077999999999999,"5min":3.8639999999999999,"15min":3.3370000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":131.07599999999999,"5min":131.07599999999999,"15min":131.07599999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.5460000000000003,"5min":2.9660000000000002,"15min":2.6829999999999998},"min":{"1min":1.1619999999999999,"5min":0.56699999999999995,"15min":0.38700000000000001},"max":{"1min":41.412999999999997,"5min":63.134999999999998,"15min":63.134999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":4.5469999999999997,"5min":3.2389999999999999,"15min":2.7890000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":42.020000000000003,"5min":63.185000000000002,"15min":63.185000000000002},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.8239999999999998,"15min":3.5699999999999998},"min":{"1min":0.95899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.548999999999999,"5min":105.974,"15min":203.92699999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":4.6369999999999996,"5min":4.0860000000000003,"15min":3.806},"min":{"1min":1.0529999999999999,"5min":0.627,"15min":0.42899999999999999},"max":{"1min":28.646000000000001,"5min":160.84700000000001,"15min":203.56899999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":9.5519999999999996,"5min":4.3310000000000004,"15min":3.0489999999999999},"min":{"1min":0.996,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":91.418000000000006,"5min":91.418000000000006,"15min":91.418000000000006},"last":0.66600000000000004},{"interface":"front","average":{"1min":5.2549999999999999,"5min":3.8029999999999999,"15min":3.0139999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":31.756,"5min":68.608000000000004,"15min":68.608000000000004},"last":0.68799999999999994}]}]},{"osd":7,"up_from":13,"seq":55834575064,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682984,"kb_used_data":417184,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93688856,"statfs":{"total":96636764160,"available":95937388544,"internally_reserved":0,"allocated":427196416,"data_stored":574962631,"data_compressed":94721461,"data_compressed_allocated":110882816,"data_compressed_original":258842624,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.3539999999999992,"5min":5.5549999999999997,"15min":4.4649999999999999},"min":{"1min":0.58199999999999996,"5min":0.501,"15min":0.39300000000000002},"max":{"1min":69.191999999999993,"5min":221.768,"15min":221.768},"last":1.0189999999999999},{"interface":"front","average":{"1min":7.1609999999999996,"5min":4.2290000000000001,"15min":3.3039999999999998},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.40699999999999997},"max":{"1min":63.854999999999997,"5min":93.781000000000006,"15min":93.781000000000006},"last":1.0569999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.5009999999999994,"5min":5.7460000000000004,"15min":4.3810000000000002},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.374},"max":{"1min":69.061999999999998,"5min":221.715,"15min":221.715},"last":1.3120000000000001},{"interface":"front","average":{"1min":7.3419999999999996,"5min":4.3179999999999996,"15min":3.3969999999999998},"min":{"1min":0.74399999999999999,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":67.930999999999997,"5min":93.825000000000003,"15min":93.825000000000003},"last":1.1890000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.0329999999999999,"15min":4.3170000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47999999999999998},"max":{"1min":21.026,"5min":27.303000000000001,"15min":189.01400000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":8.5289999999999999,"5min":5.7249999999999996,"15min":4.5910000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.48799999999999999},"max":{"1min":69.156999999999996,"5min":221.80600000000001,"15min":221.80600000000001},"last":1.109}]},{"osd":3,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":6.9409999999999998,"5min":3.3420000000000001,"15min":4.4829999999999997},"min":{"1min":0.82799999999999996,"5min":0.747,"15min":0.57399999999999995},"max":{"1min":64.206000000000003,"5min":64.206000000000003,"15min":198.696},"last":1.155},{"interface":"front","average":{"1min":8.4770000000000003,"5min":5.7590000000000003,"15min":5.3120000000000003},"min":{"1min":0.78400000000000003,"5min":0.66200000000000003,"15min":0.46100000000000002},"max":{"1min":69.585999999999999,"5min":221.846,"15min":221.846},"last":1.3819999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":7.4640000000000004,"5min":4.5199999999999996,"15min":5.0640000000000001},"min":{"1min":0.48199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":63.634,"5min":93.890000000000001,"15min":245.36000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":5.5899999999999999,"5min":3.3530000000000002,"15min":4.7130000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.443},"max":{"1min":43.292000000000002,"5min":56.325000000000003,"15min":190.40799999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.4879999999999995,"5min":6.4530000000000003,"15min":6.3959999999999999},"min":{"1min":0.46400000000000002,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":69.122,"5min":222.85499999999999,"15min":222.85499999999999},"last":1.218},{"interface":"front","average":{"1min":9.5709999999999997,"5min":5.2539999999999996,"15min":6.181},"min":{"1min":0.63400000000000001,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":83.078000000000003,"5min":93.858000000000004,"15min":215.16900000000001},"last":0.89600000000000002}]},{"osd":6,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.6600000000000001,"5min":4.9820000000000002,"15min":4.9980000000000002},"min":{"1min":0.80400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":68.109999999999999,"5min":94.079999999999998,"15min":94.079999999999998},"last":1.252},{"interface":"front","average":{"1min":8.0809999999999995,"5min":4.0359999999999996,"15min":5.0140000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":63.673000000000002,"5min":63.673000000000002,"15min":188.935},"last":1.2809999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24195072,"data_stored":104857656,"data_compressed":16682123,"data_compressed_allocated":20328448,"data_compressed_original":100999168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16805888,"data_stored":62914630,"data_compressed":9779731,"data_compressed_allocated":12054528,"data_compressed_original":58167296,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8126464,"data_stored":33555104,"data_compressed":5171825,"data_compressed_allocated":6344704,"data_compressed_original":31780864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26669056,"data_stored":104858182,"data_compressed":16510456,"data_compressed_allocated":20230144,"data_compressed_original":98422784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17113088,"data_stored":62915904,"data_compressed":9796281,"data_compressed_allocated":12075008,"data_compressed_original":57892864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21372928,"data_stored":76761205,"data_compressed":12207191,"data_compressed_allocated":15360000,"data_compressed_original":70758400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21659648,"data_stored":83886080,"data_compressed":13417072,"data_compressed_allocated":16605184,"data_compressed_original":78831616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7647232,"data_stored":26429589,"data_compressed":4039279,"data_compressed_allocated":5218304,"data_compressed_original":24010752,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344313856,"data_stored":465924096,"data_compressed":82404917,"data_compressed_allocated":97058816,"data_compressed_original":218669056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409116672,"data_stored":549949440,"data_compressed":97141047,"data_compressed_allocated":114851840,"data_compressed_original":255684608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":314249216,"data_stored":451452928,"data_compressed":84811640,"data_compressed_allocated":101961728,"data_compressed_original":239165440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":312856576,"data_stored":424542208,"data_compressed":70385955,"data_compressed_allocated":84119552,"data_compressed_original":195805184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":361660416,"data_stored":497172480,"data_compressed":89601823,"data_compressed_allocated":107122688,"data_compressed_original":242634752,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":419241984,"data_stored":548409344,"data_compressed":90682182,"data_compressed_allocated":105664512,"data_compressed_original":234831872,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:24:24.225 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-18T19:24:24.226 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:24:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.647+0000 7efe1590a640 1 Processor -- start 2023-11-18T19:24:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.647+0000 7efe1590a640 1 -- start start 2023-11-18T19:24:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.649+0000 7efe1590a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe080506f0 0x7efe08006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.649+0000 7efe1590a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080d7cd0 con 0x7efe080d78f0 2023-11-18T19:24:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.649+0000 7efe1590a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080db220 con 0x7efe0800fcc0 2023-11-18T19:24:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.649+0000 7efe1590a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0804b9d0 con 0x7efe080506f0 2023-11-18T19:24:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.650+0000 7efe14908640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efe080d78f0 0x7efe0800ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56236/0 (socket says 172.21.15.45:56236) 2023-11-18T19:24:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.650+0000 7efe14908640 1 -- 172.21.15.45:0/484380618 learned_addr learned my addr 172.21.15.45:0/484380618 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.652+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988582352 0 0) 0x7efe080d7cd0 con 0x7efe080d78f0 2023-11-18T19:24:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.652+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe00003520 con 0x7efe080d78f0 2023-11-18T19:24:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.652+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747440251 0 0) 0x7efe080db220 con 0x7efe0800fcc0 2023-11-18T19:24:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.652+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe080d7cd0 con 0x7efe0800fcc0 2023-11-18T19:24:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.652+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949885530 0 0) 0x7efe00003520 con 0x7efe080d78f0 2023-11-18T19:24:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.652+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 >> v2:172.21.15.135:3300/0 conn(0x7efe080506f0 msgr2=0x7efe08006290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-18T19:24:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 --2- 172.21.15.45:0/484380618 >> v2:172.21.15.135:3300/0 conn(0x7efe080506f0 0x7efe08006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 >> v1:172.21.15.135:6789/0 conn(0x7efe0800fcc0 legacy=0x7efe080067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0804bcb0 con 0x7efe080d78f0 2023-11-18T19:24:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7efe04001670 con 0x7efe080d78f0 2023-11-18T19:24:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 >> v1:172.21.15.45:6789/0 conn(0x7efe080d78f0 legacy=0x7efe0800ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe00003b00 0x7efe00003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000047c0 0x7efe00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000051f0 0x7efe0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0804b9d0 con 0x7efe000051f0 2023-11-18T19:24:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0000c150 con 0x7efe00003b00 2023-11-18T19:24:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0000c310 con 0x7efe000047c0 2023-11-18T19:24:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.653+0000 7efe15109640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000051f0 0x7efe0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.655+0000 7efe15109640 1 -- 172.21.15.45:0/484380618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000047c0 msgr2=0x7efe00004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T19:24:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.655+0000 7efe15109640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000047c0 0x7efe00004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.655+0000 7efe15109640 1 -- 172.21.15.45:0/484380618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe00003b00 msgr2=0x7efe00003f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-18T19:24:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.655+0000 7efe15109640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe00003b00 0x7efe00003f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.655+0000 7efe15109640 1 -- 172.21.15.45:0/484380618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0804bcb0 con 0x7efe000051f0 2023-11-18T19:24:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.658+0000 7efe15109640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000051f0 0x7efe0000b980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe1004fab0 tx=0x7efe000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17887580a193126f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.659+0000 7efe15109640 1 -- 172.21.15.45:0/484380618 reap_dead start 2023-11-18T19:24:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.661+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe100a6b60 con 0x7efe000051f0 2023-11-18T19:24:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.661+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe100a6cc0 con 0x7efe000051f0 2023-11-18T19:24:24.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.661+0000 7efe0f7fe640 1 -- 172.21.15.45:0/484380618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe100a6b60 con 0x7efe000051f0 2023-11-18T19:24:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.663+0000 7efe1590a640 1 -- 172.21.15.45:0/484380618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000051f0 msgr2=0x7efe0000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.663+0000 7efe1590a640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000051f0 0x7efe0000b980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe1004fab0 tx=0x7efe000057f0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.666+0000 7efe1590a640 1 -- 172.21.15.45:0/484380618 shutdown_connections 2023-11-18T19:24:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.666+0000 7efe1590a640 1 --2- 172.21.15.45:0/484380618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000051f0 0x7efe0000b980 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.666+0000 7efe1590a640 1 -- 172.21.15.45:0/484380618 >> 172.21.15.45:0/484380618 conn(0x7efe0804fbd0 msgr2=0x7efe0804ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:24.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.674+0000 7efe1590a640 1 -- 172.21.15.45:0/484380618 shutdown_connections 2023-11-18T19:24:24.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.674+0000 7efe1590a640 1 -- 172.21.15.45:0/484380618 wait complete. 2023-11-18T19:24:24.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.677+0000 7efe1590a640 1 Processor -- start 2023-11-18T19:24:24.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.679+0000 7efe1590a640 1 -- start start 2023-11-18T19:24:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.682+0000 7efe1590a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000051f0 0x7efe081742a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.682+0000 7efe1590a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe080db820 0x7efe0816aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.682+0000 7efe1590a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe080dd9b0 0x7efe08178070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.683+0000 7efe14908640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000051f0 0x7efe081742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:24.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.683+0000 7efe1590a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080dde70 con 0x7efe080db820 2023-11-18T19:24:24.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.683+0000 7efe1590a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081747e0 con 0x7efe080dd9b0 2023-11-18T19:24:24.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.683+0000 7efe1590a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe08177be0 con 0x7efe000051f0 2023-11-18T19:24:24.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.683+0000 7efe0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe080db820 0x7efe0816aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:24.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.683+0000 7efe14908640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000051f0 0x7efe081742a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:57208/0 (socket says 172.21.15.45:57208) 2023-11-18T19:24:24.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.683+0000 7efe14908640 1 -- 172.21.15.45:0/800723842 learned_addr learned my addr 172.21.15.45:0/800723842 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:24.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.684+0000 7efe15109640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe080dd9b0 0x7efe08178070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.685+0000 7efe0ffff640 1 -- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000051f0 msgr2=0x7efe081742a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.685+0000 7efe0ffff640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000051f0 0x7efe081742a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.685+0000 7efe0ffff640 1 -- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe080dd9b0 msgr2=0x7efe08178070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.685+0000 7efe0ffff640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe080dd9b0 0x7efe08178070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:24.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.685+0000 7efe0ffff640 1 -- 172.21.15.45:0/800723842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe081778b0 con 0x7efe080db820 2023-11-18T19:24:24.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.686+0000 7efe15109640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe080dd9b0 0x7efe08178070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:24:24.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.689+0000 7efe14908640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000051f0 0x7efe081742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:24:24.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.691+0000 7efe0ffff640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe080db820 0x7efe0816aee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00b3e0 tx=0x7efdfc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:24.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.692+0000 7efe0d7fa640 1 -- 172.21.15.45:0/800723842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc011830 con 0x7efe080db820 2023-11-18T19:24:24.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.692+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe080de390 con 0x7efe080db820 2023-11-18T19:24:24.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.692+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0816b420 con 0x7efe080db820 2023-11-18T19:24:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.692+0000 7efe0d7fa640 1 -- 172.21.15.45:0/800723842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc011990 con 0x7efe080db820 2023-11-18T19:24:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.692+0000 7efe0d7fa640 1 -- 172.21.15.45:0/800723842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc011830 con 0x7efe080db820 2023-11-18T19:24:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.694+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf0005250 con 0x7efe080db820 2023-11-18T19:24:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.698+0000 7efe0d7fa640 1 -- 172.21.15.45:0/800723842 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdfc011b00 con 0x7efe080db820 2023-11-18T19:24:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.700+0000 7efe0d7fa640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7efdf406aea0 0x7efdf406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.700+0000 7efe0d7fa640 1 -- 172.21.15.45:0/800723842 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7efdfc058ca0 con 0x7efe080db820 2023-11-18T19:24:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.708+0000 7efe14908640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7efdf406aea0 0x7efdf406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.709+0000 7efe14908640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7efdf406aea0 0x7efdf406d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe04001eb0 tx=0x7efe04001790 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:24.710+0000 7efe0d7fa640 1 -- 172.21.15.45:0/800723842 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdfc0548e0 con 0x7efe080db820 2023-11-18T19:24:25.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.096+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdf0000bc0 con 0x7efdf406aea0 2023-11-18T19:24:25.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.128+0000 7efe0d7fa640 1 -- 172.21.15.45:0/800723842 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372964 (secure 0 0 0) 0x7efdf0000bc0 con 0x7efdf406aea0 2023-11-18T19:24:25.130 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:24:25.137 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:24:25.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.140+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7efdf406aea0 msgr2=0x7efdf406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.140+0000 7efe1590a640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7efdf406aea0 0x7efdf406d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe04001eb0 tx=0x7efe04001790 comp rx=0 tx=0).stop 2023-11-18T19:24:25.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.140+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe080db820 msgr2=0x7efe0816aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.140+0000 7efe1590a640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe080db820 0x7efe0816aee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00b3e0 tx=0x7efdfc00b8a0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.143+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 shutdown_connections 2023-11-18T19:24:25.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.143+0000 7efe1590a640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe080dd9b0 0x7efe08178070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.143+0000 7efe1590a640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe080db820 0x7efe0816aee0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.143+0000 7efe1590a640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7efdf406aea0 0x7efdf406d360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.143+0000 7efe1590a640 1 --2- 172.21.15.45:0/800723842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe000051f0 0x7efe081742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.143+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 >> 172.21.15.45:0/800723842 conn(0x7efe0804fbd0 msgr2=0x7efe08004b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.145+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 shutdown_connections 2023-11-18T19:24:25.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.145+0000 7efe1590a640 1 -- 172.21.15.45:0/800723842 wait complete. 2023-11-18T19:24:25.190 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2023-11-18T19:24:23.586059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1811035976,"num_objects":120430,"num_object_clones":0,"num_object_copies":385536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120430,"num_whiteouts":0,"num_read":995,"num_read_kb":1916,"num_write":260841,"num_write_kb":2418263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2811,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218519,"ondisk_log_size":218519,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4918936,"kb_used_data":2884312,"kb_used_omap":12,"kb_used_meta":2034547,"kb_avail":750055784,"statfs":{"total":773094113280,"available":768057122816,"internally_reserved":0,"allocated":2953535488,"data_stored":4366285182,"data_compressed":752587762,"data_compressed_allocated":899575808,"data_compressed_original":2313859072,"omap_allocated":12748,"internal_metadata":2083376692},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":94,"apply_latency_ms":94,"commit_latency_ns":94000000,"apply_latency_ns":94000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":271088583,"num_objects":1709,"num_object_clones":0,"num_object_copies":3860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1709,"num_whiteouts":0,"num_read":4,"num_read_kb":10,"num_write":4959,"num_write_kb":251798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004601"},"pg_stats":[{"pgid":"2.1f","version":"29'394","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.441071+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:24:17.441071+0000","last_peered":"2023-11-18T19:24:17.441071+0000","last_clean":"2023-11-18T19:24:17.441071+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:17.441071+0000","last_undegraded":"2023-11-18T19:24:17.441071+0000","last_fullsized":"2023-11-18T19:24:17.441071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":572,"num_write_kb":13668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'902","reported_seq":926,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.540603+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:24:17.540603+0000","last_peered":"2023-11-18T19:24:17.540603+0000","last_clean":"2023-11-18T19:24:17.540603+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:24:17.540603+0000","last_undegraded":"2023-11-18T19:24:17.540603+0000","last_fullsized":"2023-11-18T19:24:17.540603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":681,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4429","reported_seq":4452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.228185+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:24:18.228185+0000","last_peered":"2023-11-18T19:24:18.228185+0000","last_clean":"2023-11-18T19:24:18.228185+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:18.228185+0000","last_undegraded":"2023-11-18T19:24:18.228185+0000","last_fullsized":"2023-11-18T19:24:18.228185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4429,"log_dups_size":0,"ondisk_log_size":4429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47448745,"num_objects":2214,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5913,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'310","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.825011+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:24:16.825011+0000","last_peered":"2023-11-18T19:24:16.825011+0000","last_clean":"2023-11-18T19:24:16.825011+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:16.825011+0000","last_undegraded":"2023-11-18T19:24:16.825011+0000","last_fullsized":"2023-11-18T19:24:16.825011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":458,"num_write_kb":31029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'912","reported_seq":936,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.664966+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:24:18.664966+0000","last_peered":"2023-11-18T19:24:18.664966+0000","last_clean":"2023-11-18T19:24:18.664966+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:24:18.664966+0000","last_undegraded":"2023-11-18T19:24:18.664966+0000","last_fullsized":"2023-11-18T19:24:18.664966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4485","reported_seq":4509,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.211313+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:24:18.211313+0000","last_peered":"2023-11-18T19:24:18.211313+0000","last_clean":"2023-11-18T19:24:18.211313+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:18.211313+0000","last_undegraded":"2023-11-18T19:24:18.211313+0000","last_fullsized":"2023-11-18T19:24:18.211313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":0,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45442855,"num_objects":2273,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5975,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'501","reported_seq":525,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.756644+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:24:16.756644+0000","last_peered":"2023-11-18T19:24:16.756644+0000","last_clean":"2023-11-18T19:24:16.756644+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:16.756644+0000","last_undegraded":"2023-11-18T19:24:16.756644+0000","last_fullsized":"2023-11-18T19:24:16.756644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":681,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'961","reported_seq":984,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678110+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:24:18.678110+0000","last_peered":"2023-11-18T19:24:18.678110+0000","last_clean":"2023-11-18T19:24:18.678110+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:18.678110+0000","last_undegraded":"2023-11-18T19:24:18.678110+0000","last_fullsized":"2023-11-18T19:24:18.678110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4526","reported_seq":4548,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.452711+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:24:17.452711+0000","last_peered":"2023-11-18T19:24:17.452711+0000","last_clean":"2023-11-18T19:24:17.452711+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:24:17.452711+0000","last_undegraded":"2023-11-18T19:24:17.452711+0000","last_fullsized":"2023-11-18T19:24:17.452711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4526,"log_dups_size":0,"ondisk_log_size":4526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48597389,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6019,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:19.771442+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:24:19.771442+0000","last_peered":"2023-11-18T19:24:19.771442+0000","last_clean":"2023-11-18T19:24:19.771442+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:19.771442+0000","last_undegraded":"2023-11-18T19:24:19.771442+0000","last_fullsized":"2023-11-18T19:24:19.771442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":406,"num_write_kb":17263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":80,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'953","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.677474+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:24:18.677474+0000","last_peered":"2023-11-18T19:24:18.677474+0000","last_clean":"2023-11-18T19:24:18.677474+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:24:18.677474+0000","last_undegraded":"2023-11-18T19:24:18.677474+0000","last_fullsized":"2023-11-18T19:24:18.677474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4361","reported_seq":4384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.211402+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:24:18.211402+0000","last_peered":"2023-11-18T19:24:18.211402+0000","last_clean":"2023-11-18T19:24:18.211402+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:18.211402+0000","last_undegraded":"2023-11-18T19:24:18.211402+0000","last_fullsized":"2023-11-18T19:24:18.211402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4361,"log_dups_size":0,"ondisk_log_size":4361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44553589,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5746,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'935","reported_seq":960,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668247+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:24:18.668247+0000","last_peered":"2023-11-18T19:24:18.668247+0000","last_clean":"2023-11-18T19:24:18.668247+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:18.668247+0000","last_undegraded":"2023-11-18T19:24:18.668247+0000","last_fullsized":"2023-11-18T19:24:18.668247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'401","reported_seq":426,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.014033+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:24:17.014033+0000","last_peered":"2023-11-18T19:24:17.014033+0000","last_clean":"2023-11-18T19:24:17.014033+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:24:17.014033+0000","last_undegraded":"2023-11-18T19:24:17.014033+0000","last_fullsized":"2023-11-18T19:24:17.014033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":589,"num_write_kb":29794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4511","reported_seq":4533,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.423236+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:24:17.423236+0000","last_peered":"2023-11-18T19:24:17.423236+0000","last_clean":"2023-11-18T19:24:17.423236+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:17.423236+0000","last_undegraded":"2023-11-18T19:24:17.423236+0000","last_fullsized":"2023-11-18T19:24:17.423236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50701125,"num_objects":2305,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6011,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'963","reported_seq":986,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656931+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:24:18.656931+0000","last_peered":"2023-11-18T19:24:18.656931+0000","last_clean":"2023-11-18T19:24:18.656931+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:18.656931+0000","last_undegraded":"2023-11-18T19:24:18.656931+0000","last_fullsized":"2023-11-18T19:24:18.656931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'426","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.159723+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:24:17.159723+0000","last_peered":"2023-11-18T19:24:17.159723+0000","last_clean":"2023-11-18T19:24:17.159723+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:17.159723+0000","last_undegraded":"2023-11-18T19:24:17.159723+0000","last_fullsized":"2023-11-18T19:24:17.159723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":29973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4482","reported_seq":4504,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.286812+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:24:17.286812+0000","last_peered":"2023-11-18T19:24:17.286812+0000","last_clean":"2023-11-18T19:24:17.286812+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:24:17.286812+0000","last_undegraded":"2023-11-18T19:24:17.286812+0000","last_fullsized":"2023-11-18T19:24:17.286812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4482,"log_dups_size":0,"ondisk_log_size":4482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5947,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'1006","reported_seq":1031,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.653285+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:24:18.653285+0000","last_peered":"2023-11-18T19:24:18.653285+0000","last_clean":"2023-11-18T19:24:18.653285+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:18.653285+0000","last_undegraded":"2023-11-18T19:24:18.653285+0000","last_fullsized":"2023-11-18T19:24:18.653285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":763,"num_object_clones":0,"num_object_copies":1526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'418","reported_seq":444,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.608296+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:24:17.608296+0000","last_peered":"2023-11-18T19:24:17.608296+0000","last_clean":"2023-11-18T19:24:17.608296+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:24:17.608296+0000","last_undegraded":"2023-11-18T19:24:17.608296+0000","last_fullsized":"2023-11-18T19:24:17.608296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":102,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":17433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":100,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4506","reported_seq":4528,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.359027+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:24:17.359027+0000","last_peered":"2023-11-18T19:24:17.359027+0000","last_clean":"2023-11-18T19:24:17.359027+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:24:17.359027+0000","last_undegraded":"2023-11-18T19:24:17.359027+0000","last_fullsized":"2023-11-18T19:24:17.359027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6027,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'937","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.671091+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:24:18.671091+0000","last_peered":"2023-11-18T19:24:18.671091+0000","last_clean":"2023-11-18T19:24:18.671091+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:24:18.671091+0000","last_undegraded":"2023-11-18T19:24:18.671091+0000","last_fullsized":"2023-11-18T19:24:18.671091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":681,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'456","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.589972+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:24:16.589972+0000","last_peered":"2023-11-18T19:24:16.589972+0000","last_clean":"2023-11-18T19:24:16.589972+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:16.589972+0000","last_undegraded":"2023-11-18T19:24:16.589972+0000","last_fullsized":"2023-11-18T19:24:16.589972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":13018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4450","reported_seq":4472,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.212131+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:24:18.212131+0000","last_peered":"2023-11-18T19:24:18.212131+0000","last_clean":"2023-11-18T19:24:18.212131+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:24:18.212131+0000","last_undegraded":"2023-11-18T19:24:18.212131+0000","last_fullsized":"2023-11-18T19:24:18.212131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53723490,"num_objects":2311,"num_object_clones":0,"num_object_copies":9244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5935,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'928","reported_seq":953,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.637353+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:24:18.637353+0000","last_peered":"2023-11-18T19:24:18.637353+0000","last_clean":"2023-11-18T19:24:18.637353+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:18.637353+0000","last_undegraded":"2023-11-18T19:24:18.637353+0000","last_fullsized":"2023-11-18T19:24:18.637353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":714,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'282","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.930334+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:24:16.930334+0000","last_peered":"2023-11-18T19:24:16.930334+0000","last_clean":"2023-11-18T19:24:16.930334+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:24:16.930334+0000","last_undegraded":"2023-11-18T19:24:16.930334+0000","last_fullsized":"2023-11-18T19:24:16.930334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":445,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4486","reported_seq":4509,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.191198+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:24:18.191198+0000","last_peered":"2023-11-18T19:24:18.191198+0000","last_clean":"2023-11-18T19:24:18.191198+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:18.191198+0000","last_undegraded":"2023-11-18T19:24:18.191198+0000","last_fullsized":"2023-11-18T19:24:18.191198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58452634,"num_objects":2264,"num_object_clones":0,"num_object_copies":9056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5975,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'899","reported_seq":924,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.657490+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:24:18.657490+0000","last_peered":"2023-11-18T19:24:18.657490+0000","last_clean":"2023-11-18T19:24:18.657490+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:18.657490+0000","last_undegraded":"2023-11-18T19:24:18.657490+0000","last_fullsized":"2023-11-18T19:24:18.657490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":673,"num_object_clones":0,"num_object_copies":1346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'523","reported_seq":549,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:20.290597+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:24:20.290597+0000","last_peered":"2023-11-18T19:24:20.290597+0000","last_clean":"2023-11-18T19:24:20.290597+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:20.290597+0000","last_undegraded":"2023-11-18T19:24:20.290597+0000","last_fullsized":"2023-11-18T19:24:20.290597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1034,"num_write_kb":20768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4478","reported_seq":4501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.817787+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:24:17.817787+0000","last_peered":"2023-11-18T19:24:17.817787+0000","last_clean":"2023-11-18T19:24:17.817787+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:24:17.817787+0000","last_undegraded":"2023-11-18T19:24:17.817787+0000","last_fullsized":"2023-11-18T19:24:17.817787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4478,"log_dups_size":0,"ondisk_log_size":4478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41932084,"num_objects":2267,"num_object_clones":0,"num_object_copies":9068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5962,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'926","reported_seq":951,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.658697+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:24:18.658697+0000","last_peered":"2023-11-18T19:24:18.658697+0000","last_clean":"2023-11-18T19:24:18.658697+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:18.658697+0000","last_undegraded":"2023-11-18T19:24:18.658697+0000","last_fullsized":"2023-11-18T19:24:18.658697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'290","reported_seq":316,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.245000+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:24:16.245000+0000","last_peered":"2023-11-18T19:24:16.245000+0000","last_clean":"2023-11-18T19:24:16.245000+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:24:16.245000+0000","last_undegraded":"2023-11-18T19:24:16.245000+0000","last_fullsized":"2023-11-18T19:24:16.245000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":21523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4524","reported_seq":4547,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.151065+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:24:18.151065+0000","last_peered":"2023-11-18T19:24:18.151065+0000","last_clean":"2023-11-18T19:24:18.151065+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:24:18.151065+0000","last_undegraded":"2023-11-18T19:24:18.151065+0000","last_fullsized":"2023-11-18T19:24:18.151065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41011562,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6009,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'901","reported_seq":925,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.660928+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:24:18.660928+0000","last_peered":"2023-11-18T19:24:18.660928+0000","last_clean":"2023-11-18T19:24:18.660928+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:18.660928+0000","last_undegraded":"2023-11-18T19:24:18.660928+0000","last_fullsized":"2023-11-18T19:24:18.660928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":685,"num_object_clones":0,"num_object_copies":1370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'461","reported_seq":486,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.158176+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:24:17.158176+0000","last_peered":"2023-11-18T19:24:17.158176+0000","last_clean":"2023-11-18T19:24:17.158176+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:17.158176+0000","last_undegraded":"2023-11-18T19:24:17.158176+0000","last_fullsized":"2023-11-18T19:24:17.158176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":17286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":72,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4455","reported_seq":4478,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.881164+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:24:17.881164+0000","last_peered":"2023-11-18T19:24:17.881164+0000","last_clean":"2023-11-18T19:24:17.881164+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:24:17.881164+0000","last_undegraded":"2023-11-18T19:24:17.881164+0000","last_fullsized":"2023-11-18T19:24:17.881164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4455,"log_dups_size":0,"ondisk_log_size":4455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47540604,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5953,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'938","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674306+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:24:18.674306+0000","last_peered":"2023-11-18T19:24:18.674306+0000","last_clean":"2023-11-18T19:24:18.674306+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:18.674306+0000","last_undegraded":"2023-11-18T19:24:18.674306+0000","last_fullsized":"2023-11-18T19:24:18.674306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1168","reported_seq":1194,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.910696+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:24:16.910696+0000","last_peered":"2023-11-18T19:24:16.910696+0000","last_clean":"2023-11-18T19:24:16.910696+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:24:16.910696+0000","last_undegraded":"2023-11-18T19:24:16.910696+0000","last_fullsized":"2023-11-18T19:24:16.910696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1168,"log_dups_size":0,"ondisk_log_size":1168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1330,"num_write_kb":46630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4463","reported_seq":4489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.226725+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:24:18.226725+0000","last_peered":"2023-11-18T19:24:18.226725+0000","last_clean":"2023-11-18T19:24:18.226725+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:24:18.226725+0000","last_undegraded":"2023-11-18T19:24:18.226725+0000","last_fullsized":"2023-11-18T19:24:18.226725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4463,"log_dups_size":0,"ondisk_log_size":4463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39429542,"num_objects":2302,"num_object_clones":0,"num_object_copies":9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5965,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'934","reported_seq":958,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.643656+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:24:18.643656+0000","last_peered":"2023-11-18T19:24:18.643656+0000","last_clean":"2023-11-18T19:24:18.643656+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:18.643656+0000","last_undegraded":"2023-11-18T19:24:18.643656+0000","last_fullsized":"2023-11-18T19:24:18.643656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":724,"num_object_clones":0,"num_object_copies":1448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1376","reported_seq":2237,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.604572+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:24:18.604572+0000","last_peered":"2023-11-18T19:24:18.604572+0000","last_clean":"2023-11-18T19:24:18.604572+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:18.604572+0000","last_undegraded":"2023-11-18T19:24:18.604572+0000","last_fullsized":"2023-11-18T19:24:18.604572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1376,"log_dups_size":0,"ondisk_log_size":1376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9652249,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":836,"num_read_kb":1816,"num_write":1557,"num_write_kb":23339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4389","reported_seq":4413,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.185051+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:24:18.185051+0000","last_peered":"2023-11-18T19:24:18.185051+0000","last_clean":"2023-11-18T19:24:18.185051+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:24:18.185051+0000","last_undegraded":"2023-11-18T19:24:18.185051+0000","last_fullsized":"2023-11-18T19:24:18.185051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4389,"log_dups_size":0,"ondisk_log_size":4389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52629501,"num_objects":2217,"num_object_clones":0,"num_object_copies":8868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5791,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'883","reported_seq":908,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.662620+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:24:18.662620+0000","last_peered":"2023-11-18T19:24:18.662620+0000","last_clean":"2023-11-18T19:24:18.662620+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:18.662620+0000","last_undegraded":"2023-11-18T19:24:18.662620+0000","last_fullsized":"2023-11-18T19:24:18.662620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":684,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'475","reported_seq":501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.840415+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:24:16.840415+0000","last_peered":"2023-11-18T19:24:16.840415+0000","last_clean":"2023-11-18T19:24:16.840415+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:24:16.840415+0000","last_undegraded":"2023-11-18T19:24:16.840415+0000","last_fullsized":"2023-11-18T19:24:16.840415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":29626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":84,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4557","reported_seq":4580,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.592298+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:24:17.592298+0000","last_peered":"2023-11-18T19:24:17.592298+0000","last_clean":"2023-11-18T19:24:17.592298+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:24:17.592298+0000","last_undegraded":"2023-11-18T19:24:17.592298+0000","last_fullsized":"2023-11-18T19:24:17.592298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4557,"log_dups_size":0,"ondisk_log_size":4557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43888851,"num_objects":2286,"num_object_clones":0,"num_object_copies":9144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6057,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'939","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.665073+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:24:18.665073+0000","last_peered":"2023-11-18T19:24:18.665073+0000","last_clean":"2023-11-18T19:24:18.665073+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:18.665073+0000","last_undegraded":"2023-11-18T19:24:18.665073+0000","last_fullsized":"2023-11-18T19:24:18.665073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":727,"num_object_clones":0,"num_object_copies":1454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'395","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.465313+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:24:16.465313+0000","last_peered":"2023-11-18T19:24:16.465313+0000","last_clean":"2023-11-18T19:24:16.465313+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:24:16.465313+0000","last_undegraded":"2023-11-18T19:24:16.465313+0000","last_fullsized":"2023-11-18T19:24:16.465313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":17537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:20:35.780144+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:20:35.780144+0000","last_peered":"2023-11-18T19:20:35.780144+0000","last_clean":"2023-11-18T19:20:35.780144+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:20:35.780144+0000","last_undegraded":"2023-11-18T19:20:35.780144+0000","last_fullsized":"2023-11-18T19:20:35.780144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:24:48.318265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4382","reported_seq":4405,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.285278+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:24:17.285278+0000","last_peered":"2023-11-18T19:24:17.285278+0000","last_clean":"2023-11-18T19:24:17.285278+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:24:17.285278+0000","last_undegraded":"2023-11-18T19:24:17.285278+0000","last_fullsized":"2023-11-18T19:24:17.285278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4382,"log_dups_size":0,"ondisk_log_size":4382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47903098,"num_objects":2231,"num_object_clones":0,"num_object_copies":8924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5818,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'928","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668320+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:24:18.668320+0000","last_peered":"2023-11-18T19:24:18.668320+0000","last_clean":"2023-11-18T19:24:18.668320+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:24:18.668320+0000","last_undegraded":"2023-11-18T19:24:18.668320+0000","last_fullsized":"2023-11-18T19:24:18.668320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'449","reported_seq":474,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.852043+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:24:17.852043+0000","last_peered":"2023-11-18T19:24:17.852043+0000","last_clean":"2023-11-18T19:24:17.852043+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:24:17.852043+0000","last_undegraded":"2023-11-18T19:24:17.852043+0000","last_fullsized":"2023-11-18T19:24:17.852043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":630,"num_write_kb":29777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4528","reported_seq":4551,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.183204+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:24:18.183204+0000","last_peered":"2023-11-18T19:24:18.183204+0000","last_clean":"2023-11-18T19:24:18.183204+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:24:18.183204+0000","last_undegraded":"2023-11-18T19:24:18.183204+0000","last_fullsized":"2023-11-18T19:24:18.183204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54570935,"num_objects":2278,"num_object_clones":0,"num_object_copies":9112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5986,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'912","reported_seq":935,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.683557+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:24:18.683557+0000","last_peered":"2023-11-18T19:24:18.683557+0000","last_clean":"2023-11-18T19:24:18.683557+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:18.683557+0000","last_undegraded":"2023-11-18T19:24:18.683557+0000","last_fullsized":"2023-11-18T19:24:18.683557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":677,"num_object_clones":0,"num_object_copies":1354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":735,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'882","reported_seq":906,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.495810+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:24:17.495810+0000","last_peered":"2023-11-18T19:24:17.495810+0000","last_clean":"2023-11-18T19:24:17.495810+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:24:17.495810+0000","last_undegraded":"2023-11-18T19:24:17.495810+0000","last_fullsized":"2023-11-18T19:24:17.495810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":34274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4569","reported_seq":4592,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.188274+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:24:18.188274+0000","last_peered":"2023-11-18T19:24:18.188274+0000","last_clean":"2023-11-18T19:24:18.188274+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:24:18.188274+0000","last_undegraded":"2023-11-18T19:24:18.188274+0000","last_fullsized":"2023-11-18T19:24:18.188274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4569,"log_dups_size":0,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46904542,"num_objects":2317,"num_object_clones":0,"num_object_copies":9268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2317,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6069,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'923","reported_seq":946,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.681245+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:24:18.681245+0000","last_peered":"2023-11-18T19:24:18.681245+0000","last_clean":"2023-11-18T19:24:18.681245+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:24:18.681245+0000","last_undegraded":"2023-11-18T19:24:18.681245+0000","last_fullsized":"2023-11-18T19:24:18.681245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'581","reported_seq":606,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.078076+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:24:17.078076+0000","last_peered":"2023-11-18T19:24:17.078076+0000","last_clean":"2023-11-18T19:24:17.078076+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:17.078076+0000","last_undegraded":"2023-11-18T19:24:17.078076+0000","last_fullsized":"2023-11-18T19:24:17.078076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":727,"num_write_kb":21480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":76,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4687","reported_seq":4712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.329251+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:24:17.329251+0000","last_peered":"2023-11-18T19:24:17.329251+0000","last_clean":"2023-11-18T19:24:17.329251+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:24:17.329251+0000","last_undegraded":"2023-11-18T19:24:17.329251+0000","last_fullsized":"2023-11-18T19:24:17.329251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4687,"log_dups_size":0,"ondisk_log_size":4687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53454220,"num_objects":2315,"num_object_clones":0,"num_object_copies":9260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2315,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6231,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'933","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.680285+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:24:18.680285+0000","last_peered":"2023-11-18T19:24:18.680285+0000","last_clean":"2023-11-18T19:24:18.680285+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:18.680285+0000","last_undegraded":"2023-11-18T19:24:18.680285+0000","last_fullsized":"2023-11-18T19:24:18.680285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'289","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.527795+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:24:16.527795+0000","last_peered":"2023-11-18T19:24:16.527795+0000","last_clean":"2023-11-18T19:24:16.527795+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:16.527795+0000","last_undegraded":"2023-11-18T19:24:16.527795+0000","last_fullsized":"2023-11-18T19:24:16.527795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":439,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4440","reported_seq":4465,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.166110+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:24:18.166110+0000","last_peered":"2023-11-18T19:24:18.166110+0000","last_clean":"2023-11-18T19:24:18.166110+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:18.166110+0000","last_undegraded":"2023-11-18T19:24:18.166110+0000","last_fullsized":"2023-11-18T19:24:18.166110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:03.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5875,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'974","reported_seq":998,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.672213+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:24:18.672213+0000","last_peered":"2023-11-18T19:24:18.672213+0000","last_clean":"2023-11-18T19:24:18.672213+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:18.672213+0000","last_undegraded":"2023-11-18T19:24:18.672213+0000","last_fullsized":"2023-11-18T19:24:18.672213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'351","reported_seq":376,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.963933+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:24:16.963933+0000","last_peered":"2023-11-18T19:24:16.963933+0000","last_clean":"2023-11-18T19:24:16.963933+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:16.963933+0000","last_undegraded":"2023-11-18T19:24:16.963933+0000","last_fullsized":"2023-11-18T19:24:16.963933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":555,"num_write_kb":13205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4401","reported_seq":4432,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.202893+0000","last_change":"2023-11-18T19:07:25.182659+0000","last_active":"2023-11-18T19:24:18.202893+0000","last_peered":"2023-11-18T19:24:18.202893+0000","last_clean":"2023-11-18T19:24:18.202893+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:24:18.202893+0000","last_undegraded":"2023-11-18T19:24:18.202893+0000","last_fullsized":"2023-11-18T19:24:18.202893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40895696,"num_objects":2243,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5822,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'917","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.150031+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:24:18.150031+0000","last_peered":"2023-11-18T19:24:18.150031+0000","last_clean":"2023-11-18T19:24:18.150031+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:18.150031+0000","last_undegraded":"2023-11-18T19:24:18.150031+0000","last_fullsized":"2023-11-18T19:24:18.150031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'268","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.413179+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:24:16.413179+0000","last_peered":"2023-11-18T19:24:16.413179+0000","last_clean":"2023-11-18T19:24:16.413179+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:16.413179+0000","last_undegraded":"2023-11-18T19:24:16.413179+0000","last_fullsized":"2023-11-18T19:24:16.413179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":457,"num_write_kb":9272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4553","reported_seq":4575,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.202932+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:24:18.202932+0000","last_peered":"2023-11-18T19:24:18.202932+0000","last_clean":"2023-11-18T19:24:18.202932+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:24:18.202932+0000","last_undegraded":"2023-11-18T19:24:18.202932+0000","last_fullsized":"2023-11-18T19:24:18.202932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4553,"log_dups_size":0,"ondisk_log_size":4553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39856077,"num_objects":2313,"num_object_clones":0,"num_object_copies":9252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6058,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'926","reported_seq":957,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.639637+0000","last_change":"2023-11-18T19:07:25.179515+0000","last_active":"2023-11-18T19:24:18.639637+0000","last_peered":"2023-11-18T19:24:18.639637+0000","last_clean":"2023-11-18T19:24:18.639637+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:18.639637+0000","last_undegraded":"2023-11-18T19:24:18.639637+0000","last_fullsized":"2023-11-18T19:24:18.639637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:56.657976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":713,"num_object_clones":0,"num_object_copies":1426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'418","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.466544+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:24:16.466544+0000","last_peered":"2023-11-18T19:24:16.466544+0000","last_clean":"2023-11-18T19:24:16.466544+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:24:16.466544+0000","last_undegraded":"2023-11-18T19:24:16.466544+0000","last_fullsized":"2023-11-18T19:24:16.466544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":638,"num_write_kb":5589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":111,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4341","reported_seq":4363,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.230685+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:24:18.230685+0000","last_peered":"2023-11-18T19:24:18.230685+0000","last_clean":"2023-11-18T19:24:18.230685+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:24:18.230685+0000","last_undegraded":"2023-11-18T19:24:18.230685+0000","last_fullsized":"2023-11-18T19:24:18.230685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4341,"log_dups_size":0,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54095014,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5784,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'881","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.662992+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:24:18.662992+0000","last_peered":"2023-11-18T19:24:18.662992+0000","last_clean":"2023-11-18T19:24:18.662992+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:18.662992+0000","last_undegraded":"2023-11-18T19:24:18.662992+0000","last_fullsized":"2023-11-18T19:24:18.662992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":676,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'363","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.816745+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:24:16.816745+0000","last_peered":"2023-11-18T19:24:16.816745+0000","last_clean":"2023-11-18T19:24:16.816745+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:16.816745+0000","last_undegraded":"2023-11-18T19:24:16.816745+0000","last_fullsized":"2023-11-18T19:24:16.816745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":563,"num_write_kb":17467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4331","reported_seq":4353,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.152919+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:24:18.152919+0000","last_peered":"2023-11-18T19:24:18.152919+0000","last_clean":"2023-11-18T19:24:18.152919+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:24:18.152919+0000","last_undegraded":"2023-11-18T19:24:18.152919+0000","last_fullsized":"2023-11-18T19:24:18.152919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":0,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46166125,"num_objects":2199,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5801,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'898","reported_seq":921,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.682351+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:24:18.682351+0000","last_peered":"2023-11-18T19:24:18.682351+0000","last_clean":"2023-11-18T19:24:18.682351+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:18.682351+0000","last_undegraded":"2023-11-18T19:24:18.682351+0000","last_fullsized":"2023-11-18T19:24:18.682351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":687,"num_object_clones":0,"num_object_copies":1374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'589","reported_seq":613,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.900589+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:24:16.900589+0000","last_peered":"2023-11-18T19:24:16.900589+0000","last_clean":"2023-11-18T19:24:16.900589+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:16.900589+0000","last_undegraded":"2023-11-18T19:24:16.900589+0000","last_fullsized":"2023-11-18T19:24:16.900589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":789,"num_write_kb":29986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4332","reported_seq":4354,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.167860+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:24:18.167860+0000","last_peered":"2023-11-18T19:24:18.167860+0000","last_clean":"2023-11-18T19:24:18.167860+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:24:18.167860+0000","last_undegraded":"2023-11-18T19:24:18.167860+0000","last_fullsized":"2023-11-18T19:24:18.167860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53099612,"num_objects":2240,"num_object_clones":0,"num_object_copies":8960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5730,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'909","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668923+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:24:18.668923+0000","last_peered":"2023-11-18T19:24:18.668923+0000","last_clean":"2023-11-18T19:24:18.668923+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:18.668923+0000","last_undegraded":"2023-11-18T19:24:18.668923+0000","last_fullsized":"2023-11-18T19:24:18.668923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'758","reported_seq":782,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.966795+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:24:17.966795+0000","last_peered":"2023-11-18T19:24:17.966795+0000","last_clean":"2023-11-18T19:24:17.966795+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:17.966795+0000","last_undegraded":"2023-11-18T19:24:17.966795+0000","last_fullsized":"2023-11-18T19:24:17.966795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":946,"num_write_kb":22041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":97,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4430","reported_seq":4452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.211353+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:24:18.211353+0000","last_peered":"2023-11-18T19:24:18.211353+0000","last_clean":"2023-11-18T19:24:18.211353+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:18.211353+0000","last_undegraded":"2023-11-18T19:24:18.211353+0000","last_fullsized":"2023-11-18T19:24:18.211353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879149,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5939,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'926","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.650913+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:24:18.650913+0000","last_peered":"2023-11-18T19:24:18.650913+0000","last_clean":"2023-11-18T19:24:18.650913+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:18.650913+0000","last_undegraded":"2023-11-18T19:24:18.650913+0000","last_fullsized":"2023-11-18T19:24:18.650913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'360","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.592044+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:24:16.592044+0000","last_peered":"2023-11-18T19:24:16.592044+0000","last_clean":"2023-11-18T19:24:16.592044+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:24:16.592044+0000","last_undegraded":"2023-11-18T19:24:16.592044+0000","last_fullsized":"2023-11-18T19:24:16.592044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":532,"num_write_kb":25814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4341","reported_seq":4364,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.391367+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:24:17.391367+0000","last_peered":"2023-11-18T19:24:17.391367+0000","last_clean":"2023-11-18T19:24:17.391367+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:17.391367+0000","last_undegraded":"2023-11-18T19:24:17.391367+0000","last_fullsized":"2023-11-18T19:24:17.391367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4341,"log_dups_size":0,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66632640,"num_objects":2174,"num_object_clones":0,"num_object_copies":8696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5756,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'914","reported_seq":937,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674590+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:24:18.674590+0000","last_peered":"2023-11-18T19:24:18.674590+0000","last_clean":"2023-11-18T19:24:18.674590+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:18.674590+0000","last_undegraded":"2023-11-18T19:24:18.674590+0000","last_fullsized":"2023-11-18T19:24:18.674590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":914,"log_dups_size":0,"ondisk_log_size":914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":677,"num_object_clones":0,"num_object_copies":1354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":741,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1205","reported_seq":1229,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.350366+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:24:17.350366+0000","last_peered":"2023-11-18T19:24:17.350366+0000","last_clean":"2023-11-18T19:24:17.350366+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:17.350366+0000","last_undegraded":"2023-11-18T19:24:17.350366+0000","last_fullsized":"2023-11-18T19:24:17.350366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:08.678189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1356,"num_write_kb":21994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4581","reported_seq":4612,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.760373+0000","last_change":"2023-11-18T19:07:25.179857+0000","last_active":"2023-11-18T19:24:17.760373+0000","last_peered":"2023-11-18T19:24:17.760373+0000","last_clean":"2023-11-18T19:24:17.760373+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:24:17.760373+0000","last_undegraded":"2023-11-18T19:24:17.760373+0000","last_fullsized":"2023-11-18T19:24:17.760373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4581,"log_dups_size":0,"ondisk_log_size":4581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111025,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6106,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4330","reported_seq":4354,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.474658+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:24:17.474658+0000","last_peered":"2023-11-18T19:24:17.474658+0000","last_clean":"2023-11-18T19:24:17.474658+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:24:17.474658+0000","last_undegraded":"2023-11-18T19:24:17.474658+0000","last_fullsized":"2023-11-18T19:24:17.474658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4330,"log_dups_size":0,"ondisk_log_size":4330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32576492,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5728,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'928","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.218048+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:24:18.218048+0000","last_peered":"2023-11-18T19:24:18.218048+0000","last_clean":"2023-11-18T19:24:18.218048+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:18.218048+0000","last_undegraded":"2023-11-18T19:24:18.218048+0000","last_fullsized":"2023-11-18T19:24:18.218048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":711,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'518","reported_seq":543,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:16.918781+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:24:16.918781+0000","last_peered":"2023-11-18T19:24:16.918781+0000","last_clean":"2023-11-18T19:24:16.918781+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:24:16.918781+0000","last_undegraded":"2023-11-18T19:24:16.918781+0000","last_fullsized":"2023-11-18T19:24:16.918781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":685,"num_write_kb":37722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4318","reported_seq":4341,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.222818+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:24:17.222818+0000","last_peered":"2023-11-18T19:24:17.222818+0000","last_clean":"2023-11-18T19:24:17.222818+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:24:17.222818+0000","last_undegraded":"2023-11-18T19:24:17.222818+0000","last_fullsized":"2023-11-18T19:24:17.222818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4318,"log_dups_size":0,"ondisk_log_size":4318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48972751,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5731,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'988","reported_seq":1011,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.657158+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:24:18.657158+0000","last_peered":"2023-11-18T19:24:18.657158+0000","last_clean":"2023-11-18T19:24:18.657158+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:18.657158+0000","last_undegraded":"2023-11-18T19:24:18.657158+0000","last_fullsized":"2023-11-18T19:24:18.657158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":793,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'301","reported_seq":326,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.531564+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:24:17.531564+0000","last_peered":"2023-11-18T19:24:17.531564+0000","last_clean":"2023-11-18T19:24:17.531564+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:17.531564+0000","last_undegraded":"2023-11-18T19:24:17.531564+0000","last_fullsized":"2023-11-18T19:24:17.531564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":17232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'663","reported_seq":688,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:23:56.458428+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:23:56.458428+0000","last_peered":"2023-11-18T19:23:56.458428+0000","last_clean":"2023-11-18T19:23:56.458428+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:23:56.458428+0000","last_undegraded":"2023-11-18T19:23:56.458428+0000","last_fullsized":"2023-11-18T19:23:56.458428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":33791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":77,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'925","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.676895+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:24:18.676895+0000","last_peered":"2023-11-18T19:24:18.676895+0000","last_clean":"2023-11-18T19:24:18.676895+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:18.676895+0000","last_undegraded":"2023-11-18T19:24:18.676895+0000","last_fullsized":"2023-11-18T19:24:18.676895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4528","reported_seq":4550,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.232806+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:24:18.232806+0000","last_peered":"2023-11-18T19:24:18.232806+0000","last_clean":"2023-11-18T19:24:18.232806+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:24:18.232806+0000","last_undegraded":"2023-11-18T19:24:18.232806+0000","last_fullsized":"2023-11-18T19:24:18.232806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50816520,"num_objects":2330,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6037,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'243","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:17.574935+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:24:17.574935+0000","last_peered":"2023-11-18T19:24:17.574935+0000","last_clean":"2023-11-18T19:24:17.574935+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:24:17.574935+0000","last_undegraded":"2023-11-18T19:24:17.574935+0000","last_fullsized":"2023-11-18T19:24:17.574935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":17256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":82,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'924","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.660411+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:24:18.660411+0000","last_peered":"2023-11-18T19:24:18.660411+0000","last_clean":"2023-11-18T19:24:18.660411+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:18.660411+0000","last_undegraded":"2023-11-18T19:24:18.660411+0000","last_fullsized":"2023-11-18T19:24:18.660411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4556","reported_seq":4578,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.162952+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:24:18.162952+0000","last_peered":"2023-11-18T19:24:18.162952+0000","last_clean":"2023-11-18T19:24:18.162952+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:24:18.162952+0000","last_undegraded":"2023-11-18T19:24:18.162952+0000","last_fullsized":"2023-11-18T19:24:18.162952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38511782,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6085,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'942","reported_seq":966,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.659248+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:24:18.659248+0000","last_peered":"2023-11-18T19:24:18.659248+0000","last_clean":"2023-11-18T19:24:18.659248+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:18.659248+0000","last_undegraded":"2023-11-18T19:24:18.659248+0000","last_fullsized":"2023-11-18T19:24:18.659248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":707,"num_object_clones":0,"num_object_copies":1414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":707,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'983","reported_seq":1007,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.652053+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:24:18.652053+0000","last_peered":"2023-11-18T19:24:18.652053+0000","last_clean":"2023-11-18T19:24:18.652053+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:18.652053+0000","last_undegraded":"2023-11-18T19:24:18.652053+0000","last_fullsized":"2023-11-18T19:24:18.652053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'931","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656415+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:24:18.656415+0000","last_peered":"2023-11-18T19:24:18.656415+0000","last_clean":"2023-11-18T19:24:18.656415+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:18.656415+0000","last_undegraded":"2023-11-18T19:24:18.656415+0000","last_fullsized":"2023-11-18T19:24:18.656415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":696,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'948","reported_seq":972,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.647998+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:24:18.647998+0000","last_peered":"2023-11-18T19:24:18.647998+0000","last_clean":"2023-11-18T19:24:18.647998+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:18.647998+0000","last_undegraded":"2023-11-18T19:24:18.647998+0000","last_fullsized":"2023-11-18T19:24:18.647998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'927","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.680319+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:24:18.680319+0000","last_peered":"2023-11-18T19:24:18.680319+0000","last_clean":"2023-11-18T19:24:18.680319+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:24:18.680319+0000","last_undegraded":"2023-11-18T19:24:18.680319+0000","last_fullsized":"2023-11-18T19:24:18.680319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":722,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'914","reported_seq":939,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.655077+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:24:18.655077+0000","last_peered":"2023-11-18T19:24:18.655077+0000","last_clean":"2023-11-18T19:24:18.655077+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:24:18.655077+0000","last_undegraded":"2023-11-18T19:24:18.655077+0000","last_fullsized":"2023-11-18T19:24:18.655077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":914,"log_dups_size":0,"ondisk_log_size":914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'978","reported_seq":1002,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.673713+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:24:18.673713+0000","last_peered":"2023-11-18T19:24:18.673713+0000","last_clean":"2023-11-18T19:24:18.673713+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:18.673713+0000","last_undegraded":"2023-11-18T19:24:18.673713+0000","last_fullsized":"2023-11-18T19:24:18.673713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":790,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'911","reported_seq":935,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.666221+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:24:18.666221+0000","last_peered":"2023-11-18T19:24:18.666221+0000","last_clean":"2023-11-18T19:24:18.666221+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:24:18.666221+0000","last_undegraded":"2023-11-18T19:24:18.666221+0000","last_fullsized":"2023-11-18T19:24:18.666221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":670,"num_object_clones":0,"num_object_copies":1340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'936","reported_seq":961,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.652337+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:24:18.652337+0000","last_peered":"2023-11-18T19:24:18.652337+0000","last_clean":"2023-11-18T19:24:18.652337+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:18.652337+0000","last_undegraded":"2023-11-18T19:24:18.652337+0000","last_fullsized":"2023-11-18T19:24:18.652337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":700,"num_object_clones":0,"num_object_copies":1400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":700,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'895","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.165722+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:24:18.165722+0000","last_peered":"2023-11-18T19:24:18.165722+0000","last_clean":"2023-11-18T19:24:18.165722+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:18.165722+0000","last_undegraded":"2023-11-18T19:24:18.165722+0000","last_fullsized":"2023-11-18T19:24:18.165722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'933","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678232+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:24:18.678232+0000","last_peered":"2023-11-18T19:24:18.678232+0000","last_clean":"2023-11-18T19:24:18.678232+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:18.678232+0000","last_undegraded":"2023-11-18T19:24:18.678232+0000","last_fullsized":"2023-11-18T19:24:18.678232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":703,"num_object_clones":0,"num_object_copies":1406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'934","reported_seq":958,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.665083+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:24:18.665083+0000","last_peered":"2023-11-18T19:24:18.665083+0000","last_clean":"2023-11-18T19:24:18.665083+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:18.665083+0000","last_undegraded":"2023-11-18T19:24:18.665083+0000","last_fullsized":"2023-11-18T19:24:18.665083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'948","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678688+0000","last_change":"2023-11-18T19:06:37.568642+0000","last_active":"2023-11-18T19:24:18.678688+0000","last_peered":"2023-11-18T19:24:18.678688+0000","last_clean":"2023-11-18T19:24:18.678688+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:18.678688+0000","last_undegraded":"2023-11-18T19:24:18.678688+0000","last_fullsized":"2023-11-18T19:24:18.678688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":703,"num_object_clones":0,"num_object_copies":1406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'946","reported_seq":970,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.664244+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:24:18.664244+0000","last_peered":"2023-11-18T19:24:18.664244+0000","last_clean":"2023-11-18T19:24:18.664244+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:24:18.664244+0000","last_undegraded":"2023-11-18T19:24:18.664244+0000","last_fullsized":"2023-11-18T19:24:18.664244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":726,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'886","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.666814+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:24:18.666814+0000","last_peered":"2023-11-18T19:24:18.666814+0000","last_clean":"2023-11-18T19:24:18.666814+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:18.666814+0000","last_undegraded":"2023-11-18T19:24:18.666814+0000","last_fullsized":"2023-11-18T19:24:18.666814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'967","reported_seq":991,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.675162+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:24:18.675162+0000","last_peered":"2023-11-18T19:24:18.675162+0000","last_clean":"2023-11-18T19:24:18.675162+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:18.675162+0000","last_undegraded":"2023-11-18T19:24:18.675162+0000","last_fullsized":"2023-11-18T19:24:18.675162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'893","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.668601+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:24:18.668601+0000","last_peered":"2023-11-18T19:24:18.668601+0000","last_clean":"2023-11-18T19:24:18.668601+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:18.668601+0000","last_undegraded":"2023-11-18T19:24:18.668601+0000","last_fullsized":"2023-11-18T19:24:18.668601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":672,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'938","reported_seq":961,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.680678+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:24:18.680678+0000","last_peered":"2023-11-18T19:24:18.680678+0000","last_clean":"2023-11-18T19:24:18.680678+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:18.680678+0000","last_undegraded":"2023-11-18T19:24:18.680678+0000","last_fullsized":"2023-11-18T19:24:18.680678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":723,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'884","reported_seq":908,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656604+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:24:18.656604+0000","last_peered":"2023-11-18T19:24:18.656604+0000","last_clean":"2023-11-18T19:24:18.656604+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:18.656604+0000","last_undegraded":"2023-11-18T19:24:18.656604+0000","last_fullsized":"2023-11-18T19:24:18.656604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":676,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'909","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.677535+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:24:18.677535+0000","last_peered":"2023-11-18T19:24:18.677535+0000","last_clean":"2023-11-18T19:24:18.677535+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:18.677535+0000","last_undegraded":"2023-11-18T19:24:18.677535+0000","last_fullsized":"2023-11-18T19:24:18.677535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'891","reported_seq":914,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.671452+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:24:18.671452+0000","last_peered":"2023-11-18T19:24:18.671452+0000","last_clean":"2023-11-18T19:24:18.671452+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:18.671452+0000","last_undegraded":"2023-11-18T19:24:18.671452+0000","last_fullsized":"2023-11-18T19:24:18.671452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":691,"num_object_clones":0,"num_object_copies":1382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'915","reported_seq":938,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.678923+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:24:18.678923+0000","last_peered":"2023-11-18T19:24:18.678923+0000","last_clean":"2023-11-18T19:24:18.678923+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:24:18.678923+0000","last_undegraded":"2023-11-18T19:24:18.678923+0000","last_fullsized":"2023-11-18T19:24:18.678923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":705,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":705,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'899","reported_seq":922,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674409+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:24:18.674409+0000","last_peered":"2023-11-18T19:24:18.674409+0000","last_clean":"2023-11-18T19:24:18.674409+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:24:18.674409+0000","last_undegraded":"2023-11-18T19:24:18.674409+0000","last_fullsized":"2023-11-18T19:24:18.674409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":695,"num_object_clones":0,"num_object_copies":1390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":737,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'964","reported_seq":987,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.664810+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:24:18.664810+0000","last_peered":"2023-11-18T19:24:18.664810+0000","last_clean":"2023-11-18T19:24:18.664810+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:18.664810+0000","last_undegraded":"2023-11-18T19:24:18.664810+0000","last_fullsized":"2023-11-18T19:24:18.664810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'884","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.679404+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:24:18.679404+0000","last_peered":"2023-11-18T19:24:18.679404+0000","last_clean":"2023-11-18T19:24:18.679404+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:18.679404+0000","last_undegraded":"2023-11-18T19:24:18.679404+0000","last_fullsized":"2023-11-18T19:24:18.679404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":693,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'929","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.672747+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:24:18.672747+0000","last_peered":"2023-11-18T19:24:18.672747+0000","last_clean":"2023-11-18T19:24:18.672747+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:18.672747+0000","last_undegraded":"2023-11-18T19:24:18.672747+0000","last_fullsized":"2023-11-18T19:24:18.672747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":709,"num_object_clones":0,"num_object_copies":1418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'874","reported_seq":897,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.663072+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:24:18.663072+0000","last_peered":"2023-11-18T19:24:18.663072+0000","last_clean":"2023-11-18T19:24:18.663072+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:18.663072+0000","last_undegraded":"2023-11-18T19:24:18.663072+0000","last_fullsized":"2023-11-18T19:24:18.663072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":653,"num_object_clones":0,"num_object_copies":1306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'962","reported_seq":985,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.683616+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:24:18.683616+0000","last_peered":"2023-11-18T19:24:18.683616+0000","last_clean":"2023-11-18T19:24:18.683616+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:18.683616+0000","last_undegraded":"2023-11-18T19:24:18.683616+0000","last_fullsized":"2023-11-18T19:24:18.683616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'915","reported_seq":939,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.673251+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:24:18.673251+0000","last_peered":"2023-11-18T19:24:18.673251+0000","last_clean":"2023-11-18T19:24:18.673251+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:18.673251+0000","last_undegraded":"2023-11-18T19:24:18.673251+0000","last_fullsized":"2023-11-18T19:24:18.673251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":706,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'967","reported_seq":991,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.652586+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:24:18.652586+0000","last_peered":"2023-11-18T19:24:18.652586+0000","last_clean":"2023-11-18T19:24:18.652586+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:18.652586+0000","last_undegraded":"2023-11-18T19:24:18.652586+0000","last_fullsized":"2023-11-18T19:24:18.652586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":753,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'889","reported_seq":913,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.656778+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:24:18.656778+0000","last_peered":"2023-11-18T19:24:18.656778+0000","last_clean":"2023-11-18T19:24:18.656778+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:24:18.656778+0000","last_undegraded":"2023-11-18T19:24:18.656778+0000","last_fullsized":"2023-11-18T19:24:18.656778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":666,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'875","reported_seq":899,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:18.674270+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:24:18.674270+0000","last_peered":"2023-11-18T19:24:18.674270+0000","last_clean":"2023-11-18T19:24:18.674270+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:24:18.674270+0000","last_undegraded":"2023-11-18T19:24:18.674270+0000","last_fullsized":"2023-11-18T19:24:18.674270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":651,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":697,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1532356433,"num_objects":72338,"num_object_clones":0,"num_object_copies":289352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72338,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":189841,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2809622528,"data_stored":3820519424,"data_compressed":666760082,"data_compressed_allocated":793534464,"data_compressed_original":1804431360,"omap_allocated":0,"internal_metadata":0},"log_size":142750,"ondisk_log_size":142750,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":45205,"num_object_clones":0,"num_object_copies":90410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45205,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48633,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59290,"ondisk_log_size":59290,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":278089175,"num_objects":2885,"num_object_clones":0,"num_object_copies":5770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2885,"num_whiteouts":0,"num_read":864,"num_read_kb":1816,"num_write":22208,"num_write_kb":725855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2811,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143589376,"data_stored":556178350,"data_compressed":87603958,"data_compressed_allocated":108216320,"data_compressed_original":520863744,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509655,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":622388,"kb_used_data":374636,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93749452,"statfs":{"total":96636764160,"available":95999438848,"internally_reserved":0,"allocated":383627264,"data_stored":581182258,"data_compressed":103018895,"data_compressed_allocated":123727872,"data_compressed_original":321466368,"omap_allocated":1594,"internal_metadata":253688262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":4.327,"15min":4.8049999999999997},"min":{"1min":0.65100000000000002,"5min":0.45800000000000002,"15min":0.372},"max":{"1min":2.4529999999999998,"5min":248.00800000000001,"15min":248.00800000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.5469999999999999,"5min":4.516,"15min":5.0270000000000001},"min":{"1min":0.72899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.4210000000000003,"5min":175.095,"15min":384.19499999999999},"last":0.93999999999999995}]},{"osd":1,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":2.4630000000000001,"15min":4.0839999999999996},"min":{"1min":0.748,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":4.681,"5min":53.398000000000003,"15min":199.179},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.587,"5min":4.5679999999999996,"15min":5.2869999999999999},"min":{"1min":0.72399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":6.4619999999999997,"5min":175.06800000000001,"15min":384.09699999999998},"last":1.2}]},{"osd":2,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.952,"15min":3.2559999999999998},"min":{"1min":0.63600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.8279999999999998,"5min":15.159000000000001,"15min":207.149},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.357,"5min":2.4900000000000002,"15min":5.4939999999999998},"min":{"1min":0.71299999999999997,"5min":0.51800000000000002,"15min":0.47299999999999998},"max":{"1min":2.4969999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":1.071}]},{"osd":3,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":4.593,"15min":5.6929999999999996},"min":{"1min":0.73299999999999998,"5min":0.51400000000000001,"15min":0.44600000000000001},"max":{"1min":6.4909999999999997,"5min":175.02600000000001,"15min":384.04700000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.472,"5min":2.4580000000000002,"15min":3.4009999999999998},"min":{"1min":0.755,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":2.8700000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":3.1269999999999998,"15min":5.0049999999999999},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":4.9420000000000002,"5min":86.346999999999994,"15min":199.393},"last":0.92100000000000004},{"interface":"front","average":{"1min":2.8420000000000001,"5min":5.4690000000000003,"15min":6.5700000000000003},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":26.733000000000001,"5min":204.786,"15min":384.161},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":3.1309999999999998,"15min":4.4429999999999996},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":2.8959999999999999,"5min":79.472999999999999,"15min":220.36500000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":2.0169999999999999,"5min":4.9050000000000002,"15min":5.5800000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":6.2699999999999996,"5min":160.107,"15min":212.68100000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":5.1760000000000002,"15min":8.9359999999999999},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":6.8769999999999998,"5min":205.01400000000001,"15min":410.60000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":2.8530000000000002,"5min":2.6150000000000002,"15min":4.0279999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":21.158000000000001,"5min":28.329999999999998,"15min":207.85300000000001},"last":0.53500000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509656,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":574512,"kb_used_data":326760,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93797328,"statfs":{"total":96636764160,"available":96048463872,"internally_reserved":0,"allocated":334602240,"data_stored":502017479,"data_compressed":82625659,"data_compressed_allocated":99524608,"data_compressed_original":267137024,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.5720000000000001,"15min":4.1859999999999999},"min":{"1min":0.73999999999999999,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":8.1440000000000001,"5min":14.576000000000001,"15min":248.32400000000001},"last":0.625},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.7689999999999999,"15min":2.7909999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.3959999999999999,"5min":26.890000000000001,"15min":93.090999999999994},"last":1.2190000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":2.113,"15min":5.3600000000000003},"min":{"1min":0.84199999999999997,"5min":0.49199999999999999,"15min":0.47899999999999998},"max":{"1min":7.9390000000000001,"5min":41.881,"15min":335.11799999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":2.8999999999999999,"5min":2.0619999999999998,"15min":3.9340000000000002},"min":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.432},"max":{"1min":22.524000000000001,"5min":22.524000000000001,"15min":278.17700000000002},"last":0.69299999999999995}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":2.3849999999999998,"15min":3.5470000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":36.954999999999998,"5min":50.735999999999997,"15min":144.68700000000001},"last":1.135},{"interface":"front","average":{"1min":1.893,"5min":2.0230000000000001,"15min":3.7120000000000002},"min":{"1min":0.77200000000000002,"5min":0.56499999999999995,"15min":0.504},"max":{"1min":7.8840000000000003,"5min":24.286999999999999,"15min":247.267},"last":0.89300000000000002}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.0209999999999999,"5min":1.9750000000000001,"15min":4.819},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":12.032,"5min":30.957999999999998,"15min":207.93799999999999},"last":1.3},{"interface":"front","average":{"1min":1.887,"5min":2.1139999999999999,"15min":4.5300000000000002},"min":{"1min":0.73099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":7.976,"5min":24.491,"15min":265.82600000000002},"last":0.85999999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7,"5min":2.3250000000000002,"15min":4.633},"min":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.42199999999999999},"max":{"1min":8.1039999999999992,"5min":28.951000000000001,"15min":303.19200000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.1360000000000001,"15min":4.7229999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":12.207000000000001,"5min":31.018999999999998,"15min":210.78899999999999},"last":1.03}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.577,"5min":2.5600000000000001,"15min":6.6859999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":41.378,"5min":41.378,"15min":308.47500000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":2.9550000000000001,"5min":2.226,"15min":4.1150000000000002},"min":{"1min":0.58999999999999997,"5min":0.44400000000000001,"15min":0.34000000000000002},"max":{"1min":22.57,"5min":24.411000000000001,"15min":303.23599999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2429999999999999,"5min":2.7789999999999999,"15min":5.2800000000000002},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.41199999999999998},"max":{"1min":11.987,"5min":63.313000000000002,"15min":252.18299999999999},"last":1.387},{"interface":"front","average":{"1min":2.0499999999999998,"5min":1.9259999999999999,"15min":4.8479999999999999},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.437},"max":{"1min":8.0169999999999995,"5min":14.84,"15min":309.029},"last":0.91800000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509656,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571648,"kb_used_data":323896,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93800192,"statfs":{"total":96636764160,"available":96051396608,"internally_reserved":0,"allocated":331669504,"data_stored":514492530,"data_compressed":94607921,"data_compressed_allocated":114036736,"data_compressed_original":297058304,"omap_allocated":1592,"internal_metadata":253688264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.6660000000000004,"5min":3.8220000000000001,"15min":2.5840000000000001},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":51.582999999999998,"5min":51.582999999999998,"15min":58.200000000000003},"last":0.93100000000000005},{"interface":"front","average":{"1min":5.0609999999999999,"5min":2.6120000000000001,"15min":2.3540000000000001},"min":{"1min":0.52900000000000003,"5min":0.40999999999999998,"15min":0.35999999999999999},"max":{"1min":56.402999999999999,"5min":56.402999999999999,"15min":56.402999999999999},"last":1.6890000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":2.3559999999999999,"15min":2.1949999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":11.771000000000001,"5min":36.024999999999999,"15min":36.024999999999999},"last":1.391},{"interface":"front","average":{"1min":7.2030000000000003,"5min":3.851,"15min":2.7309999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":51.542999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":1.125}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":5.6900000000000004,"5min":3.0270000000000001,"15min":2.6070000000000002},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":56.494,"5min":56.494,"15min":56.494},"last":1.9399999999999999},{"interface":"front","average":{"1min":3.4809999999999999,"5min":2.8319999999999999,"15min":2.605},"min":{"1min":0.622,"5min":0.622,"15min":0.42799999999999999},"max":{"1min":18.276,"5min":36.057000000000002,"15min":36.057000000000002},"last":1.482}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":6.9779999999999998,"5min":3.8759999999999999,"15min":2.9460000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":51.643000000000001,"5min":51.643000000000001,"15min":58.039999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":5.2889999999999997,"5min":2.8999999999999999,"15min":2.7719999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46500000000000002},"max":{"1min":56.530999999999999,"5min":56.530999999999999,"15min":56.530999999999999},"last":1.8140000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.0039999999999996,"5min":4.5250000000000004,"15min":3.7200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.33200000000000002},"max":{"1min":68.007000000000005,"5min":68.007000000000005,"15min":68.007000000000005},"last":1.274},{"interface":"front","average":{"1min":10.465999999999999,"5min":4.702,"15min":3.8290000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38600000000000001},"max":{"1min":72.611000000000004,"5min":72.611000000000004,"15min":72.611000000000004},"last":1.3360000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.811,"5min":4.2919999999999998,"15min":3.911},"min":{"1min":0.52700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":72.915999999999997,"5min":72.915999999999997,"15min":161.898},"last":1.175},{"interface":"front","average":{"1min":14.786,"5min":6.0739999999999998,"15min":4.7030000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":105.387,"5min":105.387,"15min":163.33600000000001},"last":1.5589999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.2610000000000001,"5min":4.6710000000000003,"15min":4.1390000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":51.615000000000002,"5min":66.341999999999999,"15min":66.341999999999999},"last":1.659},{"interface":"front","average":{"1min":6.8499999999999996,"5min":4.1790000000000003,"15min":4.101},"min":{"1min":0.65800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":56.454000000000001,"5min":58.427999999999997,"15min":66.665000000000006},"last":2.2530000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509657,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":709656,"kb_used_data":425872,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":93662184,"statfs":{"total":96636764160,"available":95910076416,"internally_reserved":0,"allocated":436092928,"data_stored":654931320,"data_compressed":113651503,"data_compressed_allocated":135081984,"data_compressed_original":354107392,"omap_allocated":1593,"internal_metadata":290585031},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.538,"15min":1.1679999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6919999999999999,"5min":44.363,"15min":44.363},"last":0.23200000000000001},{"interface":"front","average":{"1min":2.3540000000000001,"5min":1.992,"15min":1.956},"min":{"1min":0.44500000000000001,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":27.032,"5min":58.844999999999999,"15min":62.512999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.861,"15min":3.1539999999999999},"min":{"1min":0.626,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":11.923,"5min":33.281999999999996,"15min":202.65000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":1.996,"5min":2.2909999999999999,"15min":2.5369999999999999},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":16.783999999999999,"5min":84.191999999999993,"15min":114.221},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.8799999999999999,"5min":1.712,"15min":1.5669999999999999},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":15.013,"5min":27.433,"15min":43.747999999999998},"last":0.504},{"interface":"front","average":{"1min":1.4279999999999999,"5min":2.524,"15min":2.3660000000000001},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":1.98,"5min":50.006,"15min":50.006},"last":0.47099999999999997}]},{"osd":4,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":3,"15min":4.2930000000000001},"min":{"1min":0.91900000000000004,"5min":0.66400000000000003,"15min":0.42499999999999999},"max":{"1min":12.43,"5min":51.384,"15min":202.821},"last":4.0250000000000004},{"interface":"front","average":{"1min":2.3180000000000001,"5min":2.5089999999999999,"15min":3.2570000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":23.635000000000002,"5min":53.720999999999997,"15min":234.68700000000001},"last":2.7149999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.782,"5min":3.8900000000000001,"15min":4.3440000000000003},"min":{"1min":0.94199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":57.360999999999997,"5min":57.360999999999997,"15min":190.827},"last":0.52400000000000002},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.9550000000000001,"15min":4.6980000000000004},"min":{"1min":0.97799999999999998,"5min":0.58199999999999996,"15min":0.54700000000000004},"max":{"1min":39.981999999999999,"5min":70.242000000000004,"15min":213.03999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":6.0220000000000002,"5min":3.335,"15min":3.0529999999999999},"min":{"1min":0.93000000000000005,"5min":0.78300000000000003,"15min":0.46800000000000003},"max":{"1min":89.710999999999999,"5min":89.710999999999999,"15min":89.710999999999999},"last":2.5840000000000001},{"interface":"front","average":{"1min":1.9610000000000001,"5min":3.2839999999999998,"15min":3.9489999999999998},"min":{"1min":1.093,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":12.269,"5min":50.899000000000001,"15min":202.78299999999999},"last":7.8689999999999998}]},{"osd":7,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.625,"5min":3.2719999999999998,"15min":4.1950000000000003},"min":{"1min":1.014,"5min":0.745,"15min":0.58299999999999996},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":82.248000000000005},"last":2.0190000000000001},{"interface":"front","average":{"1min":4.0449999999999999,"5min":4.6319999999999997,"15min":6.069},"min":{"1min":1.087,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":42.883000000000003,"5min":113.44,"15min":233.44800000000001},"last":7.8220000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509657,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":578344,"kb_used_data":344480,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93793496,"statfs":{"total":96636764160,"available":96044539904,"internally_reserved":0,"allocated":352747520,"data_stored":499602898,"data_compressed":87576742,"data_compressed_allocated":103403520,"data_compressed_original":250449920,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.2029999999999998,"15min":1.9870000000000001},"min":{"1min":0.58999999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":15.622,"5min":83.817999999999998,"15min":83.817999999999998},"last":1.24},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.448,"15min":3.4689999999999999},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":16.433,"5min":83.266999999999996,"15min":248.16999999999999},"last":1.1719999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":1.7709999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":15.384,"5min":19.004999999999999,"15min":30.504999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.157,"15min":3.3540000000000001},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.28100000000000003},"max":{"1min":14.863,"5min":47.768999999999998,"15min":255.315},"last":1.4830000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":4.7300000000000004,"5min":1.98,"15min":1.976},"min":{"1min":0.77300000000000002,"5min":0.40799999999999997,"15min":0.315},"max":{"1min":30.062999999999999,"5min":30.062999999999999,"15min":84.840999999999994},"last":1.6080000000000001},{"interface":"front","average":{"1min":2.899,"5min":2.145,"15min":2.7589999999999999},"min":{"1min":0.73699999999999999,"5min":0.54700000000000004,"15min":0.36599999999999999},"max":{"1min":15.587,"5min":27.283000000000001,"15min":128.976},"last":1.651}]},{"osd":4,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":5.9710000000000001,"5min":3.0840000000000001,"15min":4.9109999999999996},"min":{"1min":1.0669999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":37.795000000000002,"5min":47.432000000000002,"15min":255.25700000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":3.7160000000000002,"5min":2.4159999999999999,"15min":3.4340000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.48299999999999998},"max":{"1min":15.198,"5min":34.531999999999996,"15min":128.655},"last":1.351}]},{"osd":5,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.7000000000000002,"15min":4.7380000000000004},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.53300000000000003},"max":{"1min":24.016999999999999,"5min":138.905,"15min":153.417},"last":2.0409999999999999},{"interface":"front","average":{"1min":7.109,"5min":3.3610000000000002,"15min":5.6150000000000002},"min":{"1min":0.97999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":59.981000000000002,"5min":63.884,"15min":255.34899999999999},"last":1.633}]},{"osd":6,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.2330000000000001,"5min":2.5209999999999999,"15min":3.492},"min":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.55400000000000005},"max":{"1min":10.231,"5min":82.388999999999996,"15min":138.33099999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.835,"15min":5.0419999999999998},"min":{"1min":0.85099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":15.726000000000001,"5min":127.44799999999999,"15min":187.29599999999999},"last":2.165}]},{"osd":7,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":8.3079999999999998,"5min":4.3659999999999997,"15min":6.3360000000000003},"min":{"1min":1.026,"5min":0.95499999999999996,"15min":0.60899999999999999},"max":{"1min":67.837999999999994,"5min":81.165999999999997,"15min":211.17500000000001},"last":1.7609999999999999},{"interface":"front","average":{"1min":8.5269999999999992,"5min":3.2949999999999999,"15min":4.7069999999999999},"min":{"1min":0.92000000000000004,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":72.992999999999995,"5min":72.992999999999995,"15min":173.53999999999999},"last":1.802}]}]},{"osd":1,"up_from":15,"seq":64424509657,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686800,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93685040,"statfs":{"total":96636764160,"available":95933480960,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106207472,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.968,"5min":1.617,"15min":1.478},"min":{"1min":0.76500000000000001,"5min":0.30199999999999999,"15min":0.22500000000000001},"max":{"1min":21.655999999999999,"5min":21.655999999999999,"15min":51.420999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":3.3959999999999999,"5min":1.768,"15min":1.722},"min":{"1min":0.59899999999999998,"5min":0.34200000000000003,"15min":0.255},"max":{"1min":22.587,"5min":22.587,"15min":48.802999999999997},"last":1.466}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.768,"15min":2.544},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.308},"max":{"1min":24.036999999999999,"5min":24.036999999999999,"15min":131.321},"last":1.028},{"interface":"front","average":{"1min":4.6660000000000004,"5min":1.962,"15min":1.635},"min":{"1min":0.61499999999999999,"5min":0.40699999999999997,"15min":0.27800000000000002},"max":{"1min":26.029,"5min":26.029,"15min":26.029},"last":1.2090000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.343,"5min":2.2610000000000001,"15min":2.6800000000000002},"min":{"1min":0.65800000000000003,"5min":0.42799999999999999,"15min":0.26700000000000002},"max":{"1min":43.832999999999998,"5min":43.832999999999998,"15min":197.43899999999999},"last":1.712},{"interface":"front","average":{"1min":5.843,"5min":2.4249999999999998,"15min":2.5129999999999999},"min":{"1min":0.54600000000000004,"5min":0.39600000000000002,"15min":0.32100000000000001},"max":{"1min":54.316000000000003,"5min":54.316000000000003,"15min":156.316},"last":1.319}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.0209999999999999,"5min":2.722,"15min":3.3300000000000001},"min":{"1min":0.83899999999999997,"5min":0.64900000000000002,"15min":0.44800000000000001},"max":{"1min":48.799999999999997,"5min":48.799999999999997,"15min":159.84299999999999},"last":1.147},{"interface":"front","average":{"1min":5.1520000000000001,"5min":3.214,"15min":3.1389999999999998},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.51700000000000002},"max":{"1min":28.405999999999999,"5min":43.418999999999997,"15min":62.978999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":10.071,"5min":3.726,"15min":3.347},"min":{"1min":0.90400000000000003,"5min":0.72999999999999998,"15min":0.50600000000000001},"max":{"1min":107.88500000000001,"5min":107.88500000000001,"15min":107.88500000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.6800000000000002,"15min":3.1150000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":19.553999999999998,"5min":24.309999999999999,"15min":133.685},"last":1.2669999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":7.4649999999999999,"5min":3.1819999999999999,"15min":3.5950000000000002},"min":{"1min":1.1140000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":54.220999999999997,"5min":54.220999999999997,"15min":142.84100000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":3.8700000000000001,"5min":2.278,"15min":3.706},"min":{"1min":1.006,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":23.998999999999999,"5min":23.998999999999999,"15min":146.69900000000001},"last":1.4099999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.3479999999999999,"5min":3.0499999999999998,"15min":2.7200000000000002},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":31.096,"5min":31.096,"15min":35.783999999999999},"last":1.5549999999999999},{"interface":"front","average":{"1min":7.819,"5min":3.5209999999999999,"15min":3.359},"min":{"1min":1.351,"5min":0.997,"15min":0.63600000000000001},"max":{"1min":34.281999999999996,"5min":34.281999999999996,"15min":57.134999999999998},"last":1.6779999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509658,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":492604,"kb_used_data":250484,"kb_used_omap":1,"kb_used_meta":242110,"kb_avail":93879236,"statfs":{"total":96636764160,"available":96132337664,"internally_reserved":0,"allocated":256495616,"data_stored":421311338,"data_compressed":70178109,"data_compressed_allocated":85630976,"data_compressed_original":250638336,"omap_allocated":1594,"internal_metadata":247921094},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":3.3330000000000002,"5min":1.859,"15min":1.7569999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.21099999999999999},"max":{"1min":30.565000000000001,"5min":30.565000000000001,"15min":74.326999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":3.9260000000000002,"5min":2.1829999999999998,"15min":1.5900000000000001},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.25700000000000001},"max":{"1min":32.871000000000002,"5min":33.957999999999998,"15min":43.518000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":14.217000000000001,"5min":4.2910000000000004,"15min":2.282},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":181.27099999999999,"5min":181.27099999999999,"15min":181.27099999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":4.3620000000000001,"5min":2.4119999999999999,"15min":1.827},"min":{"1min":0.504,"5min":0.436,"15min":0.24099999999999999},"max":{"1min":41.810000000000002,"5min":41.810000000000002,"15min":46.984999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.7089999999999996,"5min":2.3239999999999998,"15min":1.788},"min":{"1min":0.53000000000000003,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":31.562000000000001,"5min":31.562000000000001,"15min":36.642000000000003},"last":0.433},{"interface":"front","average":{"1min":12.118,"5min":3.8759999999999999,"15min":2.5350000000000001},"min":{"1min":1.2010000000000001,"5min":0.48599999999999999,"15min":0.28799999999999998},"max":{"1min":94.373000000000005,"5min":94.373000000000005,"15min":94.373000000000005},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.656000000000001,"5min":4.141,"15min":3.3159999999999998},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":135.547,"5min":135.547,"15min":135.547},"last":0.55900000000000005},{"interface":"front","average":{"1min":10.077999999999999,"5min":3.8639999999999999,"15min":3.3370000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":131.07599999999999,"5min":131.07599999999999,"15min":131.07599999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.5460000000000003,"5min":2.9660000000000002,"15min":2.6829999999999998},"min":{"1min":1.1619999999999999,"5min":0.56699999999999995,"15min":0.38700000000000001},"max":{"1min":41.412999999999997,"5min":63.134999999999998,"15min":63.134999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":4.5469999999999997,"5min":3.2389999999999999,"15min":2.7890000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":42.020000000000003,"5min":63.185000000000002,"15min":63.185000000000002},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.8239999999999998,"15min":3.5699999999999998},"min":{"1min":0.95899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.548999999999999,"5min":105.974,"15min":203.92699999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":4.6369999999999996,"5min":4.0860000000000003,"15min":3.806},"min":{"1min":1.0529999999999999,"5min":0.627,"15min":0.42899999999999999},"max":{"1min":28.646000000000001,"5min":160.84700000000001,"15min":203.56899999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":9.5519999999999996,"5min":4.3310000000000004,"15min":3.0489999999999999},"min":{"1min":0.996,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":91.418000000000006,"5min":91.418000000000006,"15min":91.418000000000006},"last":0.66600000000000004},{"interface":"front","average":{"1min":5.2549999999999999,"5min":3.8029999999999999,"15min":3.0139999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":31.756,"5min":68.608000000000004,"15min":68.608000000000004},"last":0.68799999999999994}]}]},{"osd":7,"up_from":13,"seq":55834575064,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":682984,"kb_used_data":417184,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93688856,"statfs":{"total":96636764160,"available":95937388544,"internally_reserved":0,"allocated":427196416,"data_stored":574962631,"data_compressed":94721461,"data_compressed_allocated":110882816,"data_compressed_original":258842624,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.3539999999999992,"5min":5.5549999999999997,"15min":4.4649999999999999},"min":{"1min":0.58199999999999996,"5min":0.501,"15min":0.39300000000000002},"max":{"1min":69.191999999999993,"5min":221.768,"15min":221.768},"last":1.0189999999999999},{"interface":"front","average":{"1min":7.1609999999999996,"5min":4.2290000000000001,"15min":3.3039999999999998},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.40699999999999997},"max":{"1min":63.854999999999997,"5min":93.781000000000006,"15min":93.781000000000006},"last":1.0569999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.5009999999999994,"5min":5.7460000000000004,"15min":4.3810000000000002},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.374},"max":{"1min":69.061999999999998,"5min":221.715,"15min":221.715},"last":1.3120000000000001},{"interface":"front","average":{"1min":7.3419999999999996,"5min":4.3179999999999996,"15min":3.3969999999999998},"min":{"1min":0.74399999999999999,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":67.930999999999997,"5min":93.825000000000003,"15min":93.825000000000003},"last":1.1890000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.0329999999999999,"15min":4.3170000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47999999999999998},"max":{"1min":21.026,"5min":27.303000000000001,"15min":189.01400000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":8.5289999999999999,"5min":5.7249999999999996,"15min":4.5910000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.48799999999999999},"max":{"1min":69.156999999999996,"5min":221.80600000000001,"15min":221.80600000000001},"last":1.109}]},{"osd":3,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":6.9409999999999998,"5min":3.3420000000000001,"15min":4.4829999999999997},"min":{"1min":0.82799999999999996,"5min":0.747,"15min":0.57399999999999995},"max":{"1min":64.206000000000003,"5min":64.206000000000003,"15min":198.696},"last":1.155},{"interface":"front","average":{"1min":8.4770000000000003,"5min":5.7590000000000003,"15min":5.3120000000000003},"min":{"1min":0.78400000000000003,"5min":0.66200000000000003,"15min":0.46100000000000002},"max":{"1min":69.585999999999999,"5min":221.846,"15min":221.846},"last":1.3819999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":7.4640000000000004,"5min":4.5199999999999996,"15min":5.0640000000000001},"min":{"1min":0.48199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":63.634,"5min":93.890000000000001,"15min":245.36000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":5.5899999999999999,"5min":3.3530000000000002,"15min":4.7130000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.443},"max":{"1min":43.292000000000002,"5min":56.325000000000003,"15min":190.40799999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.4879999999999995,"5min":6.4530000000000003,"15min":6.3959999999999999},"min":{"1min":0.46400000000000002,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":69.122,"5min":222.85499999999999,"15min":222.85499999999999},"last":1.218},{"interface":"front","average":{"1min":9.5709999999999997,"5min":5.2539999999999996,"15min":6.181},"min":{"1min":0.63400000000000001,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":83.078000000000003,"5min":93.858000000000004,"15min":215.16900000000001},"last":0.89600000000000002}]},{"osd":6,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.6600000000000001,"5min":4.9820000000000002,"15min":4.9980000000000002},"min":{"1min":0.80400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":68.109999999999999,"5min":94.079999999999998,"15min":94.079999999999998},"last":1.252},{"interface":"front","average":{"1min":8.0809999999999995,"5min":4.0359999999999996,"15min":5.0140000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":63.673000000000002,"5min":63.673000000000002,"15min":188.935},"last":1.2809999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24195072,"data_stored":104857656,"data_compressed":16682123,"data_compressed_allocated":20328448,"data_compressed_original":100999168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16805888,"data_stored":62914630,"data_compressed":9779731,"data_compressed_allocated":12054528,"data_compressed_original":58167296,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8126464,"data_stored":33555104,"data_compressed":5171825,"data_compressed_allocated":6344704,"data_compressed_original":31780864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26669056,"data_stored":104858182,"data_compressed":16510456,"data_compressed_allocated":20230144,"data_compressed_original":98422784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17113088,"data_stored":62915904,"data_compressed":9796281,"data_compressed_allocated":12075008,"data_compressed_original":57892864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21372928,"data_stored":76761205,"data_compressed":12207191,"data_compressed_allocated":15360000,"data_compressed_original":70758400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21659648,"data_stored":83886080,"data_compressed":13417072,"data_compressed_allocated":16605184,"data_compressed_original":78831616,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7647232,"data_stored":26429589,"data_compressed":4039279,"data_compressed_allocated":5218304,"data_compressed_original":24010752,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344313856,"data_stored":465924096,"data_compressed":82404917,"data_compressed_allocated":97058816,"data_compressed_original":218669056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409116672,"data_stored":549949440,"data_compressed":97141047,"data_compressed_allocated":114851840,"data_compressed_original":255684608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":314249216,"data_stored":451452928,"data_compressed":84811640,"data_compressed_allocated":101961728,"data_compressed_original":239165440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":312856576,"data_stored":424542208,"data_compressed":70385955,"data_compressed_allocated":84119552,"data_compressed_original":195805184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":361660416,"data_stored":497172480,"data_compressed":89601823,"data_compressed_allocated":107122688,"data_compressed_original":242634752,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":419241984,"data_stored":548409344,"data_compressed":90682182,"data_compressed_allocated":105664512,"data_compressed_original":234831872,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:24:25.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:24:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.452+0000 7fbdda6b4640 1 Processor -- start 2023-11-18T19:24:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.452+0000 7fbdda6b4640 1 -- start start 2023-11-18T19:24:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.454+0000 7fbdda6b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd41545c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.454+0000 7fbdda6b4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd40ca200 con 0x7fbdd40bd590 2023-11-18T19:24:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.454+0000 7fbdda6b4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd4151fe0 con 0x7fbdd4151c00 2023-11-18T19:24:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.454+0000 7fbdda6b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40c5610 con 0x7fbdd40c7e00 2023-11-18T19:24:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.454+0000 7fbdd8c51640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbdd40bd590 0x7fbdd4154b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56244/0 (socket says 172.21.15.45:56244) 2023-11-18T19:24:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.454+0000 7fbdd8c51640 1 -- 172.21.15.45:0/2575222148 learned_addr learned my addr 172.21.15.45:0/2575222148 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.454+0000 7fbdd37fe640 1 --2- 172.21.15.45:0/2575222148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd41545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.455+0000 7fbdd2ffd640 1 -- 172.21.15.45:0/2575222148 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167150474 0 0) 0x7fbdd40ca200 con 0x7fbdd40bd590 2023-11-18T19:24:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.455+0000 7fbdd2ffd640 1 -- 172.21.15.45:0/2575222148 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdbc003520 con 0x7fbdd40bd590 2023-11-18T19:24:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.455+0000 7fbdd37fe640 1 -- 172.21.15.45:0/2575222148 >> v1:172.21.15.135:6789/0 conn(0x7fbdd4151c00 legacy=0x7fbdd40c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.455+0000 7fbdd37fe640 1 -- 172.21.15.45:0/2575222148 >> v1:172.21.15.45:6789/0 conn(0x7fbdd40bd590 legacy=0x7fbdd4154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.455+0000 7fbdd2ffd640 1 -- 172.21.15.45:0/2575222148 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1060265519 0 0) 0x7fbdbc003520 con 0x7fbdd40bd590 2023-11-18T19:24:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.455+0000 7fbdd37fe640 1 -- 172.21.15.45:0/2575222148 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd41586d0 con 0x7fbdd40c7e00 2023-11-18T19:24:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.456+0000 7fbdd37fe640 1 --2- 172.21.15.45:0/2575222148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd41545c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80097d0 tx=0x7fbdc802b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b40ed4a1a5579 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.456+0000 7fbdd2ffd640 1 -- 172.21.15.45:0/2575222148 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0019f0 con 0x7fbdd40c7e00 2023-11-18T19:24:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.456+0000 7fbdd2ffd640 1 -- 172.21.15.45:0/2575222148 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc802e050 con 0x7fbdd40c7e00 2023-11-18T19:24:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.456+0000 7fbdd2ffd640 1 -- 172.21.15.45:0/2575222148 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8030710 con 0x7fbdd40c7e00 2023-11-18T19:24:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.457+0000 7fbdda6b4640 1 -- 172.21.15.45:0/2575222148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 msgr2=0x7fbdd41545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.457+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/2575222148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd41545c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80097d0 tx=0x7fbdc802b6e0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.458+0000 7fbdda6b4640 1 -- 172.21.15.45:0/2575222148 shutdown_connections 2023-11-18T19:24:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.458+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/2575222148 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd41545c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.458+0000 7fbdda6b4640 1 -- 172.21.15.45:0/2575222148 >> 172.21.15.45:0/2575222148 conn(0x7fbdd40663d0 msgr2=0x7fbdd40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.458+0000 7fbdda6b4640 1 -- 172.21.15.45:0/2575222148 shutdown_connections 2023-11-18T19:24:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.458+0000 7fbdda6b4640 1 -- 172.21.15.45:0/2575222148 wait complete. 2023-11-18T19:24:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.460+0000 7fbdda6b4640 1 Processor -- start 2023-11-18T19:24:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.460+0000 7fbdda6b4640 1 -- start start 2023-11-18T19:24:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdda6b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd40bd590 0x7fbdd41536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdda6b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd40bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdda6b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4151c00 0x7fbdd40be270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdda6b4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd41ed930 con 0x7fbdd40bd590 2023-11-18T19:24:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdda6b4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd41e9ff0 con 0x7fbdd4151c00 2023-11-18T19:24:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdda6b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd41ed690 con 0x7fbdd40c7e00 2023-11-18T19:24:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdd3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd40bd590 0x7fbdd41536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdd3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd40bd590 0x7fbdd41536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36452/0 (socket says 172.21.15.45:36452) 2023-11-18T19:24:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdd3fff640 1 -- 172.21.15.45:0/3284030161 learned_addr learned my addr 172.21.15.45:0/3284030161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.461+0000 7fbdd37fe640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd40bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.462+0000 7fbdd8c51640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4151c00 0x7fbdd40be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.462+0000 7fbdd3fff640 1 -- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 msgr2=0x7fbdd40bdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.462+0000 7fbdd3fff640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd40bdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.462+0000 7fbdd3fff640 1 -- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4151c00 msgr2=0x7fbdd40be270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.462+0000 7fbdd3fff640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4151c00 0x7fbdd40be270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.462+0000 7fbdd3fff640 1 -- 172.21.15.45:0/3284030161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8009400 con 0x7fbdd40bd590 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.462+0000 7fbdd3fff640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd40bd590 0x7fbdd41536f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400b3e0 tx=0x7fbdc400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.463+0000 7fbdd0ff9640 1 -- 172.21.15.45:0/3284030161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4011830 con 0x7fbdd40bd590 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.463+0000 7fbdd0ff9640 1 -- 172.21.15.45:0/3284030161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40119b0 con 0x7fbdd40bd590 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.463+0000 7fbdd0ff9640 1 -- 172.21.15.45:0/3284030161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4011d60 con 0x7fbdd40bd590 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.463+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd41ea200 con 0x7fbdd40bd590 2023-11-18T19:24:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.463+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd41ea7c0 con 0x7fbdd40bd590 2023-11-18T19:24:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.465+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd40747c0 con 0x7fbdd40bd590 2023-11-18T19:24:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.466+0000 7fbdd0ff9640 1 -- 172.21.15.45:0/3284030161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdc401a400 con 0x7fbdd40bd590 2023-11-18T19:24:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.467+0000 7fbdd0ff9640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdc006af10 0x7fbdc006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.467+0000 7fbdd0ff9640 1 -- 172.21.15.45:0/3284030161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbdc4089990 con 0x7fbdd40bd590 2023-11-18T19:24:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.468+0000 7fbdd37fe640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdc006af10 0x7fbdc006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.470+0000 7fbdd37fe640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdc006af10 0x7fbdc006d3d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8034000 tx=0x7fbdc8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.474+0000 7fbdd0ff9640 1 -- 172.21.15.45:0/3284030161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbdc4054810 con 0x7fbdd40bd590 2023-11-18T19:24:25.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.706+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdd414df80 con 0x7fbdd40bd590 2023-11-18T19:24:25.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.708+0000 7fbdd0ff9640 1 -- 172.21.15.45:0/3284030161 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18481 (secure 0 0 0) 0x7fbdc4015090 con 0x7fbdd40bd590 2023-11-18T19:24:25.709 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:24:25.709 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:07:25.049601+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:24:25.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdc006af10 msgr2=0x7fbdc006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdc006af10 0x7fbdc006d3d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8034000 tx=0x7fbdc8008030 comp rx=0 tx=0).stop 2023-11-18T19:24:25.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd40bd590 msgr2=0x7fbdd41536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd40bd590 0x7fbdd41536f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400b3e0 tx=0x7fbdc400b8a0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 shutdown_connections 2023-11-18T19:24:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdd4151c00 0x7fbdd40be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbdc006af10 0x7fbdc006d3d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbdd40c7e00 0x7fbdd40bdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 --2- 172.21.15.45:0/3284030161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd40bd590 0x7fbdd41536f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.711+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 >> 172.21.15.45:0/3284030161 conn(0x7fbdd40663d0 msgr2=0x7fbdd414e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.712+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 shutdown_connections 2023-11-18T19:24:25.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:25.712+0000 7fbdda6b4640 1 -- 172.21.15.45:0/3284030161 wait complete. 2023-11-18T19:24:26.734 INFO:tasks.ceph:Scrubbing osd.0 2023-11-18T19:24:26.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:27.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.117+0000 7f7154d61640 1 Processor -- start 2023-11-18T19:24:27.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.118+0000 7f7154d61640 1 -- start start 2023-11-18T19:24:27.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f7154d61640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f71500c1c60 0x7f7150155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f7154d61640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f715006dcc0 0x7f71501561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f7154d61640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71500c3ad0 con 0x7f7150158ad0 2023-11-18T19:24:27.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f7154d61640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7150159ae0 con 0x7f71500c1c60 2023-11-18T19:24:27.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f7154d61640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7150158f60 con 0x7f715006dcc0 2023-11-18T19:24:27.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f714e59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f71500c1c60 0x7f7150155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f714e59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f71500c1c60 0x7f7150155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:38000/0 (socket says 172.21.15.45:38000) 2023-11-18T19:24:27.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.122+0000 7f714e59c640 1 -- 172.21.15.45:0/2345910363 learned_addr learned my addr 172.21.15.45:0/2345910363 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:27.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.123+0000 7f714e59c640 1 -- 172.21.15.45:0/2345910363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f715006dcc0 msgr2=0x7f71501561a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-18T19:24:27.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.123+0000 7f714e59c640 1 --2- 172.21.15.45:0/2345910363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f715006dcc0 0x7f71501561a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.123+0000 7f714e59c640 1 -- 172.21.15.45:0/2345910363 >> v1:172.21.15.135:6789/0 conn(0x7f7150158ad0 legacy=0x7f715015c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:27.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.123+0000 7f714e59c640 1 -- 172.21.15.45:0/2345910363 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150159240 con 0x7f71500c1c60 2023-11-18T19:24:27.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.125+0000 7f714e59c640 1 --2- 172.21.15.45:0/2345910363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71500c1c60 0x7f7150155c60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7140009870 tx=0x7f714002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82427300a810d0cd server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.125+0000 7f714d59a640 1 -- 172.21.15.45:0/2345910363 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400317e0 con 0x7f71500c1c60 2023-11-18T19:24:27.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.125+0000 7f714d59a640 1 -- 172.21.15.45:0/2345910363 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140031940 con 0x7f71500c1c60 2023-11-18T19:24:27.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.125+0000 7f714d59a640 1 -- 172.21.15.45:0/2345910363 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140031cd0 con 0x7f71500c1c60 2023-11-18T19:24:27.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.126+0000 7f7154d61640 1 -- 172.21.15.45:0/2345910363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71500c1c60 msgr2=0x7f7150155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.126+0000 7f7154d61640 1 --2- 172.21.15.45:0/2345910363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71500c1c60 0x7f7150155c60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7140009870 tx=0x7f714002b880 comp rx=0 tx=0).stop 2023-11-18T19:24:27.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.127+0000 7f7154d61640 1 -- 172.21.15.45:0/2345910363 shutdown_connections 2023-11-18T19:24:27.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.127+0000 7f7154d61640 1 --2- 172.21.15.45:0/2345910363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f715006dcc0 0x7f71501561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.127+0000 7f7154d61640 1 --2- 172.21.15.45:0/2345910363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71500c1c60 0x7f7150155c60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.127+0000 7f7154d61640 1 -- 172.21.15.45:0/2345910363 >> 172.21.15.45:0/2345910363 conn(0x7f71500c5bd0 msgr2=0x7f71500c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:27.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.127+0000 7f7154d61640 1 -- 172.21.15.45:0/2345910363 shutdown_connections 2023-11-18T19:24:27.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.127+0000 7f7154d61640 1 -- 172.21.15.45:0/2345910363 wait complete. 2023-11-18T19:24:27.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.129+0000 7f7154d61640 1 Processor -- start 2023-11-18T19:24:27.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.130+0000 7f7154d61640 1 -- start start 2023-11-18T19:24:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f7154d61640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715006dcc0 0x7f71500a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f7154d61640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71500c1c60 0x7f71501f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f7154d61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7150154bb0 0x7f71500a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f7154d61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500a9800 con 0x7f7150154bb0 2023-11-18T19:24:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f7154d61640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500a72d0 con 0x7f715006dcc0 2023-11-18T19:24:27.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f7154d61640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71500aaf40 con 0x7f71500c1c60 2023-11-18T19:24:27.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f714ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7150154bb0 0x7f71500a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f714e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715006dcc0 0x7f71500a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f714ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7150154bb0 0x7f71500a3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36466/0 (socket says 172.21.15.45:36466) 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.131+0000 7f714ed9d640 1 -- 172.21.15.45:0/780876201 learned_addr learned my addr 172.21.15.45:0/780876201 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.132+0000 7f714dd9b640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71500c1c60 0x7f71501f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.132+0000 7f714e59c640 1 -- 172.21.15.45:0/780876201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71500c1c60 msgr2=0x7f71501f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.132+0000 7f714e59c640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71500c1c60 0x7f71501f1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.132+0000 7f714e59c640 1 -- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7150154bb0 msgr2=0x7f71500a3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.132+0000 7f714e59c640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7150154bb0 0x7f71500a3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.132+0000 7f714e59c640 1 -- 172.21.15.45:0/780876201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400094d0 con 0x7f715006dcc0 2023-11-18T19:24:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.132+0000 7f714ed9d640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7150154bb0 0x7f71500a3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:24:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.133+0000 7f714e59c640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715006dcc0 0x7f71500a4f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7140033000 tx=0x7f71400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.133+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140032900 con 0x7f715006dcc0 2023-11-18T19:24:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.133+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140032a60 con 0x7f715006dcc0 2023-11-18T19:24:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.133+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140032e10 con 0x7f715006dcc0 2023-11-18T19:24:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.134+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71501f2400 con 0x7f715006dcc0 2023-11-18T19:24:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.134+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71500aa8f0 con 0x7f715006dcc0 2023-11-18T19:24:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.135+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71500c4e80 con 0x7f715006dcc0 2023-11-18T19:24:27.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.136+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f714004d3f0 con 0x7f715006dcc0 2023-11-18T19:24:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.137+0000 7f713effd640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f713006ae90 0x7f713006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.137+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f71400ab630 con 0x7f715006dcc0 2023-11-18T19:24:27.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.137+0000 7f714dd9b640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f713006ae90 0x7f713006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.137+0000 7f713effd640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f71300745f0 0x7f7130076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.137+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 --> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7130077160 con 0x7f71300745f0 2023-11-18T19:24:27.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.137+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71400ab9a0 con 0x7f715006dcc0 2023-11-18T19:24:27.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.138+0000 7f714ed9d640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f71300745f0 0x7f7130076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.138+0000 7f714dd9b640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f713006ae90 0x7f713006d350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f71500a77e0 tx=0x7f7144009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.138+0000 7f714ed9d640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f71300745f0 0x7f7130076a90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.139+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== osd.0 v2:172.21.15.45:6800/2175017614 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7130077160 con 0x7f71300745f0 2023-11-18T19:24:27.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.153+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 --> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7150159800 con 0x7f71300745f0 2023-11-18T19:24:27.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.153+0000 7f713effd640 1 -- 172.21.15.45:0/780876201 <== osd.0 v2:172.21.15.45:6800/2175017614 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f714800f040 con 0x7f71300745f0 2023-11-18T19:24:27.154 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:27.155 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:27.155 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f71300745f0 msgr2=0x7f7130076a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6800/2175017614,v1:172.21.15.45:6801/2175017614] conn(0x7f71300745f0 0x7f7130076a90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f713006ae90 msgr2=0x7f713006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f713006ae90 0x7f713006d350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f71500a77e0 tx=0x7f7144009060 comp rx=0 tx=0).stop 2023-11-18T19:24:27.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715006dcc0 msgr2=0x7f71500a4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 --2- 172.21.15.45:0/780876201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715006dcc0 0x7f71500a4f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7140033000 tx=0x7f71400046c0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f714ed9d640 1 -- 172.21.15.45:0/780876201 reap_dead start 2023-11-18T19:24:27.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 shutdown_connections 2023-11-18T19:24:27.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 >> 172.21.15.45:0/780876201 conn(0x7f71500c5bd0 msgr2=0x7f71500c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 shutdown_connections 2023-11-18T19:24:27.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.154+0000 7f7154d61640 1 -- 172.21.15.45:0/780876201 wait complete. 2023-11-18T19:24:27.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-18T19:24:27.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.351+0000 7f75a142b640 1 Processor -- start 2023-11-18T19:24:27.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.352+0000 7f75a142b640 1 -- start start 2023-11-18T19:24:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.353+0000 7f75a142b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f759c151e00 0x7f759c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.353+0000 7f75a142b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0c3c50 con 0x7f759c06c300 2023-11-18T19:24:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.353+0000 7f75a142b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c071080 con 0x7f759c0c1e60 2023-11-18T19:24:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.353+0000 7f75a142b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c071360 con 0x7f759c151e00 2023-11-18T19:24:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.353+0000 7f759a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f759c151e00 0x7f759c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.353+0000 7f759b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f759c06c300 0x7f759c15bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56256/0 (socket says 172.21.15.45:56256) 2023-11-18T19:24:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.353+0000 7f759b7fe640 1 -- 172.21.15.45:0/3276411869 learned_addr learned my addr 172.21.15.45:0/3276411869 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:27.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.354+0000 7f7599ffb640 1 -- 172.21.15.45:0/3276411869 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309601800 0 0) 0x7f759c0c3c50 con 0x7f759c06c300 2023-11-18T19:24:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.354+0000 7f7599ffb640 1 -- 172.21.15.45:0/3276411869 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7584003520 con 0x7f759c06c300 2023-11-18T19:24:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.354+0000 7f759a7fc640 1 -- 172.21.15.45:0/3276411869 >> v1:172.21.15.135:6789/0 conn(0x7f759c0c1e60 legacy=0x7f759c0a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.354+0000 7f759a7fc640 1 -- 172.21.15.45:0/3276411869 >> v1:172.21.15.45:6789/0 conn(0x7f759c06c300 legacy=0x7f759c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.354+0000 7f759a7fc640 1 -- 172.21.15.45:0/3276411869 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c071640 con 0x7f759c151e00 2023-11-18T19:24:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.355+0000 7f759a7fc640 1 --2- 172.21.15.45:0/3276411869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c151e00 0x7f759c071e40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f75900097a0 tx=0x7f759002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29240efd586569 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.355+0000 7f7599ffb640 1 -- 172.21.15.45:0/3276411869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590031830 con 0x7f759c151e00 2023-11-18T19:24:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.355+0000 7f7599ffb640 1 -- 172.21.15.45:0/3276411869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590031990 con 0x7f759c151e00 2023-11-18T19:24:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.355+0000 7f7599ffb640 1 -- 172.21.15.45:0/3276411869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590031d20 con 0x7f759c151e00 2023-11-18T19:24:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.356+0000 7f75a142b640 1 -- 172.21.15.45:0/3276411869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c151e00 msgr2=0x7f759c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.356+0000 7f75a142b640 1 --2- 172.21.15.45:0/3276411869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c151e00 0x7f759c071e40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f75900097a0 tx=0x7f759002b8d0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.356+0000 7f75a142b640 1 -- 172.21.15.45:0/3276411869 shutdown_connections 2023-11-18T19:24:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.356+0000 7f75a142b640 1 --2- 172.21.15.45:0/3276411869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c151e00 0x7f759c071e40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.356+0000 7f75a142b640 1 -- 172.21.15.45:0/3276411869 >> 172.21.15.45:0/3276411869 conn(0x7f759c0a7980 msgr2=0x7f759c0a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.356+0000 7f75a142b640 1 -- 172.21.15.45:0/3276411869 shutdown_connections 2023-11-18T19:24:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.356+0000 7f75a142b640 1 -- 172.21.15.45:0/3276411869 wait complete. 2023-11-18T19:24:27.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.358+0000 7f75a142b640 1 Processor -- start 2023-11-18T19:24:27.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.358+0000 7f75a142b640 1 -- start start 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f75a142b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c06c300 0x7f759c14d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f75a142b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c0c1e60 0x7f759c1471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f75a142b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c0bbdd0 0x7f759c147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f75a142b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c147c60 con 0x7f759c0bbdd0 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f75a142b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c1ebef0 con 0x7f759c06c300 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f75a142b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0babf0 con 0x7f759c0c1e60 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c0bbdd0 0x7f759c147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c0bbdd0 0x7f759c147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36476/0 (socket says 172.21.15.45:36476) 2023-11-18T19:24:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 -- 172.21.15.45:0/1781747532 learned_addr learned my addr 172.21.15.45:0/1781747532 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 -- 172.21.15.45:0/1781747532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c0c1e60 msgr2=0x7f759c1471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c0c1e60 0x7f759c1471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759affd640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c06c300 0x7f759c14d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 -- 172.21.15.45:0/1781747532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c06c300 msgr2=0x7f759c14d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c06c300 0x7f759c14d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.359+0000 7f759b7fe640 1 -- 172.21.15.45:0/1781747532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7590009400 con 0x7f759c0bbdd0 2023-11-18T19:24:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.360+0000 7f759b7fe640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c0bbdd0 0x7f759c147720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f759400caa0 tx=0x7f759400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.360+0000 7f75837fe640 1 -- 172.21.15.45:0/1781747532 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400ac00 con 0x7f759c0bbdd0 2023-11-18T19:24:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.360+0000 7f75837fe640 1 -- 172.21.15.45:0/1781747532 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400ad60 con 0x7f759c0bbdd0 2023-11-18T19:24:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.360+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c0baed0 con 0x7f759c0bbdd0 2023-11-18T19:24:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.360+0000 7f75837fe640 1 -- 172.21.15.45:0/1781747532 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594012620 con 0x7f759c0bbdd0 2023-11-18T19:24:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.360+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c1482b0 con 0x7f759c0bbdd0 2023-11-18T19:24:27.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.361+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c066b80 con 0x7f759c0bbdd0 2023-11-18T19:24:27.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.362+0000 7f75837fe640 1 -- 172.21.15.45:0/1781747532 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7594007070 con 0x7f759c0bbdd0 2023-11-18T19:24:27.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.363+0000 7f75837fe640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f758806ae40 0x7f758806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.363+0000 7f75837fe640 1 -- 172.21.15.45:0/1781747532 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f7594089960 con 0x7f759c0bbdd0 2023-11-18T19:24:27.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.363+0000 7f759affd640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f758806ae40 0x7f758806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.364+0000 7f759affd640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f758806ae40 0x7f758806d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f758c000f60 tx=0x7f758c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.367+0000 7f75837fe640 1 -- 172.21.15.45:0/1781747532 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75940546b0 con 0x7f759c0bbdd0 2023-11-18T19:24:27.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.553+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f759c0a84b0 con 0x7f758806ae40 2023-11-18T19:24:27.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.555+0000 7f75837fe640 1 -- 172.21.15.45:0/1781747532 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f759c0a84b0 con 0x7f758806ae40 2023-11-18T19:24:27.555 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-11-18T19:24:27.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f758806ae40 msgr2=0x7f758806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f758806ae40 0x7f758806d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f758c000f60 tx=0x7f758c009040 comp rx=0 tx=0).stop 2023-11-18T19:24:27.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c0bbdd0 msgr2=0x7f759c147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c0bbdd0 0x7f759c147720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f759400caa0 tx=0x7f759400cf60 comp rx=0 tx=0).stop 2023-11-18T19:24:27.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 shutdown_connections 2023-11-18T19:24:27.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759c0bbdd0 0x7f759c147720 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f758806ae40 0x7f758806d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f759c0c1e60 0x7f759c1471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 --2- 172.21.15.45:0/1781747532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f759c06c300 0x7f759c14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.557+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 >> 172.21.15.45:0/1781747532 conn(0x7f759c0a7980 msgr2=0x7f759c14e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:27.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.558+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 shutdown_connections 2023-11-18T19:24:27.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.558+0000 7f75a142b640 1 -- 172.21.15.45:0/1781747532 wait complete. 2023-11-18T19:24:27.574 INFO:tasks.ceph:Scrubbing osd.1 2023-11-18T19:24:27.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:27.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.803+0000 7f6f695fb640 1 Processor -- start 2023-11-18T19:24:27.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.804+0000 7f6f695fb640 1 -- start start 2023-11-18T19:24:27.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f695fb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f640c1c60 0x7f6f64155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f695fb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6f64158ad0 0x7f6f641561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f695fb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f640c3ad0 con 0x7f6f6406dcc0 2023-11-18T19:24:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f695fb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f64159ae0 con 0x7f6f640c1c60 2023-11-18T19:24:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f695fb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f64158f60 con 0x7f6f64158ad0 2023-11-18T19:24:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f62ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f640c1c60 0x7f6f64155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f62ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f640c1c60 0x7f6f64155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36486/0 (socket says 172.21.15.45:36486) 2023-11-18T19:24:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f637fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f6406dcc0 0x7f6f6415c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56262/0 (socket says 172.21.15.45:56262) 2023-11-18T19:24:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.806+0000 7f6f62ffd640 1 -- 172.21.15.45:0/2338660140 learned_addr learned my addr 172.21.15.45:0/2338660140 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.807+0000 7f6f5a7fc640 1 --2- 172.21.15.45:0/2338660140 >> v2:172.21.15.135:3300/0 conn(0x7f6f64158ad0 0x7f6f641561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.807+0000 7f6f627fc640 1 -- 172.21.15.45:0/2338660140 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64785706 0 0) 0x7f6f640c3ad0 con 0x7f6f6406dcc0 2023-11-18T19:24:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.807+0000 7f6f627fc640 1 -- 172.21.15.45:0/2338660140 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f50003520 con 0x7f6f6406dcc0 2023-11-18T19:24:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.807+0000 7f6f62ffd640 1 -- 172.21.15.45:0/2338660140 >> v2:172.21.15.135:3300/0 conn(0x7f6f64158ad0 msgr2=0x7f6f641561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.807+0000 7f6f62ffd640 1 --2- 172.21.15.45:0/2338660140 >> v2:172.21.15.135:3300/0 conn(0x7f6f64158ad0 0x7f6f641561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.807+0000 7f6f62ffd640 1 -- 172.21.15.45:0/2338660140 >> v1:172.21.15.45:6789/0 conn(0x7f6f6406dcc0 legacy=0x7f6f6415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.807+0000 7f6f62ffd640 1 -- 172.21.15.45:0/2338660140 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f64159240 con 0x7f6f640c1c60 2023-11-18T19:24:27.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.809+0000 7f6f62ffd640 1 --2- 172.21.15.45:0/2338660140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64155c60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f640abc60 tx=0x7f6f4c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5d04c1e0540d78 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.809+0000 7f6f627fc640 1 -- 172.21.15.45:0/2338660140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0317e0 con 0x7f6f640c1c60 2023-11-18T19:24:27.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.809+0000 7f6f627fc640 1 -- 172.21.15.45:0/2338660140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c031940 con 0x7f6f640c1c60 2023-11-18T19:24:27.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.809+0000 7f6f627fc640 1 -- 172.21.15.45:0/2338660140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c031cb0 con 0x7f6f640c1c60 2023-11-18T19:24:27.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 -- 172.21.15.45:0/2338660140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 msgr2=0x7f6f64155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 --2- 172.21.15.45:0/2338660140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64155c60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f640abc60 tx=0x7f6f4c02b880 comp rx=0 tx=0).stop 2023-11-18T19:24:27.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 -- 172.21.15.45:0/2338660140 shutdown_connections 2023-11-18T19:24:27.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 --2- 172.21.15.45:0/2338660140 >> v2:172.21.15.135:3300/0 conn(0x7f6f64158ad0 0x7f6f641561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 --2- 172.21.15.45:0/2338660140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64155c60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 -- 172.21.15.45:0/2338660140 >> 172.21.15.45:0/2338660140 conn(0x7f6f640c5bd0 msgr2=0x7f6f640c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:27.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 -- 172.21.15.45:0/2338660140 shutdown_connections 2023-11-18T19:24:27.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.810+0000 7f6f695fb640 1 -- 172.21.15.45:0/2338660140 wait complete. 2023-11-18T19:24:27.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.813+0000 7f6f695fb640 1 Processor -- start 2023-11-18T19:24:27.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.813+0000 7f6f695fb640 1 -- start start 2023-11-18T19:24:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.813+0000 7f6f695fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6406dcc0 0x7f6f64157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.813+0000 7f6f695fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f695fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64155890 0x7f6f64153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f695fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640aa780 con 0x7f6f640c1c60 2023-11-18T19:24:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f695fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641ee990 con 0x7f6f6406dcc0 2023-11-18T19:24:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f695fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640aa130 con 0x7f6f64155890 2023-11-18T19:24:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36490/0 (socket says 172.21.15.45:36490) 2023-11-18T19:24:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/3382320212 learned_addr learned my addr 172.21.15.45:0/3382320212 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f62ffd640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6406dcc0 0x7f6f64157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/3382320212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64155890 msgr2=0x7f6f64153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6f64155890 0x7f6f64153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/3382320212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6406dcc0 msgr2=0x7f6f64157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f6406dcc0 0x7f6f64157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.814+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/3382320212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0094d0 con 0x7f6f640c1c60 2023-11-18T19:24:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.815+0000 7f6f5a7fc640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64153210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400ce10 tx=0x7f6f5400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.816+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54003b90 con 0x7f6f640c1c60 2023-11-18T19:24:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.816+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f54003cf0 con 0x7f6f640c1c60 2023-11-18T19:24:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.816+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54003ea0 con 0x7f6f640c1c60 2023-11-18T19:24:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.816+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f640aa410 con 0x7f6f640c1c60 2023-11-18T19:24:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.816+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f641eec30 con 0x7f6f640c1c60 2023-11-18T19:24:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.817+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f6415a560 con 0x7f6f640c1c60 2023-11-18T19:24:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.819+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f54004240 con 0x7f6f640c1c60 2023-11-18T19:24:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.821+0000 7f6f5bfff640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f4406ae70 0x7f6f4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.821+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f6f54012070 con 0x7f6f640c1c60 2023-11-18T19:24:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.821+0000 7f6f62ffd640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f4406ae70 0x7f6f4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.821+0000 7f6f5bfff640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f6f44074550 0x7f6f440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.821+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 --> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f440770c0 con 0x7f6f44074550 2023-11-18T19:24:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.821+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f5408c750 con 0x7f6f640c1c60 2023-11-18T19:24:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.821+0000 7f6f637fe640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f6f44074550 0x7f6f440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.822+0000 7f6f637fe640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f6f44074550 0x7f6f440769f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.822+0000 7f6f62ffd640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f4406ae70 0x7f6f4406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c036000 tx=0x7f6f4c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.823+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== osd.1 v2:172.21.15.45:6816/370738576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6f440770c0 con 0x7f6f44074550 2023-11-18T19:24:27.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.846+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 --> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6f640c5fb0 con 0x7f6f44074550 2023-11-18T19:24:27.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.846+0000 7f6f5bfff640 1 -- 172.21.15.45:0/3382320212 <== osd.1 v2:172.21.15.45:6816/370738576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6f640c5fb0 con 0x7f6f44074550 2023-11-18T19:24:27.847 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:27.847 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:27.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f6f44074550 msgr2=0x7f6f440769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6816/370738576,v1:172.21.15.45:6817/370738576] conn(0x7f6f44074550 0x7f6f440769f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f4406ae70 msgr2=0x7f6f4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f6f4406ae70 0x7f6f4406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c036000 tx=0x7f6f4c03d040 comp rx=0 tx=0).stop 2023-11-18T19:24:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 msgr2=0x7f6f64153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 --2- 172.21.15.45:0/3382320212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f640c1c60 0x7f6f64153210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400ce10 tx=0x7f6f5400a660 comp rx=0 tx=0).stop 2023-11-18T19:24:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f637fe640 1 -- 172.21.15.45:0/3382320212 reap_dead start 2023-11-18T19:24:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 shutdown_connections 2023-11-18T19:24:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.847+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 >> 172.21.15.45:0/3382320212 conn(0x7f6f640c5bd0 msgr2=0x7f6f64159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:27.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.848+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 shutdown_connections 2023-11-18T19:24:27.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:27.848+0000 7f6f695fb640 1 -- 172.21.15.45:0/3382320212 wait complete. 2023-11-18T19:24:27.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-18T19:24:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.116+0000 7f84069a9640 1 Processor -- start 2023-11-18T19:24:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.116+0000 7f84069a9640 1 -- start start 2023-11-18T19:24:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.117+0000 7f84069a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8400155280 0x7f840006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.118+0000 7f84069a9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84000c49b0 con 0x7f84000c7640 2023-11-18T19:24:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.118+0000 7f84069a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84000c4c50 con 0x7f8400152040 2023-11-18T19:24:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.118+0000 7f84069a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000c4f30 con 0x7f8400155280 2023-11-18T19:24:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.118+0000 7f83ff7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8400155280 0x7f840006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.118+0000 7f83ff7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8400155280 0x7f840006c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:38050/0 (socket says 172.21.15.45:38050) 2023-11-18T19:24:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.118+0000 7f83ff7fe640 1 -- 172.21.15.45:0/2729217245 learned_addr learned my addr 172.21.15.45:0/2729217245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.118+0000 7f8404f46640 1 --1- 172.21.15.45:0/2729217245 >> v1:172.21.15.45:6789/0 conn(0x7f84000c7640 0x7f840015f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56268/0 (socket says 172.21.15.45:56268) 2023-11-18T19:24:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.119+0000 7f83ff7fe640 1 -- 172.21.15.45:0/2729217245 >> v1:172.21.15.135:6789/0 conn(0x7f8400152040 legacy=0x7f84000c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.119+0000 7f83ff7fe640 1 -- 172.21.15.45:0/2729217245 >> v1:172.21.15.45:6789/0 conn(0x7f84000c7640 legacy=0x7f840015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.119+0000 7f83ff7fe640 1 -- 172.21.15.45:0/2729217245 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840006bce0 con 0x7f8400155280 2023-11-18T19:24:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.120+0000 7f83ff7fe640 1 --2- 172.21.15.45:0/2729217245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8400155280 0x7f840006c200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009870 tx=0x7f83f402b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aa7a78d5f352a94 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.121+0000 7f83feffd640 1 -- 172.21.15.45:0/2729217245 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4031880 con 0x7f8400155280 2023-11-18T19:24:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.121+0000 7f83feffd640 1 -- 172.21.15.45:0/2729217245 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f40319e0 con 0x7f8400155280 2023-11-18T19:24:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.121+0000 7f83feffd640 1 -- 172.21.15.45:0/2729217245 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4031d70 con 0x7f8400155280 2023-11-18T19:24:28.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.122+0000 7f84069a9640 1 -- 172.21.15.45:0/2729217245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8400155280 msgr2=0x7f840006c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.122+0000 7f84069a9640 1 --2- 172.21.15.45:0/2729217245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8400155280 0x7f840006c200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009870 tx=0x7f83f402b920 comp rx=0 tx=0).stop 2023-11-18T19:24:28.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.122+0000 7f84069a9640 1 -- 172.21.15.45:0/2729217245 shutdown_connections 2023-11-18T19:24:28.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.122+0000 7f84069a9640 1 --2- 172.21.15.45:0/2729217245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8400155280 0x7f840006c200 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.122+0000 7f84069a9640 1 -- 172.21.15.45:0/2729217245 >> 172.21.15.45:0/2729217245 conn(0x7f84000c9f90 msgr2=0x7f84000ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.122+0000 7f84069a9640 1 -- 172.21.15.45:0/2729217245 shutdown_connections 2023-11-18T19:24:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.123+0000 7f84069a9640 1 -- 172.21.15.45:0/2729217245 wait complete. 2023-11-18T19:24:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.125+0000 7f84069a9640 1 Processor -- start 2023-11-18T19:24:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.125+0000 7f84069a9640 1 -- start start 2023-11-18T19:24:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.126+0000 7f84069a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84000c7640 0x7f84000aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.126+0000 7f84069a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8400152040 0x7f84000be200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.126+0000 7f84069a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8400155280 0x7f840014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.126+0000 7f84069a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840014e730 con 0x7f8400155280 2023-11-18T19:24:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.126+0000 7f84069a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000ae510 con 0x7f84000c7640 2023-11-18T19:24:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.126+0000 7f84069a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000adc20 con 0x7f8400152040 2023-11-18T19:24:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8400155280 0x7f840014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8400155280 0x7f840014da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36498/0 (socket says 172.21.15.45:36498) 2023-11-18T19:24:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 -- 172.21.15.45:0/986186089 learned_addr learned my addr 172.21.15.45:0/986186089 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f83fffff640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84000c7640 0x7f84000aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f83ff7fe640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8400152040 0x7f84000be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 -- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8400152040 msgr2=0x7f84000be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8400152040 0x7f84000be200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 -- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84000c7640 msgr2=0x7f84000aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84000c7640 0x7f84000aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.127+0000 7f8404f46640 1 -- 172.21.15.45:0/986186089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40094d0 con 0x7f8400155280 2023-11-18T19:24:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.128+0000 7f8404f46640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8400155280 0x7f840014da70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f83f800c730 tx=0x7f83f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.128+0000 7f83fcff9640 1 -- 172.21.15.45:0/986186089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800ce40 con 0x7f8400155280 2023-11-18T19:24:28.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.128+0000 7f83fcff9640 1 -- 172.21.15.45:0/986186089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f800a640 con 0x7f8400155280 2023-11-18T19:24:28.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.128+0000 7f83fcff9640 1 -- 172.21.15.45:0/986186089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800a9b0 con 0x7f8400155280 2023-11-18T19:24:28.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.129+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840014e960 con 0x7f8400155280 2023-11-18T19:24:28.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.129+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84000ae1a0 con 0x7f8400155280 2023-11-18T19:24:28.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.130+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84000ae680 con 0x7f8400155280 2023-11-18T19:24:28.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.131+0000 7f83fcff9640 1 -- 172.21.15.45:0/986186089 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f83f800ab10 con 0x7f8400155280 2023-11-18T19:24:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.132+0000 7f83fcff9640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f83ec06ae40 0x7f83ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.132+0000 7f83fcff9640 1 -- 172.21.15.45:0/986186089 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f83f8088fc0 con 0x7f8400155280 2023-11-18T19:24:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.133+0000 7f83fffff640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f83ec06ae40 0x7f83ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.134+0000 7f83fffff640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f83ec06ae40 0x7f83ec06d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83f0000f60 tx=0x7f83f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.140+0000 7f83fcff9640 1 -- 172.21.15.45:0/986186089 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83f80bbe90 con 0x7f8400155280 2023-11-18T19:24:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.396+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f84000c8960 con 0x7f83ec06ae40 2023-11-18T19:24:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.397+0000 7f83fcff9640 1 -- 172.21.15.45:0/986186089 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83f00014a0 con 0x7f83ec06ae40 2023-11-18T19:24:28.398 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-11-18T19:24:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.399+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f83ec06ae40 msgr2=0x7f83ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.399+0000 7f84069a9640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f83ec06ae40 0x7f83ec06d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83f0000f60 tx=0x7f83f0009040 comp rx=0 tx=0).stop 2023-11-18T19:24:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.399+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8400155280 msgr2=0x7f840014da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.399+0000 7f84069a9640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8400155280 0x7f840014da70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f83f800c730 tx=0x7f83f800cbf0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 shutdown_connections 2023-11-18T19:24:28.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8400155280 0x7f840014da70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f83ec06ae40 0x7f83ec06d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8400152040 0x7f84000be200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 --2- 172.21.15.45:0/986186089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84000c7640 0x7f84000aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 >> 172.21.15.45:0/986186089 conn(0x7f84000c9f90 msgr2=0x7f84000c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:28.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 shutdown_connections 2023-11-18T19:24:28.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.400+0000 7f84069a9640 1 -- 172.21.15.45:0/986186089 wait complete. 2023-11-18T19:24:28.416 INFO:tasks.ceph:Scrubbing osd.2 2023-11-18T19:24:28.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:28.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.626+0000 7ff468b7c640 1 Processor -- start 2023-11-18T19:24:28.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.626+0000 7ff468b7c640 1 -- start start 2023-11-18T19:24:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.627+0000 7ff468b7c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4641522e0 0x7ff464071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.627+0000 7ff468b7c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 0x7ff46406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.627+0000 7ff468b7c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff4640c3ec0 0x7ff4640c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.627+0000 7ff468b7c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640c12f0 con 0x7ff4641522e0 2023-11-18T19:24:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.627+0000 7ff468b7c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640c0750 con 0x7ff4640c3ec0 2023-11-18T19:24:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.627+0000 7ff468b7c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640c0a30 con 0x7ff4640c55e0 2023-11-18T19:24:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.627+0000 7ff46259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4641522e0 0x7ff464071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.628+0000 7ff46259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4641522e0 0x7ff464071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36502/0 (socket says 172.21.15.45:36502) 2023-11-18T19:24:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.628+0000 7ff46259c640 1 -- 172.21.15.45:0/3177039036 learned_addr learned my addr 172.21.15.45:0/3177039036 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.628+0000 7ff46259c640 1 -- 172.21.15.45:0/3177039036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 msgr2=0x7ff46406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.628+0000 7ff46259c640 1 --2- 172.21.15.45:0/3177039036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 0x7ff46406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.628+0000 7ff46259c640 1 -- 172.21.15.45:0/3177039036 >> v2:172.21.15.135:3300/0 conn(0x7ff4640c3ec0 msgr2=0x7ff4640c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.628+0000 7ff46259c640 1 --2- 172.21.15.45:0/3177039036 >> v2:172.21.15.135:3300/0 conn(0x7ff4640c3ec0 0x7ff4640c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.628+0000 7ff46259c640 1 -- 172.21.15.45:0/3177039036 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640c0f10 con 0x7ff4641522e0 2023-11-18T19:24:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.629+0000 7ff46259c640 1 --2- 172.21.15.45:0/3177039036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4641522e0 0x7ff464071fb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff46406bd10 tx=0x7ff45402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4767392279b383 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.630+0000 7ff461d9b640 1 -- 172.21.15.45:0/3177039036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540317e0 con 0x7ff4641522e0 2023-11-18T19:24:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.630+0000 7ff461d9b640 1 -- 172.21.15.45:0/3177039036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454031940 con 0x7ff4641522e0 2023-11-18T19:24:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.630+0000 7ff461d9b640 1 -- 172.21.15.45:0/3177039036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454031cd0 con 0x7ff4641522e0 2023-11-18T19:24:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.630+0000 7ff468b7c640 1 -- 172.21.15.45:0/3177039036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4641522e0 msgr2=0x7ff464071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.630+0000 7ff468b7c640 1 --2- 172.21.15.45:0/3177039036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4641522e0 0x7ff464071fb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff46406bd10 tx=0x7ff45402b880 comp rx=0 tx=0).stop 2023-11-18T19:24:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.631+0000 7ff468b7c640 1 -- 172.21.15.45:0/3177039036 shutdown_connections 2023-11-18T19:24:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.631+0000 7ff468b7c640 1 --2- 172.21.15.45:0/3177039036 >> v2:172.21.15.135:3300/0 conn(0x7ff4640c3ec0 0x7ff4640c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.631+0000 7ff468b7c640 1 --2- 172.21.15.45:0/3177039036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 0x7ff46406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.631+0000 7ff468b7c640 1 --2- 172.21.15.45:0/3177039036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4641522e0 0x7ff464071fb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.631+0000 7ff468b7c640 1 -- 172.21.15.45:0/3177039036 >> 172.21.15.45:0/3177039036 conn(0x7ff4640c5bd0 msgr2=0x7ff4640c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:28.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.631+0000 7ff468b7c640 1 -- 172.21.15.45:0/3177039036 shutdown_connections 2023-11-18T19:24:28.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.631+0000 7ff468b7c640 1 -- 172.21.15.45:0/3177039036 wait complete. 2023-11-18T19:24:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.632+0000 7ff468b7c640 1 Processor -- start 2023-11-18T19:24:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.632+0000 7ff468b7c640 1 -- start start 2023-11-18T19:24:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.633+0000 7ff468b7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4640c3ec0 0x7ff4640aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.633+0000 7ff468b7c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 0x7ff46414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.633+0000 7ff468b7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4641522e0 0x7ff46414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.633+0000 7ff468b7c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464153c60 con 0x7ff4640c3ec0 2023-11-18T19:24:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.633+0000 7ff468b7c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46409c340 con 0x7ff4641522e0 2023-11-18T19:24:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.633+0000 7ff468b7c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641edae0 con 0x7ff4640c55e0 2023-11-18T19:24:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.633+0000 7ff46259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4640c3ec0 0x7ff4640aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4640c3ec0 0x7ff4640aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36516/0 (socket says 172.21.15.45:36516) 2023-11-18T19:24:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 -- 172.21.15.45:0/1813556941 learned_addr learned my addr 172.21.15.45:0/1813556941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff45bfff640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 0x7ff46414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 -- 172.21.15.45:0/1813556941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 msgr2=0x7ff46414ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff462d9d640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4641522e0 0x7ff46414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4640c55e0 0x7ff46414ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 -- 172.21.15.45:0/1813556941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4641522e0 msgr2=0x7ff46414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4641522e0 0x7ff46414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 -- 172.21.15.45:0/1813556941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540094d0 con 0x7ff4640c3ec0 2023-11-18T19:24:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.634+0000 7ff46259c640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4640c3ec0 0x7ff4640aa5c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff454000c00 tx=0x7ff4540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.635+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454032880 con 0x7ff4640c3ec0 2023-11-18T19:24:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.635+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4540329e0 con 0x7ff4640c3ec0 2023-11-18T19:24:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.635+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454032d90 con 0x7ff4640c3ec0 2023-11-18T19:24:28.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.635+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4641ee010 con 0x7ff4640c3ec0 2023-11-18T19:24:28.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.635+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4641edd30 con 0x7ff4640c3ec0 2023-11-18T19:24:28.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.636+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4640abfe0 con 0x7ff4640c3ec0 2023-11-18T19:24:28.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.637+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4540453f0 con 0x7ff4640c3ec0 2023-11-18T19:24:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.637+0000 7ff45affd640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff44406ae40 0x7ff44406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.638+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7ff4540abd60 con 0x7ff4640c3ec0 2023-11-18T19:24:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.638+0000 7ff45bfff640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff44406ae40 0x7ff44406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.638+0000 7ff45affd640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7ff444074520 0x7ff4440769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.638+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 --> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff444077090 con 0x7ff444074520 2023-11-18T19:24:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.638+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4540ae420 con 0x7ff4640c3ec0 2023-11-18T19:24:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.638+0000 7ff462d9d640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7ff444074520 0x7ff4440769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.638+0000 7ff45bfff640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff44406ae40 0x7ff44406d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff46409c680 tx=0x7ff44c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.639+0000 7ff462d9d640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7ff444074520 0x7ff4440769c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.639+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== osd.2 v2:172.21.15.45:6824/3279045870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff444077090 con 0x7ff444074520 2023-11-18T19:24:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.653+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 --> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff464067600 con 0x7ff444074520 2023-11-18T19:24:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff45affd640 1 -- 172.21.15.45:0/1813556941 <== osd.2 v2:172.21.15.45:6824/3279045870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff464067600 con 0x7ff444074520 2023-11-18T19:24:28.655 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:28.655 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:28.655 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7ff444074520 msgr2=0x7ff4440769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff468b7c640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6824/3279045870,v1:172.21.15.45:6825/3279045870] conn(0x7ff444074520 0x7ff4440769c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff44406ae40 msgr2=0x7ff44406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff468b7c640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7ff44406ae40 0x7ff44406d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff46409c680 tx=0x7ff44c008040 comp rx=0 tx=0).stop 2023-11-18T19:24:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4640c3ec0 msgr2=0x7ff4640aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff468b7c640 1 --2- 172.21.15.45:0/1813556941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4640c3ec0 0x7ff4640aa5c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff454000c00 tx=0x7ff4540046c0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.654+0000 7ff462d9d640 1 -- 172.21.15.45:0/1813556941 reap_dead start 2023-11-18T19:24:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.655+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 shutdown_connections 2023-11-18T19:24:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.655+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 >> 172.21.15.45:0/1813556941 conn(0x7ff4640c5bd0 msgr2=0x7ff4640bf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.655+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 shutdown_connections 2023-11-18T19:24:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.655+0000 7ff468b7c640 1 -- 172.21.15.45:0/1813556941 wait complete. 2023-11-18T19:24:28.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-18T19:24:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.888+0000 7f9292e90640 1 Processor -- start 2023-11-18T19:24:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.888+0000 7f9292e90640 1 -- start start 2023-11-18T19:24:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.889+0000 7f9292e90640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f928c151a80 0x7f928c0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.889+0000 7f9292e90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c06c6d0 0x7f928c0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.889+0000 7f9292e90640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c0c5090 con 0x7f928c0ca690 2023-11-18T19:24:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.889+0000 7f9292e90640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c154920 con 0x7f928c151a80 2023-11-18T19:24:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.889+0000 7f9292e90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c154c00 con 0x7f928c06c6d0 2023-11-18T19:24:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.890+0000 7f929268f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f928c0ca690 0x7f928c157bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56276/0 (socket says 172.21.15.45:56276) 2023-11-18T19:24:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.890+0000 7f929268f640 1 -- 172.21.15.45:0/3964220475 learned_addr learned my addr 172.21.15.45:0/3964220475 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.890+0000 7f929168d640 1 --2- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c06c6d0 0x7f928c0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.890+0000 7f9291e8e640 1 --2- 172.21.15.45:0/3964220475 >> v2:172.21.15.135:3300/0 conn(0x7f928c151a80 0x7f928c0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.890+0000 7f9290e8c640 1 -- 172.21.15.45:0/3964220475 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7206431 0 0) 0x7f928c0c5090 con 0x7f928c0ca690 2023-11-18T19:24:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.890+0000 7f9290e8c640 1 -- 172.21.15.45:0/3964220475 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9274003520 con 0x7f928c0ca690 2023-11-18T19:24:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.891+0000 7f9291e8e640 1 -- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c06c6d0 msgr2=0x7f928c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.891+0000 7f9291e8e640 1 --2- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c06c6d0 0x7f928c0ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.891+0000 7f9291e8e640 1 -- 172.21.15.45:0/3964220475 >> v1:172.21.15.45:6789/0 conn(0x7f928c0ca690 legacy=0x7f928c157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.891+0000 7f9291e8e640 1 -- 172.21.15.45:0/3964220475 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c154ee0 con 0x7f928c151a80 2023-11-18T19:24:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.892+0000 7f9291e8e640 1 --2- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c151a80 0x7f928c0c4790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f927c009d90 tx=0x7f927c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5e394e848ff7098 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.892+0000 7f9290e8c640 1 -- 172.21.15.45:0/3964220475 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c02cbd0 con 0x7f928c151a80 2023-11-18T19:24:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.892+0000 7f9290e8c640 1 -- 172.21.15.45:0/3964220475 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c02cd30 con 0x7f928c151a80 2023-11-18T19:24:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.892+0000 7f9290e8c640 1 -- 172.21.15.45:0/3964220475 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c02cea0 con 0x7f928c151a80 2023-11-18T19:24:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 -- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c151a80 msgr2=0x7f928c0c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 --2- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c151a80 0x7f928c0c4790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f927c009d90 tx=0x7f927c02be20 comp rx=0 tx=0).stop 2023-11-18T19:24:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 -- 172.21.15.45:0/3964220475 shutdown_connections 2023-11-18T19:24:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 --2- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c06c6d0 0x7f928c0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 --2- 172.21.15.45:0/3964220475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c151a80 0x7f928c0c4790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 -- 172.21.15.45:0/3964220475 >> 172.21.15.45:0/3964220475 conn(0x7f928c0663d0 msgr2=0x7f928c0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 -- 172.21.15.45:0/3964220475 shutdown_connections 2023-11-18T19:24:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.893+0000 7f9292e90640 1 -- 172.21.15.45:0/3964220475 wait complete. 2023-11-18T19:24:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.895+0000 7f9292e90640 1 Processor -- start 2023-11-18T19:24:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.896+0000 7f9292e90640 1 -- start start 2023-11-18T19:24:28.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f9292e90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c06c6d0 0x7f928c1ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f9292e90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c0ca690 0x7f928c0bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f9292e90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f928c151a80 0x7f928c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f9292e90640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0bd920 con 0x7f928c151a80 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f9292e90640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0c99c0 con 0x7f928c06c6d0 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f9292e90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1edaa0 con 0x7f928c0ca690 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f929268f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f928c151a80 0x7f928c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f929268f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f928c151a80 0x7f928c14a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36528/0 (socket says 172.21.15.45:36528) 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f929268f640 1 -- 172.21.15.45:0/2522944347 learned_addr learned my addr 172.21.15.45:0/2522944347 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.897+0000 7f9291e8e640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c06c6d0 0x7f928c1ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929168d640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c0ca690 0x7f928c0bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929268f640 1 -- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c0ca690 msgr2=0x7f928c0bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929268f640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c0ca690 0x7f928c0bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929268f640 1 -- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c06c6d0 msgr2=0x7f928c1ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929268f640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c06c6d0 0x7f928c1ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929268f640 1 -- 172.21.15.45:0/2522944347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009a70 con 0x7f928c151a80 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929168d640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c0ca690 0x7f928c0bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f9291e8e640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c06c6d0 0x7f928c1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f929268f640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f928c151a80 0x7f928c14a0b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f928400c430 tx=0x7f928400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f928a7fc640 1 -- 172.21.15.45:0/2522944347 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284005ce0 con 0x7f928c151a80 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f928a7fc640 1 -- 172.21.15.45:0/2522944347 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284005e40 con 0x7f928c151a80 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f928a7fc640 1 -- 172.21.15.45:0/2522944347 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284007310 con 0x7f928c151a80 2023-11-18T19:24:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.898+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c155580 con 0x7f928c151a80 2023-11-18T19:24:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.899+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c0bde10 con 0x7f928c151a80 2023-11-18T19:24:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.900+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c068410 con 0x7f928c151a80 2023-11-18T19:24:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.901+0000 7f928a7fc640 1 -- 172.21.15.45:0/2522944347 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9284007470 con 0x7f928c151a80 2023-11-18T19:24:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.902+0000 7f928a7fc640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f927806ae40 0x7f927806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.902+0000 7f928a7fc640 1 -- 172.21.15.45:0/2522944347 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9284088f80 con 0x7f928c151a80 2023-11-18T19:24:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.902+0000 7f9291e8e640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f927806ae40 0x7f927806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.903+0000 7f9291e8e640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f927806ae40 0x7f927806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f927c036000 tx=0x7f927c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:28.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:28.907+0000 7f928a7fc640 1 -- 172.21.15.45:0/2522944347 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92840bbe90 con 0x7f928c151a80 2023-11-18T19:24:29.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.093+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f928c0bd090 con 0x7f927806ae40 2023-11-18T19:24:29.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.094+0000 7f928a7fc640 1 -- 172.21.15.45:0/2522944347 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f928c0bd090 con 0x7f927806ae40 2023-11-18T19:24:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-11-18T19:24:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f927806ae40 msgr2=0x7f927806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f927806ae40 0x7f927806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f927c036000 tx=0x7f927c030000 comp rx=0 tx=0).stop 2023-11-18T19:24:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f928c151a80 msgr2=0x7f928c14a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f928c151a80 0x7f928c14a0b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f928400c430 tx=0x7f928400c8f0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 shutdown_connections 2023-11-18T19:24:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f928c151a80 0x7f928c14a0b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f927806ae40 0x7f927806d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f928c0ca690 0x7f928c0bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 --2- 172.21.15.45:0/2522944347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f928c06c6d0 0x7f928c1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 >> 172.21.15.45:0/2522944347 conn(0x7f928c0663d0 msgr2=0x7f928c0667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.097+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 shutdown_connections 2023-11-18T19:24:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.098+0000 7f9292e90640 1 -- 172.21.15.45:0/2522944347 wait complete. 2023-11-18T19:24:29.114 INFO:tasks.ceph:Scrubbing osd.3 2023-11-18T19:24:29.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.335+0000 7f732a021640 1 Processor -- start 2023-11-18T19:24:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.335+0000 7f732a021640 1 -- start start 2023-11-18T19:24:29.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f732a021640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f73241591e0 0x7f73240c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f732a021640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73240c5340 con 0x7f73240c3fa0 2023-11-18T19:24:29.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f732a021640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73241561c0 con 0x7f7324155de0 2023-11-18T19:24:29.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f732a021640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240c5890 con 0x7f73241591e0 2023-11-18T19:24:29.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f7329820640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f73240c3fa0 0x7f73240c43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56280/0 (socket says 172.21.15.45:56280) 2023-11-18T19:24:29.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f7329820640 1 -- 172.21.15.45:0/1504615900 learned_addr learned my addr 172.21.15.45:0/1504615900 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f732881e640 1 --2- 172.21.15.45:0/1504615900 >> v2:172.21.15.135:3300/0 conn(0x7f73241591e0 0x7f73240c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.337+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732319357 0 0) 0x7f73240c5340 con 0x7f73240c3fa0 2023-11-18T19:24:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7310003520 con 0x7f73240c3fa0 2023-11-18T19:24:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1071846962 0 0) 0x7f7310003520 con 0x7f73240c3fa0 2023-11-18T19:24:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 >> v2:172.21.15.135:3300/0 conn(0x7f73241591e0 msgr2=0x7f73240c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 --2- 172.21.15.45:0/1504615900 >> v2:172.21.15.135:3300/0 conn(0x7f73241591e0 0x7f73240c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 >> v1:172.21.15.135:6789/0 conn(0x7f7324155de0 legacy=0x7f73240a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73240c55b0 con 0x7f73240c3fa0 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f731c0019f0 con 0x7f73240c3fa0 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 >> v1:172.21.15.45:6789/0 conn(0x7f73240c3fa0 legacy=0x7f73240c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73100039c0 0x7f7310003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73100047c0 0x7f7310004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73100052a0 0x7f731000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240c5890 con 0x7f73100047c0 2023-11-18T19:24:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731000c1a0 con 0x7f73100039c0 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.338+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731000c360 con 0x7f73100052a0 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f732881e640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73100047c0 0x7f7310004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f732901f640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73100039c0 0x7f7310003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f7329820640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73100052a0 0x7f731000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f732881e640 1 -- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73100052a0 msgr2=0x7f731000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f732881e640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73100052a0 0x7f731000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f732881e640 1 -- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73100039c0 msgr2=0x7f7310003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f732881e640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73100039c0 0x7f7310003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f732881e640 1 -- 172.21.15.45:0/1504615900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310003520 con 0x7f73100047c0 2023-11-18T19:24:29.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.339+0000 7f7329820640 1 -- 172.21.15.45:0/1504615900 reap_dead start 2023-11-18T19:24:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.340+0000 7f732881e640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73100047c0 0x7f7310004c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7314009a90 tx=0x7f73100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d1846d8f561246 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.340+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731402c6b0 con 0x7f73100047c0 2023-11-18T19:24:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.340+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731402c810 con 0x7f73100047c0 2023-11-18T19:24:29.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.340+0000 7f731bfff640 1 -- 172.21.15.45:0/1504615900 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731402cba0 con 0x7f73100047c0 2023-11-18T19:24:29.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.341+0000 7f732a021640 1 -- 172.21.15.45:0/1504615900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73100047c0 msgr2=0x7f7310004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.341+0000 7f732a021640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73100047c0 0x7f7310004c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7314009a90 tx=0x7f73100057f0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.341+0000 7f732a021640 1 -- 172.21.15.45:0/1504615900 shutdown_connections 2023-11-18T19:24:29.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.341+0000 7f732a021640 1 --2- 172.21.15.45:0/1504615900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73100047c0 0x7f7310004c40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.341+0000 7f732a021640 1 -- 172.21.15.45:0/1504615900 >> 172.21.15.45:0/1504615900 conn(0x7f732406a500 msgr2=0x7f732406a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:29.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.341+0000 7f732a021640 1 -- 172.21.15.45:0/1504615900 shutdown_connections 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.341+0000 7f732a021640 1 -- 172.21.15.45:0/1504615900 wait complete. 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.343+0000 7f732a021640 1 Processor -- start 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.343+0000 7f732a021640 1 -- start start 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732a021640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73100047c0 0x7f73240a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732a021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732415c090 0x7f7324150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732a021640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73241511d0 0x7f7324071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732a021640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7324151650 con 0x7f732415c090 2023-11-18T19:24:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732a021640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73241eee80 con 0x7f73241511d0 2023-11-18T19:24:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732a021640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732415abf0 con 0x7f73100047c0 2023-11-18T19:24:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732881e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732415c090 0x7f7324150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732881e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732415c090 0x7f7324150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36544/0 (socket says 172.21.15.45:36544) 2023-11-18T19:24:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.344+0000 7f732881e640 1 -- 172.21.15.45:0/2932685197 learned_addr learned my addr 172.21.15.45:0/2932685197 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f7329820640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73241511d0 0x7f7324071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f732881e640 1 -- 172.21.15.45:0/2932685197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73100047c0 msgr2=0x7f73240a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f732881e640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f73100047c0 0x7f73240a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f732881e640 1 -- 172.21.15.45:0/2932685197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73241511d0 msgr2=0x7f7324071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f732881e640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73241511d0 0x7f7324071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f732881e640 1 -- 172.21.15.45:0/2932685197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732415aed0 con 0x7f732415c090 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f7329820640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73241511d0 0x7f7324071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f732881e640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732415c090 0x7f7324150c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f731402c250 tx=0x7f7314004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314003810 con 0x7f732415c090 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314003970 con 0x7f732415c090 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314003ce0 con 0x7f732415c090 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.345+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732415b1b0 con 0x7f732415c090 2023-11-18T19:24:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.346+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732415b490 con 0x7f732415c090 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.346+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73240c1050 con 0x7f732415c090 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.348+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7314040450 con 0x7f732415c090 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.348+0000 7f7319ffb640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f730806ae40 0x7f730806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.348+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f73140ab870 con 0x7f732415c090 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.349+0000 7f732901f640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f730806ae40 0x7f730806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.349+0000 7f7319ffb640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f7308074520 0x7f73080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.349+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 --> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7308077090 con 0x7f7308074520 2023-11-18T19:24:29.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.349+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73140ade50 con 0x7f732415c090 2023-11-18T19:24:29.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.349+0000 7f7329820640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f7308074520 0x7f73080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.349+0000 7f732901f640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f730806ae40 0x7f730806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7320007fd0 tx=0x7f7320009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:29.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.350+0000 7f7329820640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f7308074520 0x7f73080769c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:29.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.350+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== osd.3 v2:172.21.15.45:6808/2848358823 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7308077090 con 0x7f7308074520 2023-11-18T19:24:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.365+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 --> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7324159670 con 0x7f7308074520 2023-11-18T19:24:29.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.365+0000 7f7319ffb640 1 -- 172.21.15.45:0/2932685197 <== osd.3 v2:172.21.15.45:6808/2848358823 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f731c001a70 con 0x7f7308074520 2023-11-18T19:24:29.366 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:29.366 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:29.366 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f7308074520 msgr2=0x7f73080769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6808/2848358823,v1:172.21.15.45:6809/2848358823] conn(0x7f7308074520 0x7f73080769c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f730806ae40 msgr2=0x7f730806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f730806ae40 0x7f730806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7320007fd0 tx=0x7f7320009040 comp rx=0 tx=0).stop 2023-11-18T19:24:29.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732415c090 msgr2=0x7f7324150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 --2- 172.21.15.45:0/2932685197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732415c090 0x7f7324150c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f731402c250 tx=0x7f7314004730 comp rx=0 tx=0).stop 2023-11-18T19:24:29.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f7329820640 1 -- 172.21.15.45:0/2932685197 reap_dead start 2023-11-18T19:24:29.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 shutdown_connections 2023-11-18T19:24:29.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 >> 172.21.15.45:0/2932685197 conn(0x7f732406a500 msgr2=0x7f732406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:29.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 shutdown_connections 2023-11-18T19:24:29.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.366+0000 7f732a021640 1 -- 172.21.15.45:0/2932685197 wait complete. 2023-11-18T19:24:29.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-18T19:24:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.610+0000 7f4106e8a640 1 Processor -- start 2023-11-18T19:24:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.610+0000 7f4106e8a640 1 -- start start 2023-11-18T19:24:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.611+0000 7f4106e8a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41000c1370 0x7f4100072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.611+0000 7f4106e8a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f41000bef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.611+0000 7f4106e8a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410006d9d0 con 0x7f41000c56a0 2023-11-18T19:24:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.611+0000 7f4106e8a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41000a8ea0 con 0x7f41000c1370 2023-11-18T19:24:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.611+0000 7f4106e8a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41000c48c0 con 0x7f41000c0b30 2023-11-18T19:24:29.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4105e88640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41000c1370 0x7f4100072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4106689640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f41000c56a0 0x7f41000bf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56288/0 (socket says 172.21.15.45:56288) 2023-11-18T19:24:29.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4106689640 1 -- 172.21.15.45:0/2892439973 learned_addr learned my addr 172.21.15.45:0/2892439973 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:29.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4105687640 1 --2- 172.21.15.45:0/2892439973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f41000bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4105e88640 1 -- 172.21.15.45:0/2892439973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 msgr2=0x7f41000bef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:29.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4105e88640 1 --2- 172.21.15.45:0/2892439973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f41000bef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4105e88640 1 -- 172.21.15.45:0/2892439973 >> v1:172.21.15.45:6789/0 conn(0x7f41000c56a0 legacy=0x7f41000bf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.612+0000 7f4105e88640 1 -- 172.21.15.45:0/2892439973 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41000c4ba0 con 0x7f41000c1370 2023-11-18T19:24:29.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.613+0000 7f4105e88640 1 --2- 172.21.15.45:0/2892439973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f4100072130 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0097a0 tx=0x7f40fc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7254a586dd2dab8b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:29.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4104e86640 1 -- 172.21.15.45:0/2892439973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc031780 con 0x7f41000c1370 2023-11-18T19:24:29.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4104e86640 1 -- 172.21.15.45:0/2892439973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc0318e0 con 0x7f41000c1370 2023-11-18T19:24:29.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4104e86640 1 -- 172.21.15.45:0/2892439973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc031c70 con 0x7f41000c1370 2023-11-18T19:24:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4106e8a640 1 -- 172.21.15.45:0/2892439973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 msgr2=0x7f4100072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4106e8a640 1 --2- 172.21.15.45:0/2892439973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f4100072130 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0097a0 tx=0x7f40fc02b820 comp rx=0 tx=0).stop 2023-11-18T19:24:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4106e8a640 1 -- 172.21.15.45:0/2892439973 shutdown_connections 2023-11-18T19:24:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4106e8a640 1 --2- 172.21.15.45:0/2892439973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f41000bef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4106e8a640 1 --2- 172.21.15.45:0/2892439973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f4100072130 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4106e8a640 1 -- 172.21.15.45:0/2892439973 >> 172.21.15.45:0/2892439973 conn(0x7f41000a7910 msgr2=0x7f41000a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.614+0000 7f4106e8a640 1 -- 172.21.15.45:0/2892439973 shutdown_connections 2023-11-18T19:24:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.615+0000 7f4106e8a640 1 -- 172.21.15.45:0/2892439973 wait complete. 2023-11-18T19:24:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.616+0000 7f4106e8a640 1 Processor -- start 2023-11-18T19:24:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.616+0000 7f4106e8a640 1 -- start start 2023-11-18T19:24:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.617+0000 7f4106e8a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f410014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.617+0000 7f4106e8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f41001de060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.617+0000 7f4106e8a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41000c56a0 0x7f410014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.617+0000 7f4106e8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410006c750 con 0x7f41000c1370 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.617+0000 7f4106e8a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41001dfeb0 con 0x7f41000c56a0 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.617+0000 7f4106e8a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410006c090 con 0x7f41000c0b30 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f41001de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f41001de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36558/0 (socket says 172.21.15.45:36558) 2023-11-18T19:24:29.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 -- 172.21.15.45:0/3042554124 learned_addr learned my addr 172.21.15.45:0/3042554124 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105e88640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f410014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 -- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 msgr2=0x7f410014ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f410014ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 -- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41000c56a0 msgr2=0x7f410014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4106689640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41000c56a0 0x7f410014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41000c56a0 0x7f410014e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 -- 172.21.15.45:0/3042554124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc009400 con 0x7f41000c1370 2023-11-18T19:24:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4106689640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41000c56a0 0x7f410014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.618+0000 7f4105687640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f41001de060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d5c0 tx=0x7f40f000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.619+0000 7f40f67fc640 1 -- 172.21.15.45:0/3042554124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00125f0 con 0x7f41000c1370 2023-11-18T19:24:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.619+0000 7f40f67fc640 1 -- 172.21.15.45:0/3042554124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f0012750 con 0x7f41000c1370 2023-11-18T19:24:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.619+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410006c370 con 0x7f41000c1370 2023-11-18T19:24:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.619+0000 7f40f67fc640 1 -- 172.21.15.45:0/3042554124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0012b00 con 0x7f41000c1370 2023-11-18T19:24:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.619+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41001de5a0 con 0x7f41000c1370 2023-11-18T19:24:29.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.620+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410006bef0 con 0x7f41000c1370 2023-11-18T19:24:29.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.621+0000 7f40f67fc640 1 -- 172.21.15.45:0/3042554124 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40f0012c60 con 0x7f41000c1370 2023-11-18T19:24:29.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.622+0000 7f40f67fc640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f40e406ae40 0x7f40e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:29.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.622+0000 7f40f67fc640 1 -- 172.21.15.45:0/3042554124 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f40f0089e20 con 0x7f41000c1370 2023-11-18T19:24:29.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.622+0000 7f4105e88640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f40e406ae40 0x7f40e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:29.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.623+0000 7f4105e88640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f40e406ae40 0x7f40e406d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f40fc036000 tx=0x7f40fc03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.627+0000 7f40f67fc640 1 -- 172.21.15.45:0/3042554124 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f410006bef0 con 0x7f41000c1370 2023-11-18T19:24:29.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.870+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f41000c1750 con 0x7f40e406ae40 2023-11-18T19:24:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.872+0000 7f40f67fc640 1 -- 172.21.15.45:0/3042554124 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f40fc031a50 con 0x7f40e406ae40 2023-11-18T19:24:29.873 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-11-18T19:24:29.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.875+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f40e406ae40 msgr2=0x7f40e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f40e406ae40 0x7f40e406d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f40fc036000 tx=0x7f40fc03d040 comp rx=0 tx=0).stop 2023-11-18T19:24:29.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 msgr2=0x7f41001de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:29.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f41001de060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d5c0 tx=0x7f40f000da80 comp rx=0 tx=0).stop 2023-11-18T19:24:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 shutdown_connections 2023-11-18T19:24:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41000c56a0 0x7f410014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41000c1370 0x7f41001de060 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f40e406ae40 0x7f40e406d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 --2- 172.21.15.45:0/3042554124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41000c0b30 0x7f410014ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 >> 172.21.15.45:0/3042554124 conn(0x7f41000a7910 msgr2=0x7f41000a7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 shutdown_connections 2023-11-18T19:24:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:29.876+0000 7f4106e8a640 1 -- 172.21.15.45:0/3042554124 wait complete. 2023-11-18T19:24:29.897 INFO:tasks.ceph:Scrubbing osd.4 2023-11-18T19:24:29.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:30.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.112+0000 7f42ab59e640 1 Processor -- start 2023-11-18T19:24:30.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.112+0000 7f42ab59e640 1 -- start start 2023-11-18T19:24:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.113+0000 7f42ab59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42ac151c80 0x7f42ac0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.113+0000 7f42ab59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac158490 0x7f42ac154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.113+0000 7f42ab59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac0c47a0 con 0x7f42ac0c8190 2023-11-18T19:24:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.113+0000 7f42ab59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac1554c0 con 0x7f42ac151c80 2023-11-18T19:24:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.113+0000 7f42ab59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac06cb70 con 0x7f42ac158490 2023-11-18T19:24:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aa59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42ac151c80 0x7f42ac0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aa59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42ac151c80 0x7f42ac0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36566/0 (socket says 172.21.15.45:36566) 2023-11-18T19:24:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aa59c640 1 -- 172.21.15.45:0/1430801085 learned_addr learned my addr 172.21.15.45:0/1430801085 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aad9d640 1 --1- 172.21.15.45:0/1430801085 >> v1:172.21.15.45:6789/0 conn(0x7f42ac0c8190 0x7f42ac154db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56294/0 (socket says 172.21.15.45:56294) 2023-11-18T19:24:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42a9d9b640 1 --2- 172.21.15.45:0/1430801085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac158490 0x7f42ac154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aa59c640 1 -- 172.21.15.45:0/1430801085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac158490 msgr2=0x7f42ac154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aa59c640 1 --2- 172.21.15.45:0/1430801085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac158490 0x7f42ac154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aa59c640 1 -- 172.21.15.45:0/1430801085 >> v1:172.21.15.45:6789/0 conn(0x7f42ac0c8190 legacy=0x7f42ac154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.114+0000 7f42aa59c640 1 -- 172.21.15.45:0/1430801085 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac0c4a10 con 0x7f42ac151c80 2023-11-18T19:24:30.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.115+0000 7f42aa59c640 1 --2- 172.21.15.45:0/1430801085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac151c80 0x7f42ac0ca490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f429c009e50 tx=0x7f429c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcf21b31c220c66 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42a959a640 1 -- 172.21.15.45:0/1430801085 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c02c9f0 con 0x7f42ac151c80 2023-11-18T19:24:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42a959a640 1 -- 172.21.15.45:0/1430801085 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c02cb50 con 0x7f42ac151c80 2023-11-18T19:24:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42a959a640 1 -- 172.21.15.45:0/1430801085 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c0343f0 con 0x7f42ac151c80 2023-11-18T19:24:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42ab59e640 1 -- 172.21.15.45:0/1430801085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac151c80 msgr2=0x7f42ac0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42ab59e640 1 --2- 172.21.15.45:0/1430801085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac151c80 0x7f42ac0ca490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f429c009e50 tx=0x7f429c02be50 comp rx=0 tx=0).stop 2023-11-18T19:24:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42ab59e640 1 -- 172.21.15.45:0/1430801085 shutdown_connections 2023-11-18T19:24:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42ab59e640 1 --2- 172.21.15.45:0/1430801085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac158490 0x7f42ac154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42ab59e640 1 --2- 172.21.15.45:0/1430801085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac151c80 0x7f42ac0ca490 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.116+0000 7f42ab59e640 1 -- 172.21.15.45:0/1430801085 >> 172.21.15.45:0/1430801085 conn(0x7f42ac066820 msgr2=0x7f42ac0c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.117+0000 7f42ab59e640 1 -- 172.21.15.45:0/1430801085 shutdown_connections 2023-11-18T19:24:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.117+0000 7f42ab59e640 1 -- 172.21.15.45:0/1430801085 wait complete. 2023-11-18T19:24:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.118+0000 7f42ab59e640 1 Processor -- start 2023-11-18T19:24:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.119+0000 7f42ab59e640 1 -- start start 2023-11-18T19:24:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.119+0000 7f42ab59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac0c8190 0x7f42ac146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.119+0000 7f42ab59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ac151c80 0x7f42ac144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.119+0000 7f42ab59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac144c80 0x7f42ac1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.119+0000 7f42ab59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac14dca0 con 0x7f42ac144c80 2023-11-18T19:24:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.119+0000 7f42ab59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac156a80 con 0x7f42ac151c80 2023-11-18T19:24:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.119+0000 7f42ab59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac156270 con 0x7f42ac0c8190 2023-11-18T19:24:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac144c80 0x7f42ac1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac144c80 0x7f42ac1446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36578/0 (socket says 172.21.15.45:36578) 2023-11-18T19:24:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 -- 172.21.15.45:0/3257237875 learned_addr learned my addr 172.21.15.45:0/3257237875 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:30.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aa59c640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac0c8190 0x7f42ac146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 -- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac0c8190 msgr2=0x7f42ac146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42a9d9b640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ac151c80 0x7f42ac144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac0c8190 0x7f42ac146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 -- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ac151c80 msgr2=0x7f42ac144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ac151c80 0x7f42ac144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aad9d640 1 -- 172.21.15.45:0/3257237875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c009b30 con 0x7f42ac144c80 2023-11-18T19:24:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.120+0000 7f42aa59c640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42ac0c8190 0x7f42ac146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.121+0000 7f42aad9d640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac144c80 0x7f42ac1446a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f42a400c400 tx=0x7f42a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.121+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40074e0 con 0x7f42ac144c80 2023-11-18T19:24:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.121+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4007640 con 0x7f42ac144c80 2023-11-18T19:24:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.121+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40049e0 con 0x7f42ac144c80 2023-11-18T19:24:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.121+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac1564c0 con 0x7f42ac144c80 2023-11-18T19:24:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.121+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac14c0c0 con 0x7f42ac144c80 2023-11-18T19:24:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.122+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42ac0c4fd0 con 0x7f42ac144c80 2023-11-18T19:24:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.123+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42a4004b40 con 0x7f42ac144c80 2023-11-18T19:24:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.124+0000 7f42a2ffd640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f428c06ae40 0x7f428c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.124+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f42a40892e0 con 0x7f42ac144c80 2023-11-18T19:24:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.124+0000 7f42aa59c640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f428c06ae40 0x7f428c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.124+0000 7f42a2ffd640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f428c074520 0x7f428c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.124+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 --> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f428c077090 con 0x7f428c074520 2023-11-18T19:24:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.124+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42a408b9a0 con 0x7f42ac144c80 2023-11-18T19:24:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.125+0000 7f42aa59c640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f428c06ae40 0x7f428c06d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f429c035000 tx=0x7f429c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.125+0000 7f42a9d9b640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f428c074520 0x7f428c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.126+0000 7f42a9d9b640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f428c074520 0x7f428c0769c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.128+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== osd.4 v2:172.21.15.135:6800/2682063335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f428c077090 con 0x7f428c074520 2023-11-18T19:24:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.143+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 --> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f42ac158920 con 0x7f428c074520 2023-11-18T19:24:30.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.144+0000 7f42a2ffd640 1 -- 172.21.15.45:0/3257237875 <== osd.4 v2:172.21.15.135:6800/2682063335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4294009120 con 0x7f428c074520 2023-11-18T19:24:30.146 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:30.146 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:30.146 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f428c074520 msgr2=0x7f428c0769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.135:6800/2682063335,v1:172.21.15.135:6801/2682063335] conn(0x7f428c074520 0x7f428c0769c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f428c06ae40 msgr2=0x7f428c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f428c06ae40 0x7f428c06d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f429c035000 tx=0x7f429c030000 comp rx=0 tx=0).stop 2023-11-18T19:24:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac144c80 msgr2=0x7f42ac1446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 --2- 172.21.15.45:0/3257237875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42ac144c80 0x7f42ac1446a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f42a400c400 tx=0x7f42a400c8c0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42aad9d640 1 -- 172.21.15.45:0/3257237875 reap_dead start 2023-11-18T19:24:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 shutdown_connections 2023-11-18T19:24:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 >> 172.21.15.45:0/3257237875 conn(0x7f42ac066820 msgr2=0x7f42ac150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:30.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 shutdown_connections 2023-11-18T19:24:30.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.145+0000 7f42ab59e640 1 -- 172.21.15.45:0/3257237875 wait complete. 2023-11-18T19:24:30.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-18T19:24:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.380+0000 7fcaab6f2640 1 Processor -- start 2023-11-18T19:24:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.381+0000 7fcaab6f2640 1 -- start start 2023-11-18T19:24:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaab6f2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcaa4151f70 0x7fcaa40c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaab6f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa40a7120 0x7fcaa4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaab6f2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcaa4070600 0x7fcaa4158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaab6f2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa40a7890 con 0x7fcaa4151f70 2023-11-18T19:24:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaab6f2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa40c74f0 con 0x7fcaa4070600 2023-11-18T19:24:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaab6f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4152350 con 0x7fcaa40a7120 2023-11-18T19:24:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaa948e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcaa4151f70 0x7fcaa40c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaa948e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcaa4151f70 0x7fcaa40c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36586/0 (socket says 172.21.15.45:36586) 2023-11-18T19:24:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.382+0000 7fcaa948e640 1 -- 172.21.15.45:0/3895879241 learned_addr learned my addr 172.21.15.45:0/3895879241 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa8c8d640 1 --2- 172.21.15.45:0/3895879241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa40a7120 0x7fcaa4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa948e640 1 -- 172.21.15.45:0/3895879241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa40a7120 msgr2=0x7fcaa4157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa9c8f640 1 --2- 172.21.15.45:0/3895879241 >> v2:172.21.15.135:3300/0 conn(0x7fcaa4070600 0x7fcaa4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa948e640 1 --2- 172.21.15.45:0/3895879241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa40a7120 0x7fcaa4157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa948e640 1 -- 172.21.15.45:0/3895879241 >> v2:172.21.15.135:3300/0 conn(0x7fcaa4070600 msgr2=0x7fcaa4158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa948e640 1 --2- 172.21.15.45:0/3895879241 >> v2:172.21.15.135:3300/0 conn(0x7fcaa4070600 0x7fcaa4158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa948e640 1 -- 172.21.15.45:0/3895879241 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40a75b0 con 0x7fcaa4151f70 2023-11-18T19:24:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa8c8d640 1 --2- 172.21.15.45:0/3895879241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa40a7120 0x7fcaa4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.383+0000 7fcaa9c8f640 1 --2- 172.21.15.45:0/3895879241 >> v2:172.21.15.135:3300/0 conn(0x7fcaa4070600 0x7fcaa4158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.384+0000 7fcaa948e640 1 --2- 172.21.15.45:0/3895879241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4151f70 0x7fcaa40c4760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4073c70 tx=0x7fcaa002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e073b0fc1505d536 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.384+0000 7fca9bfff640 1 -- 172.21.15.45:0/3895879241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa00317e0 con 0x7fcaa4151f70 2023-11-18T19:24:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.384+0000 7fca9bfff640 1 -- 172.21.15.45:0/3895879241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa0031940 con 0x7fcaa4151f70 2023-11-18T19:24:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.384+0000 7fca9bfff640 1 -- 172.21.15.45:0/3895879241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0031cd0 con 0x7fcaa4151f70 2023-11-18T19:24:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 -- 172.21.15.45:0/3895879241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4151f70 msgr2=0x7fcaa40c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/3895879241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4151f70 0x7fcaa40c4760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4073c70 tx=0x7fcaa002b880 comp rx=0 tx=0).stop 2023-11-18T19:24:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 -- 172.21.15.45:0/3895879241 shutdown_connections 2023-11-18T19:24:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/3895879241 >> v2:172.21.15.135:3300/0 conn(0x7fcaa4070600 0x7fcaa4158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/3895879241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa40a7120 0x7fcaa4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/3895879241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4151f70 0x7fcaa40c4760 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 -- 172.21.15.45:0/3895879241 >> 172.21.15.45:0/3895879241 conn(0x7fcaa40c7cd0 msgr2=0x7fcaa40c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 -- 172.21.15.45:0/3895879241 shutdown_connections 2023-11-18T19:24:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.385+0000 7fcaab6f2640 1 -- 172.21.15.45:0/3895879241 wait complete. 2023-11-18T19:24:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.387+0000 7fcaab6f2640 1 Processor -- start 2023-11-18T19:24:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.387+0000 7fcaab6f2640 1 -- start start 2023-11-18T19:24:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaab6f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4070600 0x7fcaa4158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaab6f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4151f70 0x7fcaa40a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaab6f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa40ad060 0x7fcaa40ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaab6f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40aad80 con 0x7fcaa40ad060 2023-11-18T19:24:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaab6f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40ab340 con 0x7fcaa4151f70 2023-11-18T19:24:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaab6f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40ac930 con 0x7fcaa4070600 2023-11-18T19:24:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaa9c8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa40ad060 0x7fcaa40ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaa9c8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa40ad060 0x7fcaa40ab7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36594/0 (socket says 172.21.15.45:36594) 2023-11-18T19:24:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaa9c8f640 1 -- 172.21.15.45:0/4283613184 learned_addr learned my addr 172.21.15.45:0/4283613184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaa948e640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4070600 0x7fcaa4158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.388+0000 7fcaa8c8d640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4151f70 0x7fcaa40a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaa9c8f640 1 -- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4070600 msgr2=0x7fcaa4158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaa9c8f640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4070600 0x7fcaa4158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaa9c8f640 1 -- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4151f70 msgr2=0x7fcaa40a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaa9c8f640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4151f70 0x7fcaa40a79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaa9c8f640 1 -- 172.21.15.45:0/4283613184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00094d0 con 0x7fcaa40ad060 2023-11-18T19:24:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaa8c8d640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4151f70 0x7fcaa40a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:24:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaa9c8f640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa40ad060 0x7fcaa40ab7d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00cea0 tx=0x7fca9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fca99ffb640 1 -- 172.21.15.45:0/4283613184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c003b90 con 0x7fcaa40ad060 2023-11-18T19:24:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fca99ffb640 1 -- 172.21.15.45:0/4283613184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c003d10 con 0x7fcaa40ad060 2023-11-18T19:24:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fca99ffb640 1 -- 172.21.15.45:0/4283613184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c004260 con 0x7fcaa40ad060 2023-11-18T19:24:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40a7f10 con 0x7fcaa40ad060 2023-11-18T19:24:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.389+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa41edc80 con 0x7fcaa40ad060 2023-11-18T19:24:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.391+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa40ab4b0 con 0x7fcaa40ad060 2023-11-18T19:24:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.391+0000 7fca99ffb640 1 -- 172.21.15.45:0/4283613184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca9c0043c0 con 0x7fcaa40ad060 2023-11-18T19:24:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.392+0000 7fca99ffb640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fca8806ae40 0x7fca8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.392+0000 7fca99ffb640 1 -- 172.21.15.45:0/4283613184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fca9c08a240 con 0x7fcaa40ad060 2023-11-18T19:24:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.393+0000 7fcaa948e640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fca8806ae40 0x7fca8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.393+0000 7fcaa948e640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fca8806ae40 0x7fca8806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0036000 tx=0x7fcaa003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.397+0000 7fca99ffb640 1 -- 172.21.15.45:0/4283613184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca9c054f90 con 0x7fcaa40ad060 2023-11-18T19:24:30.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.592+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaa40c7180 con 0x7fca8806ae40 2023-11-18T19:24:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.593+0000 7fca99ffb640 1 -- 172.21.15.45:0/4283613184 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcaa0031bb0 con 0x7fca8806ae40 2023-11-18T19:24:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-11-18T19:24:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fca8806ae40 msgr2=0x7fca8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fca8806ae40 0x7fca8806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0036000 tx=0x7fcaa003d040 comp rx=0 tx=0).stop 2023-11-18T19:24:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa40ad060 msgr2=0x7fcaa40ab7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa40ad060 0x7fcaa40ab7d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00cea0 tx=0x7fca9c00cf90 comp rx=0 tx=0).stop 2023-11-18T19:24:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 shutdown_connections 2023-11-18T19:24:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa40ad060 0x7fcaa40ab7d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4151f70 0x7fcaa40a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fca8806ae40 0x7fca8806d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 --2- 172.21.15.45:0/4283613184 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4070600 0x7fcaa4158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 >> 172.21.15.45:0/4283613184 conn(0x7fcaa40c7cd0 msgr2=0x7fcaa40c28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 shutdown_connections 2023-11-18T19:24:30.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.596+0000 7fcaab6f2640 1 -- 172.21.15.45:0/4283613184 wait complete. 2023-11-18T19:24:30.617 INFO:tasks.ceph:Scrubbing osd.5 2023-11-18T19:24:30.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.830+0000 7f8c2f3fb640 1 Processor -- start 2023-11-18T19:24:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.830+0000 7f8c2f3fb640 1 -- start start 2023-11-18T19:24:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.831+0000 7f8c2f3fb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c2806df90 0x7f8c28155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.831+0000 7f8c2f3fb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2806bfa0 con 0x7f8c280c52d0 2023-11-18T19:24:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.831+0000 7f8c2f3fb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c280c4ec0 con 0x7f8c2806d4a0 2023-11-18T19:24:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.831+0000 7f8c2f3fb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c281530b0 con 0x7f8c2806df90 2023-11-18T19:24:30.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.832+0000 7f8c2ebfa640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8c280c52d0 0x7f8c28156010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56300/0 (socket says 172.21.15.45:56300) 2023-11-18T19:24:30.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.832+0000 7f8c2ebfa640 1 -- 172.21.15.45:0/1073148286 learned_addr learned my addr 172.21.15.45:0/1073148286 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:30.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.832+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1073148286 >> v2:172.21.15.135:3300/0 conn(0x7f8c2806df90 0x7f8c28155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.832+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656910089 0 0) 0x7f8c20001110 con 0x7f8c280c52d0 2023-11-18T19:24:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.832+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c14003520 con 0x7f8c280c52d0 2023-11-18T19:24:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1948873684 0 0) 0x7f8c14003520 con 0x7f8c280c52d0 2023-11-18T19:24:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 >> v2:172.21.15.135:3300/0 conn(0x7f8c2806df90 msgr2=0x7f8c28155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 --2- 172.21.15.45:0/1073148286 >> v2:172.21.15.135:3300/0 conn(0x7f8c2806df90 0x7f8c28155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 >> v1:172.21.15.135:6789/0 conn(0x7f8c2806d4a0 legacy=0x7f8c2806d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28152b30 con 0x7f8c280c52d0 2023-11-18T19:24:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f8c20001800 con 0x7f8c280c52d0 2023-11-18T19:24:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 >> v1:172.21.15.45:6789/0 conn(0x7f8c280c52d0 legacy=0x7f8c28156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c140039c0 0x7f8c14003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c140047c0 0x7f8c14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c14005180 0x7f8c1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281530b0 con 0x7f8c140047c0 2023-11-18T19:24:30.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1400c080 con 0x7f8c140039c0 2023-11-18T19:24:30.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1400c240 con 0x7f8c14005180 2023-11-18T19:24:30.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.833+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c140047c0 0x7f8c14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.834+0000 7f8c2dbf8640 1 -- 172.21.15.45:0/1073148286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c14005180 msgr2=0x7f8c1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:30.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.834+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c14005180 0x7f8c1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.834+0000 7f8c2dbf8640 1 -- 172.21.15.45:0/1073148286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c140039c0 msgr2=0x7f8c14003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:30.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.834+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c140039c0 0x7f8c14003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.834+0000 7f8c2dbf8640 1 -- 172.21.15.45:0/1073148286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14003520 con 0x7f8c140047c0 2023-11-18T19:24:30.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.834+0000 7f8c2ebfa640 1 -- 172.21.15.45:0/1073148286 reap_dead start 2023-11-18T19:24:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.835+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c140047c0 0x7f8c14004c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8c28074360 tx=0x7f8c140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee589a343c88f5a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.835+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1802cb90 con 0x7f8c140047c0 2023-11-18T19:24:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.835+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1800f040 con 0x7f8c140047c0 2023-11-18T19:24:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.835+0000 7f8c2d3f7640 1 -- 172.21.15.45:0/1073148286 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18034440 con 0x7f8c140047c0 2023-11-18T19:24:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.836+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1073148286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c140047c0 msgr2=0x7f8c14004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.836+0000 7f8c2f3fb640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c140047c0 0x7f8c14004c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8c28074360 tx=0x7f8c140057f0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.836+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1073148286 shutdown_connections 2023-11-18T19:24:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.836+0000 7f8c2f3fb640 1 --2- 172.21.15.45:0/1073148286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c140047c0 0x7f8c14004c40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.836+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1073148286 >> 172.21.15.45:0/1073148286 conn(0x7f8c2806a500 msgr2=0x7f8c2806a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.836+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1073148286 shutdown_connections 2023-11-18T19:24:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.836+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1073148286 wait complete. 2023-11-18T19:24:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.838+0000 7f8c2f3fb640 1 Processor -- start 2023-11-18T19:24:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.838+0000 7f8c2f3fb640 1 -- start start 2023-11-18T19:24:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2f3fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c140047c0 0x7f8c280c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2f3fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2814b940 0x7f8c28144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2f3fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c281447a0 0x7f8c281eb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2f3fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281dc1c0 con 0x7f8c2814b940 2023-11-18T19:24:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2f3fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28143d80 con 0x7f8c140047c0 2023-11-18T19:24:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2f3fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c1710 con 0x7f8c281447a0 2023-11-18T19:24:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2dbf8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2814b940 0x7f8c28144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2dbf8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2814b940 0x7f8c28144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36608/0 (socket says 172.21.15.45:36608) 2023-11-18T19:24:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.839+0000 7f8c2dbf8640 1 -- 172.21.15.45:0/1873562957 learned_addr learned my addr 172.21.15.45:0/1873562957 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2dbf8640 1 -- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c281447a0 msgr2=0x7f8c281eb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c281447a0 0x7f8c281eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2dbf8640 1 -- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c140047c0 msgr2=0x7f8c280c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c140047c0 0x7f8c280c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2dbf8640 1 -- 172.21.15.45:0/1873562957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280c19f0 con 0x7f8c2814b940 2023-11-18T19:24:30.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2dbf8640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2814b940 0x7f8c28144260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c1802c530 tx=0x7f8c18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1803e400 con 0x7f8c2814b940 2023-11-18T19:24:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1803e580 con 0x7f8c2814b940 2023-11-18T19:24:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1803e930 con 0x7f8c2814b940 2023-11-18T19:24:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c280c1cd0 con 0x7f8c2814b940 2023-11-18T19:24:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.840+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c280c1fb0 con 0x7f8c2814b940 2023-11-18T19:24:30.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.841+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c2806b9e0 con 0x7f8c2814b940 2023-11-18T19:24:30.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.843+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c1803ea90 con 0x7f8c2814b940 2023-11-18T19:24:30.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.843+0000 7f8c1effd640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c0c06ae70 0x7f8c0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.844+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8c180ac120 con 0x7f8c2814b940 2023-11-18T19:24:30.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.844+0000 7f8c2e3f9640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c0c06ae70 0x7f8c0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.844+0000 7f8c1effd640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7f8c0c074550 0x7f8c0c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.844+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 --> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c0c0770c0 con 0x7f8c0c074550 2023-11-18T19:24:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.844+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c180ae700 con 0x7f8c2814b940 2023-11-18T19:24:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.844+0000 7f8c2e3f9640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c0c06ae70 0x7f8c0c06d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8c28067ad0 tx=0x7f8c240079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.845+0000 7f8c2ebfa640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7f8c0c074550 0x7f8c0c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.846+0000 7f8c2ebfa640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7f8c0c074550 0x7f8c0c0769f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.848+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== osd.5 v2:172.21.15.135:6821/1627929657 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8c0c0770c0 con 0x7f8c0c074550 2023-11-18T19:24:30.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.863+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 --> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c28152dd0 con 0x7f8c0c074550 2023-11-18T19:24:30.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.864+0000 7f8c1effd640 1 -- 172.21.15.45:0/1873562957 <== osd.5 v2:172.21.15.135:6821/1627929657 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8c20001ac0 con 0x7f8c0c074550 2023-11-18T19:24:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:30.867 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7f8c0c074550 msgr2=0x7f8c0c0769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.135:6821/1627929657,v1:172.21.15.135:6822/1627929657] conn(0x7f8c0c074550 0x7f8c0c0769f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c0c06ae70 msgr2=0x7f8c0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8c0c06ae70 0x7f8c0c06d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8c28067ad0 tx=0x7f8c240079d0 comp rx=0 tx=0).stop 2023-11-18T19:24:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2814b940 msgr2=0x7f8c28144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 --2- 172.21.15.45:0/1873562957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2814b940 0x7f8c28144260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c1802c530 tx=0x7f8c18009750 comp rx=0 tx=0).stop 2023-11-18T19:24:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2ebfa640 1 -- 172.21.15.45:0/1873562957 reap_dead start 2023-11-18T19:24:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 shutdown_connections 2023-11-18T19:24:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 >> 172.21.15.45:0/1873562957 conn(0x7f8c2806a500 msgr2=0x7f8c28151b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 shutdown_connections 2023-11-18T19:24:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:30.865+0000 7f8c2f3fb640 1 -- 172.21.15.45:0/1873562957 wait complete. 2023-11-18T19:24:30.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-18T19:24:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.106+0000 7f74dde40640 1 Processor -- start 2023-11-18T19:24:31.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.106+0000 7f74dde40640 1 -- start start 2023-11-18T19:24:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74dde40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74d80a5210 0x7f74d806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74dde40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d81557b0 con 0x7f74d80c5350 2023-11-18T19:24:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74dde40640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d806b930 con 0x7f74d81563e0 2023-11-18T19:24:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74dde40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d81567c0 con 0x7f74d80a5210 2023-11-18T19:24:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74d7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74d80a5210 0x7f74d806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74d7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74d80a5210 0x7f74d806d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36610/0 (socket says 172.21.15.45:36610) 2023-11-18T19:24:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74d7fff640 1 -- 172.21.15.45:0/3344021875 learned_addr learned my addr 172.21.15.45:0/3344021875 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.108+0000 7f74dd63f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f74d80c5350 0x7f74d806dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56316/0 (socket says 172.21.15.45:56316) 2023-11-18T19:24:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.109+0000 7f74d7fff640 1 -- 172.21.15.45:0/3344021875 >> v1:172.21.15.135:6789/0 conn(0x7f74d81563e0 legacy=0x7f74d806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.109+0000 7f74d7fff640 1 -- 172.21.15.45:0/3344021875 >> v1:172.21.15.45:6789/0 conn(0x7f74d80c5350 legacy=0x7f74d806dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.109+0000 7f74d7fff640 1 -- 172.21.15.45:0/3344021875 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d806d310 con 0x7f74d80a5210 2023-11-18T19:24:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.110+0000 7f74d7fff640 1 --2- 172.21.15.45:0/3344021875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80a5210 0x7f74d806d810 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009870 tx=0x7f74c402ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2dbc3ccc8d6841 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.110+0000 7f74d77fe640 1 -- 172.21.15.45:0/3344021875 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c402f860 con 0x7f74d80a5210 2023-11-18T19:24:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.110+0000 7f74d77fe640 1 -- 172.21.15.45:0/3344021875 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c402f9c0 con 0x7f74d80a5210 2023-11-18T19:24:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.110+0000 7f74d77fe640 1 -- 172.21.15.45:0/3344021875 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c402fd50 con 0x7f74d80a5210 2023-11-18T19:24:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.111+0000 7f74dde40640 1 -- 172.21.15.45:0/3344021875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80a5210 msgr2=0x7f74d806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.111+0000 7f74dde40640 1 --2- 172.21.15.45:0/3344021875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80a5210 0x7f74d806d810 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009870 tx=0x7f74c402ba40 comp rx=0 tx=0).stop 2023-11-18T19:24:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.111+0000 7f74dde40640 1 -- 172.21.15.45:0/3344021875 shutdown_connections 2023-11-18T19:24:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.111+0000 7f74dde40640 1 --2- 172.21.15.45:0/3344021875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d80a5210 0x7f74d806d810 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.111+0000 7f74dde40640 1 -- 172.21.15.45:0/3344021875 >> 172.21.15.45:0/3344021875 conn(0x7f74d80a7910 msgr2=0x7f74d80a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.111+0000 7f74dde40640 1 -- 172.21.15.45:0/3344021875 shutdown_connections 2023-11-18T19:24:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.111+0000 7f74dde40640 1 -- 172.21.15.45:0/3344021875 wait complete. 2023-11-18T19:24:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.113+0000 7f74dde40640 1 Processor -- start 2023-11-18T19:24:31.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.113+0000 7f74dde40640 1 -- start start 2023-11-18T19:24:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dde40640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74d80a5210 0x7f74d806d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dde40640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d80c5350 0x7f74d81e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dde40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d81563e0 0x7f74d81ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dde40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80a93e0 con 0x7f74d81563e0 2023-11-18T19:24:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dde40640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80a9100 con 0x7f74d80c5350 2023-11-18T19:24:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dde40640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d81edcc0 con 0x7f74d80a5210 2023-11-18T19:24:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dd63f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d81563e0 0x7f74d81ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.114+0000 7f74dce3e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74d80a5210 0x7f74d806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74d7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d80c5350 0x7f74d81e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d81563e0 0x7f74d81ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36620/0 (socket says 172.21.15.45:36620) 2023-11-18T19:24:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 -- 172.21.15.45:0/2714833452 learned_addr learned my addr 172.21.15.45:0/2714833452 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 -- 172.21.15.45:0/2714833452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74d80a5210 msgr2=0x7f74d806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74d80a5210 0x7f74d806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 -- 172.21.15.45:0/2714833452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d80c5350 msgr2=0x7f74d81e9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d80c5350 0x7f74d81e9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 -- 172.21.15.45:0/2714833452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40094d0 con 0x7f74d81563e0 2023-11-18T19:24:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.115+0000 7f74dd63f640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d81563e0 0x7f74d81ea2a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c780 tx=0x7f74d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.116+0000 7f74d57fa640 1 -- 172.21.15.45:0/2714833452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000ce90 con 0x7f74d81563e0 2023-11-18T19:24:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.116+0000 7f74d57fa640 1 -- 172.21.15.45:0/2714833452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d000a640 con 0x7f74d81563e0 2023-11-18T19:24:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.116+0000 7f74d57fa640 1 -- 172.21.15.45:0/2714833452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000a9f0 con 0x7f74d81563e0 2023-11-18T19:24:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.116+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d81edfa0 con 0x7f74d81563e0 2023-11-18T19:24:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.116+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d81553e0 con 0x7f74d81563e0 2023-11-18T19:24:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.117+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d8068410 con 0x7f74d81563e0 2023-11-18T19:24:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.118+0000 7f74d57fa640 1 -- 172.21.15.45:0/2714833452 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74d000ab50 con 0x7f74d81563e0 2023-11-18T19:24:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.119+0000 7f74d57fa640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f74bc06ae40 0x7f74bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.119+0000 7f74d57fa640 1 -- 172.21.15.45:0/2714833452 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f74d0089090 con 0x7f74d81563e0 2023-11-18T19:24:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.119+0000 7f74dce3e640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f74bc06ae40 0x7f74bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.120+0000 7f74dce3e640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f74bc06ae40 0x7f74bc06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f60 tx=0x7f74cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.123+0000 7f74d57fa640 1 -- 172.21.15.45:0/2714833452 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74d0053e90 con 0x7f74d81563e0 2023-11-18T19:24:31.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.316+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f74d806bbf0 con 0x7f74bc06ae40 2023-11-18T19:24:31.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.317+0000 7f74d57fa640 1 -- 172.21.15.45:0/2714833452 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f74cc001d10 con 0x7f74bc06ae40 2023-11-18T19:24:31.318 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-11-18T19:24:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.319+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f74bc06ae40 msgr2=0x7f74bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.319+0000 7f74dde40640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f74bc06ae40 0x7f74bc06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f60 tx=0x7f74cc009040 comp rx=0 tx=0).stop 2023-11-18T19:24:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d81563e0 msgr2=0x7f74d81ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d81563e0 0x7f74d81ea2a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c780 tx=0x7f74d000cc40 comp rx=0 tx=0).stop 2023-11-18T19:24:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 shutdown_connections 2023-11-18T19:24:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d81563e0 0x7f74d81ea2a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d80c5350 0x7f74d81e9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f74bc06ae40 0x7f74bc06d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 --2- 172.21.15.45:0/2714833452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74d80a5210 0x7f74d806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 >> 172.21.15.45:0/2714833452 conn(0x7f74d80a7910 msgr2=0x7f74d80a7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 shutdown_connections 2023-11-18T19:24:31.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.320+0000 7f74dde40640 1 -- 172.21.15.45:0/2714833452 wait complete. 2023-11-18T19:24:31.340 INFO:tasks.ceph:Scrubbing osd.6 2023-11-18T19:24:31.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.573+0000 7f0cb71e9640 1 Processor -- start 2023-11-18T19:24:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.573+0000 7f0cb71e9640 1 -- start start 2023-11-18T19:24:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.576+0000 7f0cb71e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cb00c7ff0 0x7f0cb00c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.576+0000 7f0cb71e9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0cb00c67a0 0x7f0cb01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.576+0000 7f0cb71e9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c4e10 0x7f0cb00c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.576+0000 7f0cb71e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb0152b20 con 0x7f0cb00c7ff0 2023-11-18T19:24:31.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.576+0000 7f0cb71e9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb0152e00 con 0x7f0cb00c67a0 2023-11-18T19:24:31.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.576+0000 7f0cb71e9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01530e0 con 0x7f0cb00c4e10 2023-11-18T19:24:31.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cb00c7ff0 0x7f0cb00c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cb00c7ff0 0x7f0cb00c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36626/0 (socket says 172.21.15.45:36626) 2023-11-18T19:24:31.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 -- 172.21.15.45:0/4188157944 learned_addr learned my addr 172.21.15.45:0/4188157944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:31.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb59e6640 1 --2- 172.21.15.45:0/4188157944 >> v2:172.21.15.135:3300/0 conn(0x7f0cb00c67a0 0x7f0cb01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb69e8640 1 --2- 172.21.15.45:0/4188157944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c4e10 0x7f0cb00c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 -- 172.21.15.45:0/4188157944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c4e10 msgr2=0x7f0cb00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:31.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 --2- 172.21.15.45:0/4188157944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c4e10 0x7f0cb00c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 -- 172.21.15.45:0/4188157944 >> v2:172.21.15.135:3300/0 conn(0x7f0cb00c67a0 msgr2=0x7f0cb01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:31.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 --2- 172.21.15.45:0/4188157944 >> v2:172.21.15.135:3300/0 conn(0x7f0cb00c67a0 0x7f0cb01522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.577+0000 7f0cb61e7640 1 -- 172.21.15.45:0/4188157944 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00c48f0 con 0x7f0cb00c7ff0 2023-11-18T19:24:31.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.579+0000 7f0cb61e7640 1 --2- 172.21.15.45:0/4188157944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c7ff0 0x7f0cb00c83d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0067160 tx=0x7f0cac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60beb8738fc3a30 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.579+0000 7f0cb51e5640 1 -- 172.21.15.45:0/4188157944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0317e0 con 0x7f0cb00c7ff0 2023-11-18T19:24:31.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.579+0000 7f0cb51e5640 1 -- 172.21.15.45:0/4188157944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac031940 con 0x7f0cb00c7ff0 2023-11-18T19:24:31.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.579+0000 7f0cb51e5640 1 -- 172.21.15.45:0/4188157944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac031cd0 con 0x7f0cb00c7ff0 2023-11-18T19:24:31.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.580+0000 7f0cb71e9640 1 -- 172.21.15.45:0/4188157944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c7ff0 msgr2=0x7f0cb00c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.580+0000 7f0cb71e9640 1 --2- 172.21.15.45:0/4188157944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c7ff0 0x7f0cb00c83d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0067160 tx=0x7f0cac02b880 comp rx=0 tx=0).stop 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.580+0000 7f0cb71e9640 1 -- 172.21.15.45:0/4188157944 shutdown_connections 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.580+0000 7f0cb71e9640 1 --2- 172.21.15.45:0/4188157944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c4e10 0x7f0cb00c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.581+0000 7f0cb71e9640 1 --2- 172.21.15.45:0/4188157944 >> v2:172.21.15.135:3300/0 conn(0x7f0cb00c67a0 0x7f0cb01522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.581+0000 7f0cb71e9640 1 --2- 172.21.15.45:0/4188157944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c7ff0 0x7f0cb00c83d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.581+0000 7f0cb71e9640 1 -- 172.21.15.45:0/4188157944 >> 172.21.15.45:0/4188157944 conn(0x7f0cb00663d0 msgr2=0x7f0cb00667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.581+0000 7f0cb71e9640 1 -- 172.21.15.45:0/4188157944 shutdown_connections 2023-11-18T19:24:31.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.581+0000 7f0cb71e9640 1 -- 172.21.15.45:0/4188157944 wait complete. 2023-11-18T19:24:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.583+0000 7f0cb71e9640 1 Processor -- start 2023-11-18T19:24:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.583+0000 7f0cb71e9640 1 -- start start 2023-11-18T19:24:31.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb71e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c4e10 0x7f0cb006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb71e9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c67a0 0x7f0cb0150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb71e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cb00c7ff0 0x7f0cb0150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb71e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01d8660 con 0x7f0cb00c4e10 2023-11-18T19:24:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb71e9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0151bf0 con 0x7f0cb00c7ff0 2023-11-18T19:24:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb71e9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01eaa80 con 0x7f0cb00c67a0 2023-11-18T19:24:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb61e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c4e10 0x7f0cb006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb61e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c4e10 0x7f0cb006c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36642/0 (socket says 172.21.15.45:36642) 2023-11-18T19:24:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb61e7640 1 -- 172.21.15.45:0/3414762666 learned_addr learned my addr 172.21.15.45:0/3414762666 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb69e8640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cb00c7ff0 0x7f0cb0150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb61e7640 1 -- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c67a0 msgr2=0x7f0cb0150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb61e7640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cb00c67a0 0x7f0cb0150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb61e7640 1 -- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cb00c7ff0 msgr2=0x7f0cb0150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.584+0000 7f0cb61e7640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0cb00c7ff0 0x7f0cb0150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.585+0000 7f0cb61e7640 1 -- 172.21.15.45:0/3414762666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac0094d0 con 0x7f0cb00c4e10 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.585+0000 7f0cb61e7640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c4e10 0x7f0cb006c8d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000c00 tx=0x7f0cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.585+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac032880 con 0x7f0cb00c4e10 2023-11-18T19:24:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.585+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac032a20 con 0x7f0cb00c4e10 2023-11-18T19:24:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.585+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac032dd0 con 0x7f0cb00c4e10 2023-11-18T19:24:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.585+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb0151e00 con 0x7f0cb00c4e10 2023-11-18T19:24:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.585+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb006ce10 con 0x7f0cb00c4e10 2023-11-18T19:24:31.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.586+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0cb00c6190 con 0x7f0cb00c4e10 2023-11-18T19:24:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.588+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cac04e450 con 0x7f0cb00c4e10 2023-11-18T19:24:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.588+0000 7f0ca6ffd640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c9406ae40 0x7f0c9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.589+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0cac0abab0 con 0x7f0cb00c4e10 2023-11-18T19:24:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.589+0000 7f0cb59e6640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c9406ae40 0x7f0c9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.589+0000 7f0ca6ffd640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7f0c94074520 0x7f0c940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.589+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 --> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c94077090 con 0x7f0c94074520 2023-11-18T19:24:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.589+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cac0b02a0 con 0x7f0cb00c4e10 2023-11-18T19:24:31.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.590+0000 7f0cb59e6640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c9406ae40 0x7f0c9406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0151a90 tx=0x7f0ca0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.590+0000 7f0cb69e8640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7f0c94074520 0x7f0c940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.591+0000 7f0cb69e8640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7f0c94074520 0x7f0c940769c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.593+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== osd.6 v2:172.21.15.135:6808/1077987781 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0c94077090 con 0x7f0c94074520 2023-11-18T19:24:31.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.608+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 --> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0cb0150270 con 0x7f0c94074520 2023-11-18T19:24:31.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0ca6ffd640 1 -- 172.21.15.45:0/3414762666 <== osd.6 v2:172.21.15.135:6808/1077987781 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0cb0150270 con 0x7f0c94074520 2023-11-18T19:24:31.610 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:31.611 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:31.611 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:31.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7f0c94074520 msgr2=0x7f0c940769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0cb71e9640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.135:6808/1077987781,v1:172.21.15.135:6809/1077987781] conn(0x7f0c94074520 0x7f0c940769c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c9406ae40 msgr2=0x7f0c9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0cb71e9640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0c9406ae40 0x7f0c9406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0151a90 tx=0x7f0ca0008040 comp rx=0 tx=0).stop 2023-11-18T19:24:31.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c4e10 msgr2=0x7f0cb006c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0cb71e9640 1 --2- 172.21.15.45:0/3414762666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cb00c4e10 0x7f0cb006c8d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000c00 tx=0x7f0cac0046c0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.609+0000 7f0cb69e8640 1 -- 172.21.15.45:0/3414762666 reap_dead start 2023-11-18T19:24:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.610+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 shutdown_connections 2023-11-18T19:24:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.610+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 >> 172.21.15.45:0/3414762666 conn(0x7f0cb00663d0 msgr2=0x7f0cb00667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.610+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 shutdown_connections 2023-11-18T19:24:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.610+0000 7f0cb71e9640 1 -- 172.21.15.45:0/3414762666 wait complete. 2023-11-18T19:24:31.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-18T19:24:31.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.863+0000 7f8a88f9a640 1 Processor -- start 2023-11-18T19:24:31.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.863+0000 7f8a88f9a640 1 -- start start 2023-11-18T19:24:31.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.864+0000 7f8a88f9a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a84151970 0x7f8a840c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.864+0000 7f8a88f9a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a84154470 0x7f8a84154920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.864+0000 7f8a88f9a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a84157c00 con 0x7f8a840c4b50 2023-11-18T19:24:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.864+0000 7f8a88f9a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a840c5790 con 0x7f8a84151970 2023-11-18T19:24:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.864+0000 7f8a88f9a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a840c5060 con 0x7f8a84154470 2023-11-18T19:24:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a837fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a84151970 0x7f8a840c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a7bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8a840c4b50 0x7f8a840ca3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56330/0 (socket says 172.21.15.45:56330) 2023-11-18T19:24:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a7bfff640 1 -- 172.21.15.45:0/965766818 learned_addr learned my addr 172.21.15.45:0/965766818 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a83fff640 1 --2- 172.21.15.45:0/965766818 >> v2:172.21.15.135:3300/0 conn(0x7f8a84154470 0x7f8a84154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a837fe640 1 -- 172.21.15.45:0/965766818 >> v2:172.21.15.135:3300/0 conn(0x7f8a84154470 msgr2=0x7f8a84154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a837fe640 1 --2- 172.21.15.45:0/965766818 >> v2:172.21.15.135:3300/0 conn(0x7f8a84154470 0x7f8a84154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a837fe640 1 -- 172.21.15.45:0/965766818 >> v1:172.21.15.45:6789/0 conn(0x7f8a840c4b50 legacy=0x7f8a840ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.865+0000 7f8a837fe640 1 -- 172.21.15.45:0/965766818 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84157ee0 con 0x7f8a84151970 2023-11-18T19:24:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.866+0000 7f8a837fe640 1 --2- 172.21.15.45:0/965766818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a84151970 0x7f8a840c4610 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8a840c6060 tx=0x7f8a7402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636939c114fa2301 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.867+0000 7f8a82ffd640 1 -- 172.21.15.45:0/965766818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74031520 con 0x7f8a84151970 2023-11-18T19:24:31.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.867+0000 7f8a82ffd640 1 -- 172.21.15.45:0/965766818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74031680 con 0x7f8a84151970 2023-11-18T19:24:31.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.867+0000 7f8a82ffd640 1 -- 172.21.15.45:0/965766818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74031a10 con 0x7f8a84151970 2023-11-18T19:24:31.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 -- 172.21.15.45:0/965766818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a84151970 msgr2=0x7f8a840c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/965766818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a84151970 0x7f8a840c4610 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8a840c6060 tx=0x7f8a7402b7c0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 -- 172.21.15.45:0/965766818 shutdown_connections 2023-11-18T19:24:31.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/965766818 >> v2:172.21.15.135:3300/0 conn(0x7f8a84154470 0x7f8a84154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/965766818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a84151970 0x7f8a840c4610 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 -- 172.21.15.45:0/965766818 >> 172.21.15.45:0/965766818 conn(0x7f8a840abe50 msgr2=0x7f8a840c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:31.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 -- 172.21.15.45:0/965766818 shutdown_connections 2023-11-18T19:24:31.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.868+0000 7f8a88f9a640 1 -- 172.21.15.45:0/965766818 wait complete. 2023-11-18T19:24:31.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.870+0000 7f8a88f9a640 1 Processor -- start 2023-11-18T19:24:31.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.870+0000 7f8a88f9a640 1 -- start start 2023-11-18T19:24:31.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a88f9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a840c4b50 0x7f8a8414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a88f9a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a84151970 0x7f8a840aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a88f9a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a84154470 0x7f8a84156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a88f9a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84155840 con 0x7f8a840c4b50 2023-11-18T19:24:31.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a88f9a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84155dc0 con 0x7f8a84151970 2023-11-18T19:24:31.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a88f9a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8414f8b0 con 0x7f8a84154470 2023-11-18T19:24:31.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a840c4b50 0x7f8a8414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a840c4b50 0x7f8a8414f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36658/0 (socket says 172.21.15.45:36658) 2023-11-18T19:24:31.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.871+0000 7f8a837fe640 1 -- 172.21.15.45:0/791355183 learned_addr learned my addr 172.21.15.45:0/791355183 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.872+0000 7f8a7bfff640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a84151970 0x7f8a840aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.872+0000 7f8a837fe640 1 -- 172.21.15.45:0/791355183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a84154470 msgr2=0x7f8a84156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.872+0000 7f8a837fe640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a84154470 0x7f8a84156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.872+0000 7f8a837fe640 1 -- 172.21.15.45:0/791355183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a84151970 msgr2=0x7f8a840aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.872+0000 7f8a837fe640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a84151970 0x7f8a840aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.872+0000 7f8a837fe640 1 -- 172.21.15.45:0/791355183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a74009400 con 0x7f8a840c4b50 2023-11-18T19:24:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.872+0000 7f8a837fe640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a840c4b50 0x7f8a8414f370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009890 tx=0x7f8a740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.873+0000 7f8a80ff9640 1 -- 172.21.15.45:0/791355183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74031520 con 0x7f8a840c4b50 2023-11-18T19:24:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.873+0000 7f8a80ff9640 1 -- 172.21.15.45:0/791355183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74033c70 con 0x7f8a840c4b50 2023-11-18T19:24:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.873+0000 7f8a80ff9640 1 -- 172.21.15.45:0/791355183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7403c400 con 0x7f8a840c4b50 2023-11-18T19:24:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.873+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a84157360 con 0x7f8a840c4b50 2023-11-18T19:24:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.873+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a84155a50 con 0x7f8a840c4b50 2023-11-18T19:24:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.875+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a84068410 con 0x7f8a840c4b50 2023-11-18T19:24:31.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.876+0000 7f8a80ff9640 1 -- 172.21.15.45:0/791355183 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a7403a040 con 0x7f8a840c4b50 2023-11-18T19:24:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.877+0000 7f8a80ff9640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.878+0000 7f8a80ff9640 1 -- 172.21.15.45:0/791355183 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f8a740ab410 con 0x7f8a840c4b50 2023-11-18T19:24:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.878+0000 7f8a7bfff640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.879+0000 7f8a7bfff640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a841eae60 tx=0x7f8a6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:31.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:31.882+0000 7f8a80ff9640 1 -- 172.21.15.45:0/791355183 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a74076280 con 0x7f8a840c4b50 2023-11-18T19:24:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.115+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a841584a0 con 0x7f8a6406ae70 2023-11-18T19:24:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.116+0000 7f8a80ff9640 1 -- 172.21.15.45:0/791355183 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a6c001c50 con 0x7f8a6406ae70 2023-11-18T19:24:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-11-18T19:24:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.119+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a6406ae70 msgr2=0x7f8a6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.119+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a841eae60 tx=0x7f8a6c009040 comp rx=0 tx=0).stop 2023-11-18T19:24:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.119+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a840c4b50 msgr2=0x7f8a8414f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.119+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a840c4b50 0x7f8a8414f370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009890 tx=0x7f8a740046c0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 shutdown_connections 2023-11-18T19:24:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a84154470 0x7f8a84156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a84151970 0x7f8a840aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 --2- 172.21.15.45:0/791355183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a840c4b50 0x7f8a8414f370 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 >> 172.21.15.45:0/791355183 conn(0x7f8a840abe50 msgr2=0x7f8a8414a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 shutdown_connections 2023-11-18T19:24:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.120+0000 7f8a88f9a640 1 -- 172.21.15.45:0/791355183 wait complete. 2023-11-18T19:24:32.139 INFO:tasks.ceph:Scrubbing osd.7 2023-11-18T19:24:32.139 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-18T19:24:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.353+0000 7fbce91dc640 1 Processor -- start 2023-11-18T19:24:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.354+0000 7fbce91dc640 1 -- start start 2023-11-18T19:24:32.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.355+0000 7fbce91dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbce40c8450 0x7fbce4154a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.355+0000 7fbce91dc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40c49c0 con 0x7fbce4151d40 2023-11-18T19:24:32.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.355+0000 7fbce91dc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40c5260 con 0x7fbce40c7f40 2023-11-18T19:24:32.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.355+0000 7fbce91dc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce406bf90 con 0x7fbce40c8450 2023-11-18T19:24:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.356+0000 7fbce259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbce40c8450 0x7fbce4154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.356+0000 7fbce259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbce40c8450 0x7fbce4154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36666/0 (socket says 172.21.15.45:36666) 2023-11-18T19:24:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.356+0000 7fbce259c640 1 -- 172.21.15.45:0/608979359 learned_addr learned my addr 172.21.15.45:0/608979359 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.356+0000 7fbce259c640 1 -- 172.21.15.45:0/608979359 >> v1:172.21.15.135:6789/0 conn(0x7fbce40c7f40 legacy=0x7fbce4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.356+0000 7fbce259c640 1 -- 172.21.15.45:0/608979359 >> v1:172.21.15.45:6789/0 conn(0x7fbce4151d40 legacy=0x7fbce40ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.356+0000 7fbce259c640 1 -- 172.21.15.45:0/608979359 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4158b50 con 0x7fbce40c8450 2023-11-18T19:24:32.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.358+0000 7fbce259c640 1 --2- 172.21.15.45:0/608979359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce40c8450 0x7fbce4154a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009870 tx=0x7fbcd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f872177e3659c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:32.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.358+0000 7fbce1d9b640 1 -- 172.21.15.45:0/608979359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8031870 con 0x7fbce40c8450 2023-11-18T19:24:32.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.358+0000 7fbce1d9b640 1 -- 172.21.15.45:0/608979359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd80319d0 con 0x7fbce40c8450 2023-11-18T19:24:32.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.359+0000 7fbce1d9b640 1 -- 172.21.15.45:0/608979359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8031d60 con 0x7fbce40c8450 2023-11-18T19:24:32.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.359+0000 7fbce91dc640 1 -- 172.21.15.45:0/608979359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce40c8450 msgr2=0x7fbce4154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.359+0000 7fbce91dc640 1 --2- 172.21.15.45:0/608979359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce40c8450 0x7fbce4154a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009870 tx=0x7fbcd802b910 comp rx=0 tx=0).stop 2023-11-18T19:24:32.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.360+0000 7fbce91dc640 1 -- 172.21.15.45:0/608979359 shutdown_connections 2023-11-18T19:24:32.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.360+0000 7fbce91dc640 1 --2- 172.21.15.45:0/608979359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce40c8450 0x7fbce4154a20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.360+0000 7fbce91dc640 1 -- 172.21.15.45:0/608979359 >> 172.21.15.45:0/608979359 conn(0x7fbce40663d0 msgr2=0x7fbce40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:32.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.360+0000 7fbce91dc640 1 -- 172.21.15.45:0/608979359 shutdown_connections 2023-11-18T19:24:32.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.360+0000 7fbce91dc640 1 -- 172.21.15.45:0/608979359 wait complete. 2023-11-18T19:24:32.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.362+0000 7fbce91dc640 1 Processor -- start 2023-11-18T19:24:32.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.362+0000 7fbce91dc640 1 -- start start 2023-11-18T19:24:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce91dc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbce40c7f40 0x7fbce40c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce91dc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbce40c8450 0x7fbce40ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce91dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4151d40 0x7fbce40a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce91dc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40c40b0 con 0x7fbce4151d40 2023-11-18T19:24:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce91dc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40c4390 con 0x7fbce40c7f40 2023-11-18T19:24:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce91dc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40c2960 con 0x7fbce40c8450 2023-11-18T19:24:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4151d40 0x7fbce40a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4151d40 0x7fbce40a9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36670/0 (socket says 172.21.15.45:36670) 2023-11-18T19:24:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.363+0000 7fbce359e640 1 -- 172.21.15.45:0/2156975283 learned_addr learned my addr 172.21.15.45:0/2156975283 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce259c640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbce40c8450 0x7fbce40ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbce40c7f40 0x7fbce40c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce359e640 1 -- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbce40c8450 msgr2=0x7fbce40ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce359e640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbce40c8450 0x7fbce40ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce359e640 1 -- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbce40c7f40 msgr2=0x7fbce40c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce359e640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbce40c7f40 0x7fbce40c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce359e640 1 -- 172.21.15.45:0/2156975283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80094d0 con 0x7fbce4151d40 2023-11-18T19:24:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.364+0000 7fbce359e640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4151d40 0x7fbce40a9a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00b9e0 tx=0x7fbcdc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.365+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc003b70 con 0x7fbce4151d40 2023-11-18T19:24:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.365+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc003cd0 con 0x7fbce4151d40 2023-11-18T19:24:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.365+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce40c2c40 con 0x7fbce4151d40 2023-11-18T19:24:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.365+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00cb60 con 0x7fbce4151d40 2023-11-18T19:24:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.365+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce40ab750 con 0x7fbce4151d40 2023-11-18T19:24:32.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.366+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbce40c4500 con 0x7fbce4151d40 2023-11-18T19:24:32.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.367+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbcdc00ccc0 con 0x7fbce4151d40 2023-11-18T19:24:32.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.368+0000 7fbccb7fe640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbcd006ae40 0x7fbcd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.368+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbcdc089630 con 0x7fbce4151d40 2023-11-18T19:24:32.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.368+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbcd006ae40 0x7fbcd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.368+0000 7fbccb7fe640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7fbcd0074520 0x7fbcd00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.368+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 --> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbcd0077090 con 0x7fbcd0074520 2023-11-18T19:24:32.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.368+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcdc08bcf0 con 0x7fbce4151d40 2023-11-18T19:24:32.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.369+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbcd006ae40 0x7fbcd006d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4001640 tx=0x7fbcd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:32.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.369+0000 7fbce259c640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7fbcd0074520 0x7fbcd00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.371+0000 7fbce259c640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7fbcd0074520 0x7fbcd00769c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.373+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== osd.7 v2:172.21.15.135:6816/745158176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbcd0077090 con 0x7fbcd0074520 2023-11-18T19:24:32.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.387+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 --> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbce4152120 con 0x7fbcd0074520 2023-11-18T19:24:32.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.388+0000 7fbccb7fe640 1 -- 172.21.15.45:0/2156975283 <== osd.7 v2:172.21.15.135:6816/745158176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbcd8031bc0 con 0x7fbcd0074520 2023-11-18T19:24:32.390 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-18T19:24:32.390 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-18T19:24:32.390 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-18T19:24:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.388+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7fbcd0074520 msgr2=0x7fbcd00769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.388+0000 7fbce91dc640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.135:6816/745158176,v1:172.21.15.135:6817/745158176] conn(0x7fbcd0074520 0x7fbcd00769c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbcd006ae40 msgr2=0x7fbcd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fbcd006ae40 0x7fbcd006d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4001640 tx=0x7fbcd4009040 comp rx=0 tx=0).stop 2023-11-18T19:24:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4151d40 msgr2=0x7fbce40a9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 --2- 172.21.15.45:0/2156975283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4151d40 0x7fbce40a9a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00b9e0 tx=0x7fbcdc00bea0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce359e640 1 -- 172.21.15.45:0/2156975283 reap_dead start 2023-11-18T19:24:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 shutdown_connections 2023-11-18T19:24:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 >> 172.21.15.45:0/2156975283 conn(0x7fbce40663d0 msgr2=0x7fbce4154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 shutdown_connections 2023-11-18T19:24:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.389+0000 7fbce91dc640 1 -- 172.21.15.45:0/2156975283 wait complete. 2023-11-18T19:24:32.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-18T19:24:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.631+0000 7fbab8ba7640 1 Processor -- start 2023-11-18T19:24:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.632+0000 7fbab8ba7640 1 -- start start 2023-11-18T19:24:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.634+0000 7fbab8ba7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbab406c6d0 0x7fbab40ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.634+0000 7fbab8ba7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbab40ca690 0x7fbab4157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.634+0000 7fbab8ba7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab40c5090 con 0x7fbab4151a80 2023-11-18T19:24:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.634+0000 7fbab8ba7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab40c4ea0 con 0x7fbab406c6d0 2023-11-18T19:24:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.634+0000 7fbab8ba7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab4154920 con 0x7fbab40ca690 2023-11-18T19:24:32.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbaabfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbab406c6d0 0x7fbab40ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbaabfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbab406c6d0 0x7fbab40ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36674/0 (socket says 172.21.15.45:36674) 2023-11-18T19:24:32.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbaabfff640 1 -- 172.21.15.45:0/2127189199 learned_addr learned my addr 172.21.15.45:0/2127189199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:32.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbab3fff640 1 --2- 172.21.15.45:0/2127189199 >> v2:172.21.15.135:3300/0 conn(0x7fbab40ca690 0x7fbab4157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbaabfff640 1 -- 172.21.15.45:0/2127189199 >> v2:172.21.15.135:3300/0 conn(0x7fbab40ca690 msgr2=0x7fbab4157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:32.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbaabfff640 1 --2- 172.21.15.45:0/2127189199 >> v2:172.21.15.135:3300/0 conn(0x7fbab40ca690 0x7fbab4157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbaabfff640 1 -- 172.21.15.45:0/2127189199 >> v1:172.21.15.135:6789/0 conn(0x7fbab4151a80 legacy=0x7fbab40c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:32.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.635+0000 7fbaabfff640 1 -- 172.21.15.45:0/2127189199 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4154c00 con 0x7fbab406c6d0 2023-11-18T19:24:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.636+0000 7fbaabfff640 1 --2- 172.21.15.45:0/2127189199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab406c6d0 0x7fbab40ca150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbab40bd8e0 tx=0x7fba9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f34eb2179a2049 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.637+0000 7fbab2ffd640 1 -- 172.21.15.45:0/2127189199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0317e0 con 0x7fbab406c6d0 2023-11-18T19:24:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.637+0000 7fbab2ffd640 1 -- 172.21.15.45:0/2127189199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c031940 con 0x7fbab406c6d0 2023-11-18T19:24:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.637+0000 7fbab2ffd640 1 -- 172.21.15.45:0/2127189199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c031cd0 con 0x7fbab406c6d0 2023-11-18T19:24:32.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 -- 172.21.15.45:0/2127189199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab406c6d0 msgr2=0x7fbab40ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/2127189199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab406c6d0 0x7fbab40ca150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbab40bd8e0 tx=0x7fba9c02b880 comp rx=0 tx=0).stop 2023-11-18T19:24:32.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 -- 172.21.15.45:0/2127189199 shutdown_connections 2023-11-18T19:24:32.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/2127189199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab406c6d0 0x7fbab40ca150 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/2127189199 >> v2:172.21.15.135:3300/0 conn(0x7fbab40ca690 0x7fbab4157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 -- 172.21.15.45:0/2127189199 >> 172.21.15.45:0/2127189199 conn(0x7fbab40663d0 msgr2=0x7fbab40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:32.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 -- 172.21.15.45:0/2127189199 shutdown_connections 2023-11-18T19:24:32.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.638+0000 7fbab8ba7640 1 -- 172.21.15.45:0/2127189199 wait complete. 2023-11-18T19:24:32.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.640+0000 7fbab8ba7640 1 Processor -- start 2023-11-18T19:24:32.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.640+0000 7fbab8ba7640 1 -- start start 2023-11-18T19:24:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.641+0000 7fbab8ba7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbab406c6d0 0x7fbab41eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.641+0000 7fbab8ba7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab40ca690 0x7fbab40c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.641+0000 7fbab8ba7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab4151a80 0x7fbab41434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.641+0000 7fbab8ba7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4146280 con 0x7fbab4151a80 2023-11-18T19:24:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.641+0000 7fbab8ba7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4146560 con 0x7fbab40ca690 2023-11-18T19:24:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.641+0000 7fbab8ba7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41ea080 con 0x7fbab406c6d0 2023-11-18T19:24:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.641+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab4151a80 0x7fbab41434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab4151a80 0x7fbab41434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36688/0 (socket says 172.21.15.45:36688) 2023-11-18T19:24:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 -- 172.21.15.45:0/1746706702 learned_addr learned my addr 172.21.15.45:0/1746706702 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbaabfff640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab40ca690 0x7fbab40c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab37fe640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbab406c6d0 0x7fbab41eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 -- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbab406c6d0 msgr2=0x7fbab41eab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbab406c6d0 0x7fbab41eab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 -- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab40ca690 msgr2=0x7fbab40c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab40ca690 0x7fbab40c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 -- 172.21.15.45:0/1746706702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0094d0 con 0x7fbab4151a80 2023-11-18T19:24:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.642+0000 7fbab3fff640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab4151a80 0x7fbab41434b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00cd70 tx=0x7fbaac00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.643+0000 7fbab0ff9640 1 -- 172.21.15.45:0/1746706702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac003b90 con 0x7fbab4151a80 2023-11-18T19:24:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.643+0000 7fbab0ff9640 1 -- 172.21.15.45:0/1746706702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac003cf0 con 0x7fbab4151a80 2023-11-18T19:24:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.643+0000 7fbab0ff9640 1 -- 172.21.15.45:0/1746706702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac004240 con 0x7fbab4151a80 2023-11-18T19:24:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.643+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab4155580 con 0x7fbab4151a80 2023-11-18T19:24:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.643+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41ea640 con 0x7fbab4151a80 2023-11-18T19:24:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.644+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab4068410 con 0x7fbab4151a80 2023-11-18T19:24:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.645+0000 7fbab0ff9640 1 -- 172.21.15.45:0/1746706702 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbaac0043a0 con 0x7fbab4151a80 2023-11-18T19:24:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.646+0000 7fbab0ff9640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba9406ae90 0x7fba9406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.646+0000 7fbab0ff9640 1 -- 172.21.15.45:0/1746706702 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fbaac012070 con 0x7fbab4151a80 2023-11-18T19:24:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.646+0000 7fbab37fe640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba9406ae90 0x7fba9406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.647+0000 7fbab37fe640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba9406ae90 0x7fba9406d350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400a730 tx=0x7fbaa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:32.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.650+0000 7fbab0ff9640 1 -- 172.21.15.45:0/1746706702 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbaac055090 con 0x7fbab4151a80 2023-11-18T19:24:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.875+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fbab4155400 con 0x7fba9406ae90 2023-11-18T19:24:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.876+0000 7fbab0ff9640 1 -- 172.21.15.45:0/1746706702 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbaa400a380 con 0x7fba9406ae90 2023-11-18T19:24:32.878 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-11-18T19:24:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba9406ae90 msgr2=0x7fba9406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba9406ae90 0x7fba9406d350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400a730 tx=0x7fbaa4008040 comp rx=0 tx=0).stop 2023-11-18T19:24:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab4151a80 msgr2=0x7fbab41434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab4151a80 0x7fbab41434b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00cd70 tx=0x7fbaac00a660 comp rx=0 tx=0).stop 2023-11-18T19:24:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 shutdown_connections 2023-11-18T19:24:32.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbab4151a80 0x7fbab41434b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab40ca690 0x7fbab40c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba9406ae90 0x7fba9406d350 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 --2- 172.21.15.45:0/1746706702 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbab406c6d0 0x7fbab41eab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:32.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.879+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 >> 172.21.15.45:0/1746706702 conn(0x7fbab40663d0 msgr2=0x7fbab40c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:32.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.880+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 shutdown_connections 2023-11-18T19:24:32.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:32.880+0000 7fbab8ba7640 1 -- 172.21.15.45:0/1746706702 wait complete. 2023-11-18T19:24:32.898 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:24:33.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.143+0000 7f9f686a2640 1 Processor -- start 2023-11-18T19:24:33.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.143+0000 7f9f686a2640 1 -- start start 2023-11-18T19:24:33.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.144+0000 7f9f686a2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f60151c00 0x7f9f600c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:33.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.144+0000 7f9f686a2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9f600bd590 0x7f9f60154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:33.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.144+0000 7f9f686a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f600ca200 con 0x7f9f600c7e00 2023-11-18T19:24:33.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.144+0000 7f9f686a2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600c5610 con 0x7f9f60151c00 2023-11-18T19:24:33.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.144+0000 7f9f686a2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600cac50 con 0x7f9f600bd590 2023-11-18T19:24:33.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f6643e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f60151c00 0x7f9f600c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:33.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f6643e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f60151c00 0x7f9f600c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36350/0 (socket says 172.21.15.45:36350) 2023-11-18T19:24:33.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f6643e640 1 -- 172.21.15.45:0/3788470523 learned_addr learned my addr 172.21.15.45:0/3788470523 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:33.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f66c3f640 1 --2- 172.21.15.45:0/3788470523 >> v2:172.21.15.135:3300/0 conn(0x7f9f600bd590 0x7f9f60154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:33.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f6643e640 1 -- 172.21.15.45:0/3788470523 >> v2:172.21.15.135:3300/0 conn(0x7f9f600bd590 msgr2=0x7f9f60154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:33.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f6643e640 1 --2- 172.21.15.45:0/3788470523 >> v2:172.21.15.135:3300/0 conn(0x7f9f600bd590 0x7f9f60154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f6643e640 1 -- 172.21.15.45:0/3788470523 >> v1:172.21.15.135:6789/0 conn(0x7f9f600c7e00 legacy=0x7f9f601545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:24:33.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f6643e640 1 -- 172.21.15.45:0/3788470523 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60151fe0 con 0x7f9f60151c00 2023-11-18T19:24:33.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.145+0000 7f9f66c3f640 1 --2- 172.21.15.45:0/3788470523 >> v2:172.21.15.135:3300/0 conn(0x7f9f600bd590 0x7f9f60154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:24:33.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.147+0000 7f9f6643e640 1 --2- 172.21.15.45:0/3788470523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f60151c00 0x7f9f600c4880 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9f600c6860 tx=0x7f9f5c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9af8179dc009d1b server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:33.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.147+0000 7f9f6543c640 1 -- 172.21.15.45:0/3788470523 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0317e0 con 0x7f9f60151c00 2023-11-18T19:24:33.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.148+0000 7f9f6543c640 1 -- 172.21.15.45:0/3788470523 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c031940 con 0x7f9f60151c00 2023-11-18T19:24:33.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.148+0000 7f9f6543c640 1 -- 172.21.15.45:0/3788470523 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c031cd0 con 0x7f9f60151c00 2023-11-18T19:24:33.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 -- 172.21.15.45:0/3788470523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f60151c00 msgr2=0x7f9f600c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:33.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 --2- 172.21.15.45:0/3788470523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f60151c00 0x7f9f600c4880 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9f600c6860 tx=0x7f9f5c02b880 comp rx=0 tx=0).stop 2023-11-18T19:24:33.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 -- 172.21.15.45:0/3788470523 shutdown_connections 2023-11-18T19:24:33.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 --2- 172.21.15.45:0/3788470523 >> v2:172.21.15.135:3300/0 conn(0x7f9f600bd590 0x7f9f60154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 --2- 172.21.15.45:0/3788470523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f60151c00 0x7f9f600c4880 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 -- 172.21.15.45:0/3788470523 >> 172.21.15.45:0/3788470523 conn(0x7f9f600663d0 msgr2=0x7f9f600667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:33.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 -- 172.21.15.45:0/3788470523 shutdown_connections 2023-11-18T19:24:33.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.149+0000 7f9f686a2640 1 -- 172.21.15.45:0/3788470523 wait complete. 2023-11-18T19:24:33.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.151+0000 7f9f686a2640 1 Processor -- start 2023-11-18T19:24:33.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.152+0000 7f9f686a2640 1 -- start start 2023-11-18T19:24:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f686a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f600bd590 0x7f9f600bcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f686a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600c7e00 0x7f9f601563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f686a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f60151c00 0x7f9f601536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f686a2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60154490 con 0x7f9f600c7e00 2023-11-18T19:24:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f686a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f601eedf0 con 0x7f9f600bd590 2023-11-18T19:24:33.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f686a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f601ef090 con 0x7f9f60151c00 2023-11-18T19:24:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f65c3d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600c7e00 0x7f9f601563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f65c3d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600c7e00 0x7f9f601563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36366/0 (socket says 172.21.15.45:36366) 2023-11-18T19:24:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f65c3d640 1 -- 172.21.15.45:0/2356658383 learned_addr learned my addr 172.21.15.45:0/2356658383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.154+0000 7f9f6643e640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f600bd590 0x7f9f600bcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.155+0000 7f9f66c3f640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f60151c00 0x7f9f601536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.155+0000 7f9f65c3d640 1 -- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f60151c00 msgr2=0x7f9f601536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.155+0000 7f9f65c3d640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f60151c00 0x7f9f601536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.155+0000 7f9f65c3d640 1 -- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f600bd590 msgr2=0x7f9f600bcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.155+0000 7f9f65c3d640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f600bd590 0x7f9f600bcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.155+0000 7f9f65c3d640 1 -- 172.21.15.45:0/2356658383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0094d0 con 0x7f9f600c7e00 2023-11-18T19:24:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.156+0000 7f9f65c3d640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600c7e00 0x7f9f601563b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c430 tx=0x7f9f5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.156+0000 7f9f56ffd640 1 -- 172.21.15.45:0/2356658383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50011790 con 0x7f9f600c7e00 2023-11-18T19:24:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.156+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f601558d0 con 0x7f9f600c7e00 2023-11-18T19:24:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.156+0000 7f9f56ffd640 1 -- 172.21.15.45:0/2356658383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f500118f0 con 0x7f9f600c7e00 2023-11-18T19:24:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.156+0000 7f9f56ffd640 1 -- 172.21.15.45:0/2356658383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50011ce0 con 0x7f9f600c7e00 2023-11-18T19:24:33.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.156+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f60155e90 con 0x7f9f600c7e00 2023-11-18T19:24:33.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.158+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f600747c0 con 0x7f9f600c7e00 2023-11-18T19:24:33.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.159+0000 7f9f56ffd640 1 -- 172.21.15.45:0/2356658383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f5001c460 con 0x7f9f600c7e00 2023-11-18T19:24:33.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.161+0000 7f9f56ffd640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f4406ae40 0x7f9f4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:33.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.161+0000 7f9f56ffd640 1 -- 172.21.15.45:0/2356658383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f9f50089880 con 0x7f9f600c7e00 2023-11-18T19:24:33.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.161+0000 7f9f6643e640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f4406ae40 0x7f9f4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:33.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.163+0000 7f9f6643e640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f4406ae40 0x7f9f4406d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c036000 tx=0x7f9f5c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:33.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.167+0000 7f9f56ffd640 1 -- 172.21.15.45:0/2356658383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f500545d0 con 0x7f9f600c7e00 2023-11-18T19:24:33.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.503+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f601589b0 con 0x7f9f4406ae40 2023-11-18T19:24:33.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.520+0000 7f9f56ffd640 1 -- 172.21.15.45:0/2356658383 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372274 (secure 0 0 0) 0x7f9f5c031b60 con 0x7f9f4406ae40 2023-11-18T19:24:33.526 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:24:33.528 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:24:33.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.526+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f4406ae40 msgr2=0x7f9f4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:33.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.526+0000 7f9f686a2640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f4406ae40 0x7f9f4406d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c036000 tx=0x7f9f5c03d040 comp rx=0 tx=0).stop 2023-11-18T19:24:33.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.526+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600c7e00 msgr2=0x7f9f601563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.526+0000 7f9f686a2640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600c7e00 0x7f9f601563b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c430 tx=0x7f9f5000c8f0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 shutdown_connections 2023-11-18T19:24:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f9f4406ae40 0x7f9f4406d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9f60151c00 0x7f9f601536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600c7e00 0x7f9f601563b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 --2- 172.21.15.45:0/2356658383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f600bd590 0x7f9f600bcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 >> 172.21.15.45:0/2356658383 conn(0x7f9f600663d0 msgr2=0x7f9f6014e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 shutdown_connections 2023-11-18T19:24:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:33.527+0000 7f9f686a2640 1 -- 172.21.15.45:0/2356658383 wait complete. 2023-11-18T19:24:33.551 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":564,"stamp":"2023-11-18T19:24:31.588592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1797666071,"num_objects":123786,"num_object_clones":0,"num_object_copies":392250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123786,"num_whiteouts":0,"num_read":995,"num_read_kb":1916,"num_write":271594,"num_write_kb":2424214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226371,"ondisk_log_size":226371,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4988680,"kb_used_data":2881864,"kb_used_omap":12,"kb_used_meta":2106739,"kb_avail":749986040,"statfs":{"total":773094113280,"available":767985704960,"internally_reserved":0,"allocated":2951028736,"data_stored":4355335357,"data_compressed":750532204,"data_compressed_allocated":897007616,"data_compressed_original":2302853120,"omap_allocated":12748,"internal_metadata":2157301300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,5,3,6,15,33,21,41,95,257,58,132,28],"upper_bound":8192},"perf_stat":{"commit_latency_ms":155,"apply_latency_ms":155,"commit_latency_ns":155000000,"apply_latency_ns":155000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4801465,"num_objects":4066,"num_object_clones":0,"num_object_copies":8010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4066,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":13244,"num_write_kb":23409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":249,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004214"},"pg_stats":[{"pgid":"2.1f","version":"29'404","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.420252+0000","last_change":"2023-11-18T19:06:37.049421+0000","last_active":"2023-11-18T19:24:26.420252+0000","last_peered":"2023-11-18T19:24:26.420252+0000","last_clean":"2023-11-18T19:24:26.420252+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:26.420252+0000","last_undegraded":"2023-11-18T19:24:26.420252+0000","last_fullsized":"2023-11-18T19:24:26.420252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":592,"num_write_kb":13689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'952","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.990949+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:24:26.990949+0000","last_peered":"2023-11-18T19:24:26.990949+0000","last_clean":"2023-11-18T19:24:26.990949+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:24:26.990949+0000","last_undegraded":"2023-11-18T19:24:26.990949+0000","last_fullsized":"2023-11-18T19:24:26.990949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":731,"num_object_clones":0,"num_object_copies":1462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4515","reported_seq":4538,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.196194+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:24:27.196194+0000","last_peered":"2023-11-18T19:24:27.196194+0000","last_clean":"2023-11-18T19:24:27.196194+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:27.196194+0000","last_undegraded":"2023-11-18T19:24:27.196194+0000","last_fullsized":"2023-11-18T19:24:27.196194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4515,"log_dups_size":0,"ondisk_log_size":4515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:53.247056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47448745,"num_objects":2214,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6085,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'324","reported_seq":349,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:25.308630+0000","last_change":"2023-11-18T19:06:37.056608+0000","last_active":"2023-11-18T19:24:25.308630+0000","last_peered":"2023-11-18T19:24:25.308630+0000","last_clean":"2023-11-18T19:24:25.308630+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:25.308630+0000","last_undegraded":"2023-11-18T19:24:25.308630+0000","last_fullsized":"2023-11-18T19:24:25.308630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":487,"num_write_kb":31117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":81,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'952","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.017095+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:24:27.017095+0000","last_peered":"2023-11-18T19:24:27.017095+0000","last_clean":"2023-11-18T19:24:27.017095+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:24:27.017095+0000","last_undegraded":"2023-11-18T19:24:27.017095+0000","last_fullsized":"2023-11-18T19:24:27.017095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4583","reported_seq":4607,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.033699+0000","last_change":"2023-11-18T19:06:41.610337+0000","last_active":"2023-11-18T19:24:27.033699+0000","last_peered":"2023-11-18T19:24:27.033699+0000","last_clean":"2023-11-18T19:24:27.033699+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:27.033699+0000","last_undegraded":"2023-11-18T19:24:27.033699+0000","last_fullsized":"2023-11-18T19:24:27.033699+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:11.418842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45442855,"num_objects":2273,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6171,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'511","reported_seq":536,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:23.079376+0000","last_change":"2023-11-18T19:06:37.054467+0000","last_active":"2023-11-18T19:24:23.079376+0000","last_peered":"2023-11-18T19:24:23.079376+0000","last_clean":"2023-11-18T19:24:23.079376+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:23.079376+0000","last_undegraded":"2023-11-18T19:24:23.079376+0000","last_fullsized":"2023-11-18T19:24:23.079376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":701,"num_write_kb":33858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":98,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'1018","reported_seq":1042,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.700437+0000","last_change":"2023-11-18T19:06:37.570950+0000","last_active":"2023-11-18T19:24:26.700437+0000","last_peered":"2023-11-18T19:24:26.700437+0000","last_clean":"2023-11-18T19:24:26.700437+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:26.700437+0000","last_undegraded":"2023-11-18T19:24:26.700437+0000","last_fullsized":"2023-11-18T19:24:26.700437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":804,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4623","reported_seq":4645,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.046482+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:24:27.046482+0000","last_peered":"2023-11-18T19:24:27.046482+0000","last_clean":"2023-11-18T19:24:27.046482+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:24:27.046482+0000","last_undegraded":"2023-11-18T19:24:27.046482+0000","last_fullsized":"2023-11-18T19:24:27.046482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48597389,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6213,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'266","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.827875+0000","last_change":"2023-11-18T19:06:37.060072+0000","last_active":"2023-11-18T19:24:26.827875+0000","last_peered":"2023-11-18T19:24:26.827875+0000","last_clean":"2023-11-18T19:24:26.827875+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:26.827875+0000","last_undegraded":"2023-11-18T19:24:26.827875+0000","last_fullsized":"2023-11-18T19:24:26.827875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":442,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'998","reported_seq":1022,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.970832+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:24:26.970832+0000","last_peered":"2023-11-18T19:24:26.970832+0000","last_clean":"2023-11-18T19:24:26.970832+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:24:26.970832+0000","last_undegraded":"2023-11-18T19:24:26.970832+0000","last_fullsized":"2023-11-18T19:24:26.970832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":998,"log_dups_size":0,"ondisk_log_size":998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:44.053038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":763,"num_object_clones":0,"num_object_copies":1526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":819,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4456","reported_seq":4479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.048515+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:24:27.048515+0000","last_peered":"2023-11-18T19:24:27.048515+0000","last_clean":"2023-11-18T19:24:27.048515+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:27.048515+0000","last_undegraded":"2023-11-18T19:24:27.048515+0000","last_fullsized":"2023-11-18T19:24:27.048515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4456,"log_dups_size":0,"ondisk_log_size":4456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:38.254981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44553589,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5936,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'980","reported_seq":1005,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.954457+0000","last_change":"2023-11-18T19:06:37.581511+0000","last_active":"2023-11-18T19:24:26.954457+0000","last_peered":"2023-11-18T19:24:26.954457+0000","last_clean":"2023-11-18T19:24:26.954457+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:26.954457+0000","last_undegraded":"2023-11-18T19:24:26.954457+0000","last_fullsized":"2023-11-18T19:24:26.954457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:00:16.539808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":740,"num_object_clones":0,"num_object_copies":1480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":802,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'415","reported_seq":440,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.304489+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:24:24.304489+0000","last_peered":"2023-11-18T19:24:24.304489+0000","last_clean":"2023-11-18T19:24:24.304489+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:24:24.304489+0000","last_undegraded":"2023-11-18T19:24:24.304489+0000","last_fullsized":"2023-11-18T19:24:24.304489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":29849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4618","reported_seq":4639,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.022724+0000","last_change":"2023-11-18T19:06:41.614725+0000","last_active":"2023-11-18T19:24:27.022724+0000","last_peered":"2023-11-18T19:24:27.022724+0000","last_clean":"2023-11-18T19:24:27.022724+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:27.022724+0000","last_undegraded":"2023-11-18T19:24:27.022724+0000","last_fullsized":"2023-11-18T19:24:27.022724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4618,"log_dups_size":0,"ondisk_log_size":4618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50701125,"num_objects":2305,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6225,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'1014","reported_seq":1037,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.809100+0000","last_change":"2023-11-18T19:06:37.578293+0000","last_active":"2023-11-18T19:24:26.809100+0000","last_peered":"2023-11-18T19:24:26.809100+0000","last_clean":"2023-11-18T19:24:26.809100+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:26.809100+0000","last_undegraded":"2023-11-18T19:24:26.809100+0000","last_fullsized":"2023-11-18T19:24:26.809100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:35:36.080366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":785,"num_object_clones":0,"num_object_copies":1570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'438","reported_seq":464,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:25.323795+0000","last_change":"2023-11-18T19:06:37.052386+0000","last_active":"2023-11-18T19:24:25.323795+0000","last_peered":"2023-11-18T19:24:25.323795+0000","last_clean":"2023-11-18T19:24:25.323795+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:25.323795+0000","last_undegraded":"2023-11-18T19:24:25.323795+0000","last_fullsized":"2023-11-18T19:24:25.323795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":30122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4571","reported_seq":4594,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.976896+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:24:26.976896+0000","last_peered":"2023-11-18T19:24:26.976896+0000","last_clean":"2023-11-18T19:24:26.976896+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:24:26.976896+0000","last_undegraded":"2023-11-18T19:24:26.976896+0000","last_fullsized":"2023-11-18T19:24:26.976896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4571,"log_dups_size":0,"ondisk_log_size":4571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6125,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'1051","reported_seq":1076,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.855276+0000","last_change":"2023-11-18T19:06:37.572776+0000","last_active":"2023-11-18T19:24:26.855276+0000","last_peered":"2023-11-18T19:24:26.855276+0000","last_clean":"2023-11-18T19:24:26.855276+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:26.855276+0000","last_undegraded":"2023-11-18T19:24:26.855276+0000","last_fullsized":"2023-11-18T19:24:26.855276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1051,"log_dups_size":0,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":808,"num_object_clones":0,"num_object_copies":1616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'443","reported_seq":469,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:25.190960+0000","last_change":"2023-11-18T19:06:37.060108+0000","last_active":"2023-11-18T19:24:25.190960+0000","last_peered":"2023-11-18T19:24:25.190960+0000","last_clean":"2023-11-18T19:24:25.190960+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:24:25.190960+0000","last_undegraded":"2023-11-18T19:24:25.190960+0000","last_fullsized":"2023-11-18T19:24:25.190960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:15.484970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":17586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4609","reported_seq":4631,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.992205+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:24:26.992205+0000","last_peered":"2023-11-18T19:24:26.992205+0000","last_clean":"2023-11-18T19:24:26.992205+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:24:26.992205+0000","last_undegraded":"2023-11-18T19:24:26.992205+0000","last_fullsized":"2023-11-18T19:24:26.992205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:59:36.899393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6233,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'989","reported_seq":1014,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.811657+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:24:26.811657+0000","last_peered":"2023-11-18T19:24:26.811657+0000","last_clean":"2023-11-18T19:24:26.811657+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:24:26.811657+0000","last_undegraded":"2023-11-18T19:24:26.811657+0000","last_fullsized":"2023-11-18T19:24:26.811657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:38.550233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'467","reported_seq":493,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.810438+0000","last_change":"2023-11-18T19:06:37.059045+0000","last_active":"2023-11-18T19:24:26.810438+0000","last_peered":"2023-11-18T19:24:26.810438+0000","last_clean":"2023-11-18T19:24:26.810438+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:26.810438+0000","last_undegraded":"2023-11-18T19:24:26.810438+0000","last_fullsized":"2023-11-18T19:24:26.810438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":13046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4549","reported_seq":4571,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.031915+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:24:27.031915+0000","last_peered":"2023-11-18T19:24:27.031915+0000","last_clean":"2023-11-18T19:24:27.031915+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:24:27.031915+0000","last_undegraded":"2023-11-18T19:24:27.031915+0000","last_fullsized":"2023-11-18T19:24:27.031915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53723490,"num_objects":2311,"num_object_clones":0,"num_object_copies":9244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6133,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'997","reported_seq":1022,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.843228+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:24:26.843228+0000","last_peered":"2023-11-18T19:24:26.843228+0000","last_clean":"2023-11-18T19:24:26.843228+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:26.843228+0000","last_undegraded":"2023-11-18T19:24:26.843228+0000","last_fullsized":"2023-11-18T19:24:26.843228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:37.793644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":783,"num_object_clones":0,"num_object_copies":1566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'294","reported_seq":320,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:23.937018+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:24:23.937018+0000","last_peered":"2023-11-18T19:24:23.937018+0000","last_clean":"2023-11-18T19:24:23.937018+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:24:23.937018+0000","last_undegraded":"2023-11-18T19:24:23.937018+0000","last_fullsized":"2023-11-18T19:24:23.937018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:07.496215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":469,"num_write_kb":13215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4569","reported_seq":4592,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.029490+0000","last_change":"2023-11-18T19:06:41.596046+0000","last_active":"2023-11-18T19:24:27.029490+0000","last_peered":"2023-11-18T19:24:27.029490+0000","last_clean":"2023-11-18T19:24:27.029490+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:27.029490+0000","last_undegraded":"2023-11-18T19:24:27.029490+0000","last_fullsized":"2023-11-18T19:24:27.029490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4569,"log_dups_size":0,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:37.688052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58452634,"num_objects":2264,"num_object_clones":0,"num_object_copies":9056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6141,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'947","reported_seq":972,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.746124+0000","last_change":"2023-11-18T19:06:37.567387+0000","last_active":"2023-11-18T19:24:26.746124+0000","last_peered":"2023-11-18T19:24:26.746124+0000","last_clean":"2023-11-18T19:24:26.746124+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:26.746124+0000","last_undegraded":"2023-11-18T19:24:26.746124+0000","last_fullsized":"2023-11-18T19:24:26.746124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'535","reported_seq":561,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.726335+0000","last_change":"2023-11-18T19:06:37.061883+0000","last_active":"2023-11-18T19:24:26.726335+0000","last_peered":"2023-11-18T19:24:26.726335+0000","last_clean":"2023-11-18T19:24:26.726335+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:26.726335+0000","last_undegraded":"2023-11-18T19:24:26.726335+0000","last_fullsized":"2023-11-18T19:24:26.726335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1057,"num_write_kb":20813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4574","reported_seq":4597,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.977499+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:24:26.977499+0000","last_peered":"2023-11-18T19:24:26.977499+0000","last_clean":"2023-11-18T19:24:26.977499+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:24:26.977499+0000","last_undegraded":"2023-11-18T19:24:26.977499+0000","last_fullsized":"2023-11-18T19:24:26.977499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4574,"log_dups_size":0,"ondisk_log_size":4574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41932084,"num_objects":2267,"num_object_clones":0,"num_object_copies":9068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6154,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'987","reported_seq":1012,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.951735+0000","last_change":"2023-11-18T19:06:37.569535+0000","last_active":"2023-11-18T19:24:26.951735+0000","last_peered":"2023-11-18T19:24:26.951735+0000","last_clean":"2023-11-18T19:24:26.951735+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:26.951735+0000","last_undegraded":"2023-11-18T19:24:26.951735+0000","last_fullsized":"2023-11-18T19:24:26.951735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:51.300567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'306","reported_seq":332,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.615139+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:24:24.615139+0000","last_peered":"2023-11-18T19:24:24.615139+0000","last_clean":"2023-11-18T19:24:24.615139+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:24:24.615139+0000","last_undegraded":"2023-11-18T19:24:24.615139+0000","last_fullsized":"2023-11-18T19:24:24.615139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:10.738943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":21633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4621","reported_seq":4644,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.806320+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:24:26.806320+0000","last_peered":"2023-11-18T19:24:26.806320+0000","last_clean":"2023-11-18T19:24:26.806320+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:24:26.806320+0000","last_undegraded":"2023-11-18T19:24:26.806320+0000","last_fullsized":"2023-11-18T19:24:26.806320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41011562,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6203,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'946","reported_seq":970,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.724569+0000","last_change":"2023-11-18T19:06:37.560091+0000","last_active":"2023-11-18T19:24:26.724569+0000","last_peered":"2023-11-18T19:24:26.724569+0000","last_clean":"2023-11-18T19:24:26.724569+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:26.724569+0000","last_undegraded":"2023-11-18T19:24:26.724569+0000","last_fullsized":"2023-11-18T19:24:26.724569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:41:09.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'473","reported_seq":498,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.421850+0000","last_change":"2023-11-18T19:06:37.051019+0000","last_active":"2023-11-18T19:24:26.421850+0000","last_peered":"2023-11-18T19:24:26.421850+0000","last_clean":"2023-11-18T19:24:26.421850+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:26.421850+0000","last_undegraded":"2023-11-18T19:24:26.421850+0000","last_fullsized":"2023-11-18T19:24:26.421850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:48:59.026684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":17360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4547","reported_seq":4570,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.935691+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:24:26.935691+0000","last_peered":"2023-11-18T19:24:26.935691+0000","last_clean":"2023-11-18T19:24:26.935691+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:24:26.935691+0000","last_undegraded":"2023-11-18T19:24:26.935691+0000","last_fullsized":"2023-11-18T19:24:26.935691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:16.839757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47540604,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'987","reported_seq":1012,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.848428+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:24:26.848428+0000","last_peered":"2023-11-18T19:24:26.848428+0000","last_clean":"2023-11-18T19:24:26.848428+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:26.848428+0000","last_undegraded":"2023-11-18T19:24:26.848428+0000","last_fullsized":"2023-11-18T19:24:26.848428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1181","reported_seq":1207,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.546875+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:24:24.546875+0000","last_peered":"2023-11-18T19:24:24.546875+0000","last_clean":"2023-11-18T19:24:24.546875+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:24:24.546875+0000","last_undegraded":"2023-11-18T19:24:24.546875+0000","last_fullsized":"2023-11-18T19:24:24.546875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:09:36.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4578","reported_seq":4604,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.026310+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:24:27.026310+0000","last_peered":"2023-11-18T19:24:27.026310+0000","last_clean":"2023-11-18T19:24:27.026310+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:24:27.026310+0000","last_undegraded":"2023-11-18T19:24:27.026310+0000","last_fullsized":"2023-11-18T19:24:27.026310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39429542,"num_objects":2302,"num_object_clones":0,"num_object_copies":9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6195,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'988","reported_seq":1012,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.864464+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:24:26.864464+0000","last_peered":"2023-11-18T19:24:26.864464+0000","last_clean":"2023-11-18T19:24:26.864464+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:26.864464+0000","last_undegraded":"2023-11-18T19:24:26.864464+0000","last_fullsized":"2023-11-18T19:24:26.864464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":778,"num_object_clones":0,"num_object_copies":1556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1834","reported_seq":2695,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.256351+0000","last_change":"2023-11-18T19:06:37.057382+0000","last_active":"2023-11-18T19:24:27.256351+0000","last_peered":"2023-11-18T19:24:27.256351+0000","last_clean":"2023-11-18T19:24:27.256351+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:27.256351+0000","last_undegraded":"2023-11-18T19:24:27.256351+0000","last_fullsized":"2023-11-18T19:24:27.256351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1834,"log_dups_size":0,"ondisk_log_size":1834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:19:28.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13059560,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":836,"num_read_kb":1816,"num_write":2028,"num_write_kb":27014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4483","reported_seq":4507,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.855198+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:24:26.855198+0000","last_peered":"2023-11-18T19:24:26.855198+0000","last_clean":"2023-11-18T19:24:26.855198+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:24:26.855198+0000","last_undegraded":"2023-11-18T19:24:26.855198+0000","last_fullsized":"2023-11-18T19:24:26.855198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:32.158573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52629501,"num_objects":2217,"num_object_clones":0,"num_object_copies":8868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5979,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'928","reported_seq":953,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.695045+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:24:26.695045+0000","last_peered":"2023-11-18T19:24:26.695045+0000","last_clean":"2023-11-18T19:24:26.695045+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:26.695045+0000","last_undegraded":"2023-11-18T19:24:26.695045+0000","last_fullsized":"2023-11-18T19:24:26.695045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'481","reported_seq":507,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.413000+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:24:26.413000+0000","last_peered":"2023-11-18T19:24:26.413000+0000","last_clean":"2023-11-18T19:24:26.413000+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:24:26.413000+0000","last_undegraded":"2023-11-18T19:24:26.413000+0000","last_fullsized":"2023-11-18T19:24:26.413000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:06.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":29679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4675","reported_seq":4698,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.013105+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:24:27.013105+0000","last_peered":"2023-11-18T19:24:27.013105+0000","last_clean":"2023-11-18T19:24:27.013105+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:24:27.013105+0000","last_undegraded":"2023-11-18T19:24:27.013105+0000","last_fullsized":"2023-11-18T19:24:27.013105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:24.841247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43888851,"num_objects":2286,"num_object_clones":0,"num_object_copies":9144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6293,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'980","reported_seq":1005,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.787589+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:24:26.787589+0000","last_peered":"2023-11-18T19:24:26.787589+0000","last_clean":"2023-11-18T19:24:26.787589+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:26.787589+0000","last_undegraded":"2023-11-18T19:24:26.787589+0000","last_fullsized":"2023-11-18T19:24:26.787589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":768,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'415","reported_seq":441,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.047583+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:24:27.047583+0000","last_peered":"2023-11-18T19:24:27.047583+0000","last_clean":"2023-11-18T19:24:27.047583+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:24:27.047583+0000","last_undegraded":"2023-11-18T19:24:27.047583+0000","last_fullsized":"2023-11-18T19:24:27.047583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:02.627949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":179,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:22:40.196971+0000","last_change":"2023-11-18T19:06:32.610358+0000","last_active":"2023-11-18T19:22:40.196971+0000","last_peered":"2023-11-18T19:22:40.196971+0000","last_clean":"2023-11-18T19:22:40.196971+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:22:40.196971+0000","last_undegraded":"2023-11-18T19:22:40.196971+0000","last_fullsized":"2023-11-18T19:22:40.196971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:31.454786+0000","last_clean_scrub_stamp":"2023-11-18T19:06:31.454786+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4468","reported_seq":4491,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.022362+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:24:27.022362+0000","last_peered":"2023-11-18T19:24:27.022362+0000","last_clean":"2023-11-18T19:24:27.022362+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:24:27.022362+0000","last_undegraded":"2023-11-18T19:24:27.022362+0000","last_fullsized":"2023-11-18T19:24:27.022362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4468,"log_dups_size":0,"ondisk_log_size":4468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:58:05.259269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47903098,"num_objects":2231,"num_object_clones":0,"num_object_copies":8924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5990,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'983","reported_seq":1007,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.006990+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:24:27.006990+0000","last_peered":"2023-11-18T19:24:27.006990+0000","last_clean":"2023-11-18T19:24:27.006990+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:24:27.006990+0000","last_undegraded":"2023-11-18T19:24:27.006990+0000","last_fullsized":"2023-11-18T19:24:27.006990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:50:21.294721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":764,"num_object_clones":0,"num_object_copies":1528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":764,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'463","reported_seq":488,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:25.509889+0000","last_change":"2023-11-18T19:06:37.055070+0000","last_active":"2023-11-18T19:24:25.509889+0000","last_peered":"2023-11-18T19:24:25.509889+0000","last_clean":"2023-11-18T19:24:25.509889+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:24:25.509889+0000","last_undegraded":"2023-11-18T19:24:25.509889+0000","last_fullsized":"2023-11-18T19:24:25.509889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:33.955560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":658,"num_write_kb":29852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4629","reported_seq":4651,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.050993+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:24:27.050993+0000","last_peered":"2023-11-18T19:24:27.050993+0000","last_clean":"2023-11-18T19:24:27.050993+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:24:27.050993+0000","last_undegraded":"2023-11-18T19:24:27.050993+0000","last_fullsized":"2023-11-18T19:24:27.050993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:32.443867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54570935,"num_objects":2278,"num_object_clones":0,"num_object_copies":9112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6188,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'952","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.980428+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:24:26.980428+0000","last_peered":"2023-11-18T19:24:26.980428+0000","last_clean":"2023-11-18T19:24:26.980428+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:26.980428+0000","last_undegraded":"2023-11-18T19:24:26.980428+0000","last_fullsized":"2023-11-18T19:24:26.980428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'892","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:23.992396+0000","last_change":"2023-11-18T19:06:37.058479+0000","last_active":"2023-11-18T19:24:23.992396+0000","last_peered":"2023-11-18T19:24:23.992396+0000","last_clean":"2023-11-18T19:24:23.992396+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:24:23.992396+0000","last_undegraded":"2023-11-18T19:24:23.992396+0000","last_fullsized":"2023-11-18T19:24:23.992396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:08:50.290941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":34394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4679","reported_seq":4702,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.983575+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:24:26.983575+0000","last_peered":"2023-11-18T19:24:26.983575+0000","last_clean":"2023-11-18T19:24:26.983575+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:24:26.983575+0000","last_undegraded":"2023-11-18T19:24:26.983575+0000","last_fullsized":"2023-11-18T19:24:26.983575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:53.248814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46904542,"num_objects":2317,"num_object_clones":0,"num_object_copies":9268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2317,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6289,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'970","reported_seq":994,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.751401+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:24:26.751401+0000","last_peered":"2023-11-18T19:24:26.751401+0000","last_clean":"2023-11-18T19:24:26.751401+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:24:26.751401+0000","last_undegraded":"2023-11-18T19:24:26.751401+0000","last_fullsized":"2023-11-18T19:24:26.751401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":970,"log_dups_size":0,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'599","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.425122+0000","last_change":"2023-11-18T19:06:37.059639+0000","last_active":"2023-11-18T19:24:26.425122+0000","last_peered":"2023-11-18T19:24:26.425122+0000","last_clean":"2023-11-18T19:24:26.425122+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:26.425122+0000","last_undegraded":"2023-11-18T19:24:26.425122+0000","last_fullsized":"2023-11-18T19:24:26.425122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:57.040178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":764,"num_write_kb":21557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4777","reported_seq":4801,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.019551+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:24:27.019551+0000","last_peered":"2023-11-18T19:24:27.019551+0000","last_clean":"2023-11-18T19:24:27.019551+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:24:27.019551+0000","last_undegraded":"2023-11-18T19:24:27.019551+0000","last_fullsized":"2023-11-18T19:24:27.019551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4777,"log_dups_size":0,"ondisk_log_size":4777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:06:25.309377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53454220,"num_objects":2315,"num_object_clones":0,"num_object_copies":9260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2315,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6411,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'986","reported_seq":1009,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.994119+0000","last_change":"2023-11-18T19:06:37.570406+0000","last_active":"2023-11-18T19:24:26.994119+0000","last_peered":"2023-11-18T19:24:26.994119+0000","last_clean":"2023-11-18T19:24:26.994119+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:26.994119+0000","last_undegraded":"2023-11-18T19:24:26.994119+0000","last_fullsized":"2023-11-18T19:24:26.994119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:24:16.494595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'301","reported_seq":326,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:23.252798+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:24:23.252798+0000","last_peered":"2023-11-18T19:24:23.252798+0000","last_clean":"2023-11-18T19:24:23.252798+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:23.252798+0000","last_undegraded":"2023-11-18T19:24:23.252798+0000","last_fullsized":"2023-11-18T19:24:23.252798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":464,"num_write_kb":13159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4549","reported_seq":4575,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.991009+0000","last_change":"2023-11-18T19:06:41.604441+0000","last_active":"2023-11-18T19:24:26.991009+0000","last_peered":"2023-11-18T19:24:26.991009+0000","last_clean":"2023-11-18T19:24:26.991009+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:26.991009+0000","last_undegraded":"2023-11-18T19:24:26.991009+0000","last_fullsized":"2023-11-18T19:24:26.991009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6093,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'1023","reported_seq":1047,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.866041+0000","last_change":"2023-11-18T19:06:37.572644+0000","last_active":"2023-11-18T19:24:26.866041+0000","last_peered":"2023-11-18T19:24:26.866041+0000","last_clean":"2023-11-18T19:24:26.866041+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:26.866041+0000","last_undegraded":"2023-11-18T19:24:26.866041+0000","last_fullsized":"2023-11-18T19:24:26.866041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:41.916613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'353","reported_seq":378,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:23.135027+0000","last_change":"2023-11-18T19:06:37.055860+0000","last_active":"2023-11-18T19:24:23.135027+0000","last_peered":"2023-11-18T19:24:23.135027+0000","last_clean":"2023-11-18T19:24:23.135027+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:23.135027+0000","last_undegraded":"2023-11-18T19:24:23.135027+0000","last_fullsized":"2023-11-18T19:24:23.135027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:40:04.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":559,"num_write_kb":13211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4506","reported_seq":4537,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.036660+0000","last_change":"2023-11-18T19:07:25.182659+0000","last_active":"2023-11-18T19:24:27.036660+0000","last_peered":"2023-11-18T19:24:27.036660+0000","last_clean":"2023-11-18T19:24:27.036660+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:24:27.036660+0000","last_undegraded":"2023-11-18T19:24:27.036660+0000","last_fullsized":"2023-11-18T19:24:27.036660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40895696,"num_objects":2243,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6032,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'982","reported_seq":1006,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.801456+0000","last_change":"2023-11-18T19:06:37.566905+0000","last_active":"2023-11-18T19:24:26.801456+0000","last_peered":"2023-11-18T19:24:26.801456+0000","last_clean":"2023-11-18T19:24:26.801456+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:26.801456+0000","last_undegraded":"2023-11-18T19:24:26.801456+0000","last_fullsized":"2023-11-18T19:24:26.801456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":760,"num_object_clones":0,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'285","reported_seq":310,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.872748+0000","last_change":"2023-11-18T19:06:37.059061+0000","last_active":"2023-11-18T19:24:26.872748+0000","last_peered":"2023-11-18T19:24:26.872748+0000","last_clean":"2023-11-18T19:24:26.872748+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:26.872748+0000","last_undegraded":"2023-11-18T19:24:26.872748+0000","last_fullsized":"2023-11-18T19:24:26.872748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":490,"num_write_kb":9347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4642","reported_seq":4664,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.021719+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:24:27.021719+0000","last_peered":"2023-11-18T19:24:27.021719+0000","last_clean":"2023-11-18T19:24:27.021719+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:24:27.021719+0000","last_undegraded":"2023-11-18T19:24:27.021719+0000","last_fullsized":"2023-11-18T19:24:27.021719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4642,"log_dups_size":0,"ondisk_log_size":4642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:43:47.599564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39856077,"num_objects":2314,"num_object_clones":0,"num_object_copies":9256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6236,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'965","reported_seq":996,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.031265+0000","last_change":"2023-11-18T19:07:25.179515+0000","last_active":"2023-11-18T19:24:27.031265+0000","last_peered":"2023-11-18T19:24:27.031265+0000","last_clean":"2023-11-18T19:24:27.031265+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:27.031265+0000","last_undegraded":"2023-11-18T19:24:27.031265+0000","last_fullsized":"2023-11-18T19:24:27.031265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:25:56.657976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'432","reported_seq":457,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.880868+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:24:24.880868+0000","last_peered":"2023-11-18T19:24:24.880868+0000","last_clean":"2023-11-18T19:24:24.880868+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:24:24.880868+0000","last_undegraded":"2023-11-18T19:24:24.880868+0000","last_fullsized":"2023-11-18T19:24:24.880868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:40.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":667,"num_write_kb":5679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":118,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4441","reported_seq":4463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.982881+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:24:26.982881+0000","last_peered":"2023-11-18T19:24:26.982881+0000","last_clean":"2023-11-18T19:24:26.982881+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:24:26.982881+0000","last_undegraded":"2023-11-18T19:24:26.982881+0000","last_fullsized":"2023-11-18T19:24:26.982881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:15.295095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54095014,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'933","reported_seq":957,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.876574+0000","last_change":"2023-11-18T19:06:37.556060+0000","last_active":"2023-11-18T19:24:26.876574+0000","last_peered":"2023-11-18T19:24:26.876574+0000","last_clean":"2023-11-18T19:24:26.876574+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:26.876574+0000","last_undegraded":"2023-11-18T19:24:26.876574+0000","last_fullsized":"2023-11-18T19:24:26.876574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'373","reported_seq":397,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:22.932004+0000","last_change":"2023-11-18T19:06:37.061716+0000","last_active":"2023-11-18T19:24:22.932004+0000","last_peered":"2023-11-18T19:24:22.932004+0000","last_clean":"2023-11-18T19:24:22.932004+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:22.932004+0000","last_undegraded":"2023-11-18T19:24:22.932004+0000","last_fullsized":"2023-11-18T19:24:22.932004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:30.172222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":17513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":107,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4420","reported_seq":4439,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.968183+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:24:26.968183+0000","last_peered":"2023-11-18T19:24:26.968183+0000","last_clean":"2023-11-18T19:24:26.968183+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:24:26.968183+0000","last_undegraded":"2023-11-18T19:24:26.968183+0000","last_fullsized":"2023-11-18T19:24:26.968183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":0,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:35:50.682240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46166125,"num_objects":2199,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5979,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'946","reported_seq":970,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.751371+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:24:26.751371+0000","last_peered":"2023-11-18T19:24:26.751371+0000","last_clean":"2023-11-18T19:24:26.751371+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:26.751371+0000","last_undegraded":"2023-11-18T19:24:26.751371+0000","last_fullsized":"2023-11-18T19:24:26.751371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":735,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'604","reported_seq":628,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.431142+0000","last_change":"2023-11-18T19:06:37.049696+0000","last_active":"2023-11-18T19:24:26.431142+0000","last_peered":"2023-11-18T19:24:26.431142+0000","last_clean":"2023-11-18T19:24:26.431142+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:26.431142+0000","last_undegraded":"2023-11-18T19:24:26.431142+0000","last_fullsized":"2023-11-18T19:24:26.431142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:00:45.937874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":818,"num_write_kb":30025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4438","reported_seq":4460,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.031586+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:24:27.031586+0000","last_peered":"2023-11-18T19:24:27.031586+0000","last_clean":"2023-11-18T19:24:27.031586+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:24:27.031586+0000","last_undegraded":"2023-11-18T19:24:27.031586+0000","last_fullsized":"2023-11-18T19:24:27.031586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4438,"log_dups_size":0,"ondisk_log_size":4438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:28:45.463139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53099612,"num_objects":2240,"num_object_clones":0,"num_object_copies":8960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'959","reported_seq":983,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.840161+0000","last_change":"2023-11-18T19:06:37.577670+0000","last_active":"2023-11-18T19:24:26.840161+0000","last_peered":"2023-11-18T19:24:26.840161+0000","last_clean":"2023-11-18T19:24:26.840161+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:26.840161+0000","last_undegraded":"2023-11-18T19:24:26.840161+0000","last_fullsized":"2023-11-18T19:24:26.840161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:18:49.702288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'772","reported_seq":796,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.855337+0000","last_change":"2023-11-18T19:06:37.053254+0000","last_active":"2023-11-18T19:24:26.855337+0000","last_peered":"2023-11-18T19:24:26.855337+0000","last_clean":"2023-11-18T19:24:26.855337+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:26.855337+0000","last_undegraded":"2023-11-18T19:24:26.855337+0000","last_fullsized":"2023-11-18T19:24:26.855337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:15:00.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":978,"num_write_kb":22256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4525","reported_seq":4547,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.049216+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:24:27.049216+0000","last_peered":"2023-11-18T19:24:27.049216+0000","last_clean":"2023-11-18T19:24:27.049216+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:27.049216+0000","last_undegraded":"2023-11-18T19:24:27.049216+0000","last_fullsized":"2023-11-18T19:24:27.049216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:20.224532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879149,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6129,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'969","reported_seq":992,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.028368+0000","last_change":"2023-11-18T19:06:37.580326+0000","last_active":"2023-11-18T19:24:27.028368+0000","last_peered":"2023-11-18T19:24:27.028368+0000","last_clean":"2023-11-18T19:24:27.028368+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:27.028368+0000","last_undegraded":"2023-11-18T19:24:27.028368+0000","last_fullsized":"2023-11-18T19:24:27.028368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:37:34.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":759,"num_object_clones":0,"num_object_copies":1518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'374","reported_seq":399,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:23.201199+0000","last_change":"2023-11-18T19:06:37.054694+0000","last_active":"2023-11-18T19:24:23.201199+0000","last_peered":"2023-11-18T19:24:23.201199+0000","last_clean":"2023-11-18T19:24:23.201199+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:24:23.201199+0000","last_undegraded":"2023-11-18T19:24:23.201199+0000","last_fullsized":"2023-11-18T19:24:23.201199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":562,"num_write_kb":25902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4461","reported_seq":4484,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.079322+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:24:27.079322+0000","last_peered":"2023-11-18T19:24:27.079322+0000","last_clean":"2023-11-18T19:24:27.079322+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:27.079322+0000","last_undegraded":"2023-11-18T19:24:27.079322+0000","last_fullsized":"2023-11-18T19:24:27.079322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:21:42.418570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66632640,"num_objects":2174,"num_object_clones":0,"num_object_copies":8696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5996,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'976","reported_seq":999,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.032037+0000","last_change":"2023-11-18T19:06:37.586108+0000","last_active":"2023-11-18T19:24:27.032037+0000","last_peered":"2023-11-18T19:24:27.032037+0000","last_clean":"2023-11-18T19:24:27.032037+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:27.032037+0000","last_undegraded":"2023-11-18T19:24:27.032037+0000","last_fullsized":"2023-11-18T19:24:27.032037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1225","reported_seq":1250,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.633354+0000","last_change":"2023-11-18T19:06:37.054068+0000","last_active":"2023-11-18T19:24:26.633354+0000","last_peered":"2023-11-18T19:24:26.633354+0000","last_clean":"2023-11-18T19:24:26.633354+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:26.633354+0000","last_undegraded":"2023-11-18T19:24:26.633354+0000","last_fullsized":"2023-11-18T19:24:26.633354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1397,"num_write_kb":22068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4689","reported_seq":4720,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.942637+0000","last_change":"2023-11-18T19:07:25.179857+0000","last_active":"2023-11-18T19:24:26.942637+0000","last_peered":"2023-11-18T19:24:26.942637+0000","last_clean":"2023-11-18T19:24:26.942637+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:24:26.942637+0000","last_undegraded":"2023-11-18T19:24:26.942637+0000","last_fullsized":"2023-11-18T19:24:26.942637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:47:25.039988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111025,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6322,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4432","reported_seq":4456,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.863690+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:24:26.863690+0000","last_peered":"2023-11-18T19:24:26.863690+0000","last_clean":"2023-11-18T19:24:26.863690+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:24:26.863690+0000","last_undegraded":"2023-11-18T19:24:26.863690+0000","last_fullsized":"2023-11-18T19:24:26.863690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:35:42.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32576492,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5932,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'968","reported_seq":992,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.859601+0000","last_change":"2023-11-18T19:06:37.566336+0000","last_active":"2023-11-18T19:24:26.859601+0000","last_peered":"2023-11-18T19:24:26.859601+0000","last_clean":"2023-11-18T19:24:26.859601+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:26.859601+0000","last_undegraded":"2023-11-18T19:24:26.859601+0000","last_fullsized":"2023-11-18T19:24:26.859601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:39:41.973616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":751,"num_object_clones":0,"num_object_copies":1502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'531","reported_seq":556,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.419497+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:24:26.419497+0000","last_peered":"2023-11-18T19:24:26.419497+0000","last_clean":"2023-11-18T19:24:26.419497+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:24:26.419497+0000","last_undegraded":"2023-11-18T19:24:26.419497+0000","last_fullsized":"2023-11-18T19:24:26.419497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:52.770320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":711,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4401","reported_seq":4424,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.047295+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:24:27.047295+0000","last_peered":"2023-11-18T19:24:27.047295+0000","last_clean":"2023-11-18T19:24:27.047295+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:24:27.047295+0000","last_undegraded":"2023-11-18T19:24:27.047295+0000","last_fullsized":"2023-11-18T19:24:27.047295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:20:30.004291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48972751,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5897,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'1031","reported_seq":1054,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.771487+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:24:26.771487+0000","last_peered":"2023-11-18T19:24:26.771487+0000","last_clean":"2023-11-18T19:24:26.771487+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:26.771487+0000","last_undegraded":"2023-11-18T19:24:26.771487+0000","last_fullsized":"2023-11-18T19:24:26.771487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:14:07.872316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":790,"num_object_clones":0,"num_object_copies":1580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'317","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.068868+0000","last_change":"2023-11-18T19:06:37.057903+0000","last_active":"2023-11-18T19:24:24.068868+0000","last_peered":"2023-11-18T19:24:24.068868+0000","last_clean":"2023-11-18T19:24:24.068868+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:24.068868+0000","last_undegraded":"2023-11-18T19:24:24.068868+0000","last_fullsized":"2023-11-18T19:24:24.068868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:41.243351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":17267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'674","reported_seq":699,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.761963+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:24:26.761963+0000","last_peered":"2023-11-18T19:24:26.761963+0000","last_clean":"2023-11-18T19:24:26.761963+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:24:26.761963+0000","last_undegraded":"2023-11-18T19:24:26.761963+0000","last_fullsized":"2023-11-18T19:24:26.761963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:01.372551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":33823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'969","reported_seq":993,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.732575+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:24:26.732575+0000","last_peered":"2023-11-18T19:24:26.732575+0000","last_clean":"2023-11-18T19:24:26.732575+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:26.732575+0000","last_undegraded":"2023-11-18T19:24:26.732575+0000","last_fullsized":"2023-11-18T19:24:26.732575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":753,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4623","reported_seq":4645,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.933361+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:24:26.933361+0000","last_peered":"2023-11-18T19:24:26.933361+0000","last_clean":"2023-11-18T19:24:26.933361+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:24:26.933361+0000","last_undegraded":"2023-11-18T19:24:26.933361+0000","last_fullsized":"2023-11-18T19:24:26.933361+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:11.721101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50816520,"num_objects":2330,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6227,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'263","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.306454+0000","last_change":"2023-11-18T19:06:37.055554+0000","last_active":"2023-11-18T19:24:24.306454+0000","last_peered":"2023-11-18T19:24:24.306454+0000","last_clean":"2023-11-18T19:24:24.306454+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:24:24.306454+0000","last_undegraded":"2023-11-18T19:24:24.306454+0000","last_fullsized":"2023-11-18T19:24:24.306454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:40.136769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":92,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'970","reported_seq":994,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.799350+0000","last_change":"2023-11-18T19:06:37.574764+0000","last_active":"2023-11-18T19:24:26.799350+0000","last_peered":"2023-11-18T19:24:26.799350+0000","last_clean":"2023-11-18T19:24:26.799350+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:26.799350+0000","last_undegraded":"2023-11-18T19:24:26.799350+0000","last_fullsized":"2023-11-18T19:24:26.799350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":970,"log_dups_size":0,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4639","reported_seq":4661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.912574+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:24:26.912574+0000","last_peered":"2023-11-18T19:24:26.912574+0000","last_clean":"2023-11-18T19:24:26.912574+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:24:26.912574+0000","last_undegraded":"2023-11-18T19:24:26.912574+0000","last_fullsized":"2023-11-18T19:24:26.912574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:17:46.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38511782,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6251,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'984","reported_seq":1008,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.861933+0000","last_change":"2023-11-18T19:06:37.558113+0000","last_active":"2023-11-18T19:24:26.861933+0000","last_peered":"2023-11-18T19:24:26.861933+0000","last_clean":"2023-11-18T19:24:26.861933+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:26.861933+0000","last_undegraded":"2023-11-18T19:24:26.861933+0000","last_fullsized":"2023-11-18T19:24:26.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:29:58.049803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":749,"num_object_clones":0,"num_object_copies":1498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'1021","reported_seq":1045,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.169078+0000","last_change":"2023-11-18T19:06:37.579556+0000","last_active":"2023-11-18T19:24:27.169078+0000","last_peered":"2023-11-18T19:24:27.169078+0000","last_clean":"2023-11-18T19:24:27.169078+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:27.169078+0000","last_undegraded":"2023-11-18T19:24:27.169078+0000","last_fullsized":"2023-11-18T19:24:27.169078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:22:37.147851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":846,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'982","reported_seq":1006,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.930753+0000","last_change":"2023-11-18T19:06:37.575203+0000","last_active":"2023-11-18T19:24:26.930753+0000","last_peered":"2023-11-18T19:24:26.930753+0000","last_clean":"2023-11-18T19:24:26.930753+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:26.930753+0000","last_undegraded":"2023-11-18T19:24:26.930753+0000","last_fullsized":"2023-11-18T19:24:26.930753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:23:08.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'996","reported_seq":1020,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.822654+0000","last_change":"2023-11-18T19:06:37.579497+0000","last_active":"2023-11-18T19:24:26.822654+0000","last_peered":"2023-11-18T19:24:26.822654+0000","last_clean":"2023-11-18T19:24:26.822654+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:26.822654+0000","last_undegraded":"2023-11-18T19:24:26.822654+0000","last_fullsized":"2023-11-18T19:24:26.822654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:15:53.779946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'981","reported_seq":1006,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.980936+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:24:26.980936+0000","last_peered":"2023-11-18T19:24:26.980936+0000","last_clean":"2023-11-18T19:24:26.980936+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:24:26.980936+0000","last_undegraded":"2023-11-18T19:24:26.980936+0000","last_fullsized":"2023-11-18T19:24:26.980936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:49:00.036309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'961","reported_seq":986,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.688809+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:24:26.688809+0000","last_peered":"2023-11-18T19:24:26.688809+0000","last_clean":"2023-11-18T19:24:26.688809+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:24:26.688809+0000","last_undegraded":"2023-11-18T19:24:26.688809+0000","last_fullsized":"2023-11-18T19:24:26.688809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:46:08.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":802,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'1027","reported_seq":1051,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.031392+0000","last_change":"2023-11-18T19:06:37.586099+0000","last_active":"2023-11-18T19:24:27.031392+0000","last_peered":"2023-11-18T19:24:27.031392+0000","last_clean":"2023-11-18T19:24:27.031392+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:27.031392+0000","last_undegraded":"2023-11-18T19:24:27.031392+0000","last_fullsized":"2023-11-18T19:24:27.031392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:05:03.637574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'957","reported_seq":981,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.989965+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:24:26.989965+0000","last_peered":"2023-11-18T19:24:26.989965+0000","last_clean":"2023-11-18T19:24:26.989965+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:24:26.989965+0000","last_undegraded":"2023-11-18T19:24:26.989965+0000","last_fullsized":"2023-11-18T19:24:26.989965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:36:02.382177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'984","reported_seq":1008,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.976635+0000","last_change":"2023-11-18T19:06:37.573871+0000","last_active":"2023-11-18T19:24:26.976635+0000","last_peered":"2023-11-18T19:24:26.976635+0000","last_clean":"2023-11-18T19:24:26.976635+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:26.976635+0000","last_undegraded":"2023-11-18T19:24:26.976635+0000","last_fullsized":"2023-11-18T19:24:26.976635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:41:28.612048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":748,"num_object_clones":0,"num_object_copies":1496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'948","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.081907+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:24:27.081907+0000","last_peered":"2023-11-18T19:24:27.081907+0000","last_clean":"2023-11-18T19:24:27.081907+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:27.081907+0000","last_undegraded":"2023-11-18T19:24:27.081907+0000","last_fullsized":"2023-11-18T19:24:27.081907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:14:28.897341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":758,"num_object_clones":0,"num_object_copies":1516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'987","reported_seq":1011,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.699951+0000","last_change":"2023-11-18T19:06:37.572149+0000","last_active":"2023-11-18T19:24:26.699951+0000","last_peered":"2023-11-18T19:24:26.699951+0000","last_clean":"2023-11-18T19:24:26.699951+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:26.699951+0000","last_undegraded":"2023-11-18T19:24:26.699951+0000","last_fullsized":"2023-11-18T19:24:26.699951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":757,"num_object_clones":0,"num_object_copies":1514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'993","reported_seq":1017,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.777938+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:24:26.777938+0000","last_peered":"2023-11-18T19:24:26.777938+0000","last_clean":"2023-11-18T19:24:26.777938+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:26.777938+0000","last_undegraded":"2023-11-18T19:24:26.777938+0000","last_fullsized":"2023-11-18T19:24:26.777938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":780,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'1686","reported_seq":1748,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:28.332964+0000","last_change":"2023-11-18T19:24:28.333003+0000","last_active":"2023-11-18T19:24:28.332964+0000","last_peered":"2023-11-18T19:24:28.332964+0000","last_clean":"2023-11-18T19:24:28.332964+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:28.332964+0000","last_undegraded":"2023-11-18T19:24:28.332964+0000","last_fullsized":"2023-11-18T19:24:28.332964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1686","last_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_deep_scrub":"29'1686","last_deep_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_clean_scrub_stamp":"2023-11-18T19:24:28.332899+0000","objects_scrubbed":752,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:08.798032+0000","scrub_duration":0.58671065600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'997","reported_seq":1021,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.906065+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:24:26.906065+0000","last_peered":"2023-11-18T19:24:26.906065+0000","last_clean":"2023-11-18T19:24:26.906065+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:24:26.906065+0000","last_undegraded":"2023-11-18T19:24:26.906065+0000","last_fullsized":"2023-11-18T19:24:26.906065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:53:22.380769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":777,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'932","reported_seq":955,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.756516+0000","last_change":"2023-11-18T19:06:37.579599+0000","last_active":"2023-11-18T19:24:26.756516+0000","last_peered":"2023-11-18T19:24:26.756516+0000","last_clean":"2023-11-18T19:24:26.756516+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:26.756516+0000","last_undegraded":"2023-11-18T19:24:26.756516+0000","last_fullsized":"2023-11-18T19:24:26.756516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:53:56.968054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1023","reported_seq":1047,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.933311+0000","last_change":"2023-11-18T19:06:37.579400+0000","last_active":"2023-11-18T19:24:26.933311+0000","last_peered":"2023-11-18T19:24:26.933311+0000","last_clean":"2023-11-18T19:24:26.933311+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:26.933311+0000","last_undegraded":"2023-11-18T19:24:26.933311+0000","last_fullsized":"2023-11-18T19:24:26.933311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:17:49.296702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":806,"num_object_clones":0,"num_object_copies":1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'944","reported_seq":968,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.904259+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:24:26.904259+0000","last_peered":"2023-11-18T19:24:26.904259+0000","last_clean":"2023-11-18T19:24:26.904259+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:26.904259+0000","last_undegraded":"2023-11-18T19:24:26.904259+0000","last_fullsized":"2023-11-18T19:24:26.904259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":723,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'997","reported_seq":1020,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.075190+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:24:27.075190+0000","last_peered":"2023-11-18T19:24:27.075190+0000","last_clean":"2023-11-18T19:24:27.075190+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:27.075190+0000","last_undegraded":"2023-11-18T19:24:27.075190+0000","last_fullsized":"2023-11-18T19:24:27.075190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:07:34.708455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'938","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.829672+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:24:26.829672+0000","last_peered":"2023-11-18T19:24:26.829672+0000","last_clean":"2023-11-18T19:24:26.829672+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:26.829672+0000","last_undegraded":"2023-11-18T19:24:26.829672+0000","last_fullsized":"2023-11-18T19:24:26.829672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:10.944415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'965","reported_seq":989,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.761174+0000","last_change":"2023-11-18T19:06:37.576957+0000","last_active":"2023-11-18T19:24:26.761174+0000","last_peered":"2023-11-18T19:24:26.761174+0000","last_clean":"2023-11-18T19:24:26.761174+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:26.761174+0000","last_undegraded":"2023-11-18T19:24:26.761174+0000","last_fullsized":"2023-11-18T19:24:26.761174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:08:41.146394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":761,"num_object_clones":0,"num_object_copies":1522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'941","reported_seq":965,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.957452+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:24:26.957452+0000","last_peered":"2023-11-18T19:24:26.957452+0000","last_clean":"2023-11-18T19:24:26.957452+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:26.957452+0000","last_undegraded":"2023-11-18T19:24:26.957452+0000","last_fullsized":"2023-11-18T19:24:26.957452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":741,"num_object_clones":0,"num_object_copies":1482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'960","reported_seq":984,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.861383+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:24:26.861383+0000","last_peered":"2023-11-18T19:24:26.861383+0000","last_clean":"2023-11-18T19:24:26.861383+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:24:26.861383+0000","last_undegraded":"2023-11-18T19:24:26.861383+0000","last_fullsized":"2023-11-18T19:24:26.861383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'942","reported_seq":966,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.771702+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:24:26.771702+0000","last_peered":"2023-11-18T19:24:26.771702+0000","last_clean":"2023-11-18T19:24:26.771702+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:24:26.771702+0000","last_undegraded":"2023-11-18T19:24:26.771702+0000","last_fullsized":"2023-11-18T19:24:26.771702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":738,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'1010","reported_seq":1034,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.859878+0000","last_change":"2023-11-18T19:06:37.586882+0000","last_active":"2023-11-18T19:24:26.859878+0000","last_peered":"2023-11-18T19:24:26.859878+0000","last_clean":"2023-11-18T19:24:26.859878+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:26.859878+0000","last_undegraded":"2023-11-18T19:24:26.859878+0000","last_fullsized":"2023-11-18T19:24:26.859878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'939","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.857173+0000","last_change":"2023-11-18T19:06:37.573071+0000","last_active":"2023-11-18T19:24:26.857173+0000","last_peered":"2023-11-18T19:24:26.857173+0000","last_clean":"2023-11-18T19:24:26.857173+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:26.857173+0000","last_undegraded":"2023-11-18T19:24:26.857173+0000","last_fullsized":"2023-11-18T19:24:26.857173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:23:16.678006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":748,"num_object_clones":0,"num_object_copies":1496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'975","reported_seq":999,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.843882+0000","last_change":"2023-11-18T19:06:37.567619+0000","last_active":"2023-11-18T19:24:26.843882+0000","last_peered":"2023-11-18T19:24:26.843882+0000","last_clean":"2023-11-18T19:24:26.843882+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:26.843882+0000","last_undegraded":"2023-11-18T19:24:26.843882+0000","last_fullsized":"2023-11-18T19:24:26.843882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":755,"num_object_clones":0,"num_object_copies":1510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'923","reported_seq":946,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.051160+0000","last_change":"2023-11-18T19:06:37.561186+0000","last_active":"2023-11-18T19:24:27.051160+0000","last_peered":"2023-11-18T19:24:27.051160+0000","last_clean":"2023-11-18T19:24:27.051160+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:27.051160+0000","last_undegraded":"2023-11-18T19:24:27.051160+0000","last_fullsized":"2023-11-18T19:24:27.051160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:40:42.252977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":702,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'1015","reported_seq":1039,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.863063+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:24:26.863063+0000","last_peered":"2023-11-18T19:24:26.863063+0000","last_clean":"2023-11-18T19:24:26.863063+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:26.863063+0000","last_undegraded":"2023-11-18T19:24:26.863063+0000","last_fullsized":"2023-11-18T19:24:26.863063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'953","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.719832+0000","last_change":"2023-11-18T19:06:37.558186+0000","last_active":"2023-11-18T19:24:26.719832+0000","last_peered":"2023-11-18T19:24:26.719832+0000","last_clean":"2023-11-18T19:24:26.719832+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:26.719832+0000","last_undegraded":"2023-11-18T19:24:26.719832+0000","last_fullsized":"2023-11-18T19:24:26.719832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:34.965185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":744,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'1003","reported_seq":1027,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.723767+0000","last_change":"2023-11-18T19:06:37.572395+0000","last_active":"2023-11-18T19:24:26.723767+0000","last_peered":"2023-11-18T19:24:26.723767+0000","last_clean":"2023-11-18T19:24:26.723767+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:26.723767+0000","last_undegraded":"2023-11-18T19:24:26.723767+0000","last_fullsized":"2023-11-18T19:24:26.723767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:23:11.748569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'941","reported_seq":965,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.018680+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:24:27.018680+0000","last_peered":"2023-11-18T19:24:27.018680+0000","last_clean":"2023-11-18T19:24:27.018680+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:24:27.018680+0000","last_undegraded":"2023-11-18T19:24:27.018680+0000","last_fullsized":"2023-11-18T19:24:27.018680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:40:13.293231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'918","reported_seq":943,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.853070+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:24:26.853070+0000","last_peered":"2023-11-18T19:24:26.853070+0000","last_clean":"2023-11-18T19:24:26.853070+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:24:26.853070+0000","last_undegraded":"2023-11-18T19:24:26.853070+0000","last_fullsized":"2023-11-18T19:24:26.853070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1532356433,"num_objects":72339,"num_object_clones":0,"num_object_copies":289356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72339,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":196121,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2809622528,"data_stored":3820519424,"data_compressed":666760082,"data_compressed_allocated":793534464,"data_compressed_original":1804431360,"omap_allocated":0,"internal_metadata":0},"log_size":145890,"ondisk_log_size":145890,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":48345,"num_object_clones":0,"num_object_copies":96690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51773,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63119,"ondisk_log_size":63119,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264719270,"num_objects":3100,"num_object_clones":0,"num_object_copies":6200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3100,"num_whiteouts":0,"num_read":864,"num_read_kb":1816,"num_write":23541,"num_write_kb":731806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133697536,"data_stored":508158437,"data_compressed":79538489,"data_compressed_allocated":98336768,"data_compressed_original":472858624,"omap_allocated":0,"internal_metadata":0},"log_size":17245,"ondisk_log_size":17245,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509656,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":644596,"kb_used_data":374636,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93727244,"statfs":{"total":96636764160,"available":95976697856,"internally_reserved":0,"allocated":383627264,"data_stored":581182258,"data_compressed":103018895,"data_compressed_allocated":123727872,"data_compressed_original":321466368,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,3,0,0,0,7,25,20,23,59,28],"upper_bound":8192},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":4.327,"15min":4.8049999999999997},"min":{"1min":0.65100000000000002,"5min":0.45800000000000002,"15min":0.372},"max":{"1min":2.4529999999999998,"5min":248.00800000000001,"15min":248.00800000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.5469999999999999,"5min":4.516,"15min":5.0270000000000001},"min":{"1min":0.72899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.4210000000000003,"5min":175.095,"15min":384.19499999999999},"last":0.49299999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":2.4630000000000001,"15min":4.0839999999999996},"min":{"1min":0.748,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":4.681,"5min":53.398000000000003,"15min":199.179},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.587,"5min":4.5679999999999996,"15min":5.2869999999999999},"min":{"1min":0.72399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":6.4619999999999997,"5min":175.06800000000001,"15min":384.09699999999998},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.952,"15min":3.2559999999999998},"min":{"1min":0.63600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.8279999999999998,"5min":15.159000000000001,"15min":207.149},"last":2.3999999999999999},{"interface":"front","average":{"1min":1.357,"5min":2.4900000000000002,"15min":5.4939999999999998},"min":{"1min":0.71299999999999997,"5min":0.51800000000000002,"15min":0.47299999999999998},"max":{"1min":2.4969999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":4.593,"15min":5.6929999999999996},"min":{"1min":0.73299999999999998,"5min":0.51400000000000001,"15min":0.44600000000000001},"max":{"1min":6.4909999999999997,"5min":175.02600000000001,"15min":384.04700000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":1.472,"5min":2.4580000000000002,"15min":3.4009999999999998},"min":{"1min":0.755,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":2.8700000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":2.359}]},{"osd":4,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":3.1269999999999998,"15min":5.0049999999999999},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":4.9420000000000002,"5min":86.346999999999994,"15min":199.393},"last":4.2300000000000004},{"interface":"front","average":{"1min":2.8420000000000001,"5min":5.4690000000000003,"15min":6.5700000000000003},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":26.733000000000001,"5min":204.786,"15min":384.161},"last":1.3340000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":3.1309999999999998,"15min":4.4429999999999996},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":2.8959999999999999,"5min":79.472999999999999,"15min":220.36500000000001},"last":2.4849999999999999},{"interface":"front","average":{"1min":2.0169999999999999,"5min":4.9050000000000002,"15min":5.5800000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":6.2699999999999996,"5min":160.107,"15min":212.68100000000001},"last":8.7690000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":5.1760000000000002,"15min":8.9359999999999999},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":6.8769999999999998,"5min":205.01400000000001,"15min":410.60000000000002},"last":1.4239999999999999},{"interface":"front","average":{"1min":2.8530000000000002,"5min":2.6150000000000002,"15min":4.0279999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":21.158000000000001,"5min":28.329999999999998,"15min":207.85300000000001},"last":5.3239999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509657,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575316,"kb_used_data":327564,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93796524,"statfs":{"total":96636764160,"available":96047640576,"internally_reserved":0,"allocated":335425536,"data_stored":504874558,"data_compressed":82928644,"data_compressed_allocated":99893248,"data_compressed_original":269541376,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,10,2,17,35,1,35,73],"upper_bound":4096},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.5720000000000001,"15min":4.1859999999999999},"min":{"1min":0.73999999999999999,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":8.1440000000000001,"5min":14.576000000000001,"15min":248.32400000000001},"last":56.268000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.7689999999999999,"15min":2.7909999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.3959999999999999,"5min":26.890000000000001,"15min":93.090999999999994},"last":3.4369999999999998}]},{"osd":1,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":2.113,"15min":5.3600000000000003},"min":{"1min":0.84199999999999997,"5min":0.49199999999999999,"15min":0.47899999999999998},"max":{"1min":7.9390000000000001,"5min":41.881,"15min":335.11799999999999},"last":10.644},{"interface":"front","average":{"1min":2.8999999999999999,"5min":2.0619999999999998,"15min":3.9340000000000002},"min":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.432},"max":{"1min":22.524000000000001,"5min":22.524000000000001,"15min":278.17700000000002},"last":56.345999999999997}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":2.3849999999999998,"15min":3.5470000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":36.954999999999998,"5min":50.735999999999997,"15min":144.68700000000001},"last":26.256},{"interface":"front","average":{"1min":1.893,"5min":2.0230000000000001,"15min":3.7120000000000002},"min":{"1min":0.77200000000000002,"5min":0.56499999999999995,"15min":0.504},"max":{"1min":7.8840000000000003,"5min":24.286999999999999,"15min":247.267},"last":10.755000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.0209999999999999,"5min":1.9750000000000001,"15min":4.819},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":12.032,"5min":30.957999999999998,"15min":207.93799999999999},"last":10.880000000000001},{"interface":"front","average":{"1min":1.887,"5min":2.1139999999999999,"15min":4.5300000000000002},"min":{"1min":0.73099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":7.976,"5min":24.491,"15min":265.82600000000002},"last":10.718999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7,"5min":2.3250000000000002,"15min":4.633},"min":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.42199999999999999},"max":{"1min":8.1039999999999992,"5min":28.951000000000001,"15min":303.19200000000001},"last":55.738999999999997},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.1360000000000001,"15min":4.7229999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":12.207000000000001,"5min":31.018999999999998,"15min":210.78899999999999},"last":4.2960000000000003}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.577,"5min":2.5600000000000001,"15min":6.6859999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":41.378,"5min":41.378,"15min":308.47500000000002},"last":10.686999999999999},{"interface":"front","average":{"1min":2.9550000000000001,"5min":2.226,"15min":4.1150000000000002},"min":{"1min":0.58999999999999997,"5min":0.44400000000000001,"15min":0.34000000000000002},"max":{"1min":22.57,"5min":24.411000000000001,"15min":303.23599999999999},"last":56.228999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2429999999999999,"5min":2.7789999999999999,"15min":5.2800000000000002},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.41199999999999998},"max":{"1min":11.987,"5min":63.313000000000002,"15min":252.18299999999999},"last":13.352},{"interface":"front","average":{"1min":2.0499999999999998,"5min":1.9259999999999999,"15min":4.8479999999999999},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.437},"max":{"1min":8.0169999999999995,"5min":14.84,"15min":309.029},"last":19.734999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509657,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":570716,"kb_used_data":322964,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93801124,"statfs":{"total":96636764160,"available":96052350976,"internally_reserved":0,"allocated":330715136,"data_stored":510298226,"data_compressed":94016584,"data_compressed_allocated":113283072,"data_compressed_original":293064704,"omap_allocated":1592,"internal_metadata":253688264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.6660000000000004,"5min":3.8220000000000001,"15min":2.5840000000000001},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":51.582999999999998,"5min":51.582999999999998,"15min":58.200000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":5.0609999999999999,"5min":2.6120000000000001,"15min":2.3540000000000001},"min":{"1min":0.52900000000000003,"5min":0.40999999999999998,"15min":0.35999999999999999},"max":{"1min":56.402999999999999,"5min":56.402999999999999,"15min":56.402999999999999},"last":0.85899999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":2.3559999999999999,"15min":2.1949999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":11.771000000000001,"5min":36.024999999999999,"15min":36.024999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":7.2030000000000003,"5min":3.851,"15min":2.7309999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":51.542999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":0.81899999999999995}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":5.6900000000000004,"5min":3.0270000000000001,"15min":2.6070000000000002},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":56.494,"5min":56.494,"15min":56.494},"last":0.46600000000000003},{"interface":"front","average":{"1min":3.4809999999999999,"5min":2.8319999999999999,"15min":2.605},"min":{"1min":0.622,"5min":0.622,"15min":0.42799999999999999},"max":{"1min":18.276,"5min":36.057000000000002,"15min":36.057000000000002},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":6.9779999999999998,"5min":3.8759999999999999,"15min":2.9460000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":51.643000000000001,"5min":51.643000000000001,"15min":58.039999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":5.2889999999999997,"5min":2.8999999999999999,"15min":2.7719999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46500000000000002},"max":{"1min":56.530999999999999,"5min":56.530999999999999,"15min":56.530999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.0039999999999996,"5min":4.5250000000000004,"15min":3.7200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.33200000000000002},"max":{"1min":68.007000000000005,"5min":68.007000000000005,"15min":68.007000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":10.465999999999999,"5min":4.702,"15min":3.8290000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38600000000000001},"max":{"1min":72.611000000000004,"5min":72.611000000000004,"15min":72.611000000000004},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.811,"5min":4.2919999999999998,"15min":3.911},"min":{"1min":0.52700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":72.915999999999997,"5min":72.915999999999997,"15min":161.898},"last":0.39300000000000002},{"interface":"front","average":{"1min":14.786,"5min":6.0739999999999998,"15min":4.7030000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":105.387,"5min":105.387,"15min":163.33600000000001},"last":0.45100000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.2610000000000001,"5min":4.6710000000000003,"15min":4.1390000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":51.615000000000002,"5min":66.341999999999999,"15min":66.341999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":6.8499999999999996,"5min":4.1790000000000003,"15min":4.101},"min":{"1min":0.65800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":56.454000000000001,"5min":58.427999999999997,"15min":66.665000000000006},"last":0.629}]}]},{"osd":3,"up_from":15,"seq":64424509658,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":727704,"kb_used_data":425872,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":93644136,"statfs":{"total":96636764160,"available":95891595264,"internally_reserved":0,"allocated":436092928,"data_stored":654931320,"data_compressed":113651503,"data_compressed_allocated":135081984,"data_compressed_original":354107392,"omap_allocated":1593,"internal_metadata":309066183},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,3,8,10,35,131],"upper_bound":1024},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.538,"15min":1.1679999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6919999999999999,"5min":44.363,"15min":44.363},"last":2.5219999999999998},{"interface":"front","average":{"1min":2.3540000000000001,"5min":1.992,"15min":1.956},"min":{"1min":0.44500000000000001,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":27.032,"5min":58.844999999999999,"15min":62.512999999999998},"last":11.276}]},{"osd":1,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.861,"15min":3.1539999999999999},"min":{"1min":0.626,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":11.923,"5min":33.281999999999996,"15min":202.65000000000001},"last":11.541},{"interface":"front","average":{"1min":1.996,"5min":2.2909999999999999,"15min":2.5369999999999999},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":16.783999999999999,"5min":84.191999999999993,"15min":114.221},"last":22.388999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.8799999999999999,"5min":1.712,"15min":1.5669999999999999},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":15.013,"5min":27.433,"15min":43.747999999999998},"last":28.433},{"interface":"front","average":{"1min":1.4279999999999999,"5min":2.524,"15min":2.3660000000000001},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":1.98,"5min":50.006,"15min":50.006},"last":11.395}]},{"osd":4,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":3,"15min":4.2930000000000001},"min":{"1min":0.91900000000000004,"5min":0.66400000000000003,"15min":0.42499999999999999},"max":{"1min":12.43,"5min":51.384,"15min":202.821},"last":11.693},{"interface":"front","average":{"1min":2.3180000000000001,"5min":2.5089999999999999,"15min":3.2570000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":23.635000000000002,"5min":53.720999999999997,"15min":234.68700000000001},"last":8.0380000000000003}]},{"osd":5,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.782,"5min":3.8900000000000001,"15min":4.3440000000000003},"min":{"1min":0.94199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":57.360999999999997,"5min":57.360999999999997,"15min":190.827},"last":11.427},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.9550000000000001,"15min":4.6980000000000004},"min":{"1min":0.97799999999999998,"5min":0.58199999999999996,"15min":0.54700000000000004},"max":{"1min":39.981999999999999,"5min":70.242000000000004,"15min":213.03999999999999},"last":35.301000000000002}]},{"osd":6,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":6.0220000000000002,"5min":3.335,"15min":3.0529999999999999},"min":{"1min":0.93000000000000005,"5min":0.78300000000000003,"15min":0.46800000000000003},"max":{"1min":89.710999999999999,"5min":89.710999999999999,"15min":89.710999999999999},"last":16.312000000000001},{"interface":"front","average":{"1min":1.9610000000000001,"5min":3.2839999999999998,"15min":3.9489999999999998},"min":{"1min":1.093,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":12.269,"5min":50.899000000000001,"15min":202.78299999999999},"last":11.661}]},{"osd":7,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.625,"5min":3.2719999999999998,"15min":4.1950000000000003},"min":{"1min":1.014,"5min":0.745,"15min":0.58299999999999996},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":82.248000000000005},"last":11.346},{"interface":"front","average":{"1min":4.0449999999999999,"5min":4.6319999999999997,"15min":6.069},"min":{"1min":1.087,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":42.883000000000003,"5min":113.44,"15min":233.44800000000001},"last":35.350000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509658,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595508,"kb_used_data":343596,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93776332,"statfs":{"total":96636764160,"available":96026963968,"internally_reserved":0,"allocated":351842304,"data_stored":495408594,"data_compressed":86929094,"data_compressed_allocated":102625280,"data_compressed_original":246382592,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,9,12,10,7,0,105],"upper_bound":1024},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.2029999999999998,"15min":1.9870000000000001},"min":{"1min":0.58999999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":15.622,"5min":83.817999999999998,"15min":83.817999999999998},"last":8.2769999999999992},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.448,"15min":3.4689999999999999},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":16.433,"5min":83.266999999999996,"15min":248.16999999999999},"last":7.5880000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":1.7709999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":15.384,"5min":19.004999999999999,"15min":30.504999999999999},"last":8.2210000000000001},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.157,"15min":3.3540000000000001},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.28100000000000003},"max":{"1min":14.863,"5min":47.768999999999998,"15min":255.315},"last":7.4790000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":4.7300000000000004,"5min":1.98,"15min":1.976},"min":{"1min":0.77300000000000002,"5min":0.40799999999999997,"15min":0.315},"max":{"1min":30.062999999999999,"5min":30.062999999999999,"15min":84.840999999999994},"last":19.701000000000001},{"interface":"front","average":{"1min":2.899,"5min":2.145,"15min":2.7589999999999999},"min":{"1min":0.73699999999999999,"5min":0.54700000000000004,"15min":0.36599999999999999},"max":{"1min":15.587,"5min":27.283000000000001,"15min":128.976},"last":10.113}]},{"osd":4,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":5.9710000000000001,"5min":3.0840000000000001,"15min":4.9109999999999996},"min":{"1min":1.0669999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":37.795000000000002,"5min":47.432000000000002,"15min":255.25700000000001},"last":7.548},{"interface":"front","average":{"1min":3.7160000000000002,"5min":2.4159999999999999,"15min":3.4340000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.48299999999999998},"max":{"1min":15.198,"5min":34.531999999999996,"15min":128.655},"last":19.753}]},{"osd":5,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.7000000000000002,"15min":4.7380000000000004},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.53300000000000003},"max":{"1min":24.016999999999999,"5min":138.905,"15min":153.417},"last":12.138999999999999},{"interface":"front","average":{"1min":7.109,"5min":3.3610000000000002,"15min":5.6150000000000002},"min":{"1min":0.97999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":59.981000000000002,"5min":63.884,"15min":255.34899999999999},"last":7.7619999999999996}]},{"osd":6,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.2330000000000001,"5min":2.5209999999999999,"15min":3.492},"min":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.55400000000000005},"max":{"1min":10.231,"5min":82.388999999999996,"15min":138.33099999999999},"last":48.976999999999997},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.835,"15min":5.0419999999999998},"min":{"1min":0.85099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":15.726000000000001,"5min":127.44799999999999,"15min":187.29599999999999},"last":16.331}]},{"osd":7,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":8.3079999999999998,"5min":4.3659999999999997,"15min":6.3360000000000003},"min":{"1min":1.026,"5min":0.95499999999999996,"15min":0.60899999999999999},"max":{"1min":67.837999999999994,"5min":81.165999999999997,"15min":211.17500000000001},"last":21.617999999999999},{"interface":"front","average":{"1min":8.5269999999999992,"5min":3.2949999999999999,"15min":4.7069999999999999},"min":{"1min":0.92000000000000004,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":72.992999999999995,"5min":72.992999999999995,"15min":173.53999999999999},"last":49.033999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509659,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":709008,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93662832,"statfs":{"total":96636764160,"available":95910739968,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106231679,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,3,8,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.968,"5min":1.617,"15min":1.478},"min":{"1min":0.76500000000000001,"5min":0.30199999999999999,"15min":0.22500000000000001},"max":{"1min":21.655999999999999,"5min":21.655999999999999,"15min":51.420999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":3.3959999999999999,"5min":1.768,"15min":1.722},"min":{"1min":0.59899999999999998,"5min":0.34200000000000003,"15min":0.255},"max":{"1min":22.587,"5min":22.587,"15min":48.802999999999997},"last":1.8129999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.768,"15min":2.544},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.308},"max":{"1min":24.036999999999999,"5min":24.036999999999999,"15min":131.321},"last":2.0430000000000001},{"interface":"front","average":{"1min":4.6660000000000004,"5min":1.962,"15min":1.635},"min":{"1min":0.61499999999999999,"5min":0.40699999999999997,"15min":0.27800000000000002},"max":{"1min":26.029,"5min":26.029,"15min":26.029},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.343,"5min":2.2610000000000001,"15min":2.6800000000000002},"min":{"1min":0.65800000000000003,"5min":0.42799999999999999,"15min":0.26700000000000002},"max":{"1min":43.832999999999998,"5min":43.832999999999998,"15min":197.43899999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":5.843,"5min":2.4249999999999998,"15min":2.5129999999999999},"min":{"1min":0.54600000000000004,"5min":0.39600000000000002,"15min":0.32100000000000001},"max":{"1min":54.316000000000003,"5min":54.316000000000003,"15min":156.316},"last":6.0140000000000002}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.0209999999999999,"5min":2.722,"15min":3.3300000000000001},"min":{"1min":0.83899999999999997,"5min":0.64900000000000002,"15min":0.44800000000000001},"max":{"1min":48.799999999999997,"5min":48.799999999999997,"15min":159.84299999999999},"last":32.771999999999998},{"interface":"front","average":{"1min":5.1520000000000001,"5min":3.214,"15min":3.1389999999999998},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.51700000000000002},"max":{"1min":28.405999999999999,"5min":43.418999999999997,"15min":62.978999999999999},"last":12.879}]},{"osd":5,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":10.071,"5min":3.726,"15min":3.347},"min":{"1min":0.90400000000000003,"5min":0.72999999999999998,"15min":0.50600000000000001},"max":{"1min":107.88500000000001,"5min":107.88500000000001,"15min":107.88500000000001},"last":1.853},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.6800000000000002,"15min":3.1150000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":19.553999999999998,"5min":24.309999999999999,"15min":133.685},"last":2.2200000000000002}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":7.4649999999999999,"5min":3.1819999999999999,"15min":3.5950000000000002},"min":{"1min":1.1140000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":54.220999999999997,"5min":54.220999999999997,"15min":142.84100000000001},"last":3.3180000000000001},{"interface":"front","average":{"1min":3.8700000000000001,"5min":2.278,"15min":3.706},"min":{"1min":1.006,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":23.998999999999999,"5min":23.998999999999999,"15min":146.69900000000001},"last":5.4800000000000004}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.3479999999999999,"5min":3.0499999999999998,"15min":2.7200000000000002},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":31.096,"5min":31.096,"15min":35.783999999999999},"last":1.002},{"interface":"front","average":{"1min":7.819,"5min":3.5209999999999999,"15min":3.359},"min":{"1min":1.351,"5min":0.997,"15min":0.63600000000000001},"max":{"1min":34.281999999999996,"5min":34.281999999999996,"15min":57.134999999999998},"last":1.881}]}]},{"osd":0,"up_from":15,"seq":64424509660,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477772,"kb_used_data":248132,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":93894068,"statfs":{"total":96636764160,"available":96147525632,"internally_reserved":0,"allocated":254087168,"data_stored":412922730,"data_compressed":68731359,"data_compressed_allocated":83857408,"data_compressed_original":242884608,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":3.3330000000000002,"5min":1.859,"15min":1.7569999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.21099999999999999},"max":{"1min":30.565000000000001,"5min":30.565000000000001,"15min":74.326999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":3.9260000000000002,"5min":2.1829999999999998,"15min":1.5900000000000001},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.25700000000000001},"max":{"1min":32.871000000000002,"5min":33.957999999999998,"15min":43.518000000000001},"last":1.026}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":14.217000000000001,"5min":4.2910000000000004,"15min":2.282},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":181.27099999999999,"5min":181.27099999999999,"15min":181.27099999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":4.3620000000000001,"5min":2.4119999999999999,"15min":1.827},"min":{"1min":0.504,"5min":0.436,"15min":0.24099999999999999},"max":{"1min":41.810000000000002,"5min":41.810000000000002,"15min":46.984999999999999},"last":0.98599999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.7089999999999996,"5min":2.3239999999999998,"15min":1.788},"min":{"1min":0.53000000000000003,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":31.562000000000001,"5min":31.562000000000001,"15min":36.642000000000003},"last":0.82099999999999995},{"interface":"front","average":{"1min":12.118,"5min":3.8759999999999999,"15min":2.5350000000000001},"min":{"1min":1.2010000000000001,"5min":0.48599999999999999,"15min":0.28799999999999998},"max":{"1min":94.373000000000005,"5min":94.373000000000005,"15min":94.373000000000005},"last":0.89600000000000002}]},{"osd":4,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.656000000000001,"5min":4.141,"15min":3.3159999999999998},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":135.547,"5min":135.547,"15min":135.547},"last":1.4550000000000001},{"interface":"front","average":{"1min":10.077999999999999,"5min":3.8639999999999999,"15min":3.3370000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":131.07599999999999,"5min":131.07599999999999,"15min":131.07599999999999},"last":1.264}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.5460000000000003,"5min":2.9660000000000002,"15min":2.6829999999999998},"min":{"1min":1.1619999999999999,"5min":0.56699999999999995,"15min":0.38700000000000001},"max":{"1min":41.412999999999997,"5min":63.134999999999998,"15min":63.134999999999998},"last":0.97099999999999997},{"interface":"front","average":{"1min":4.5469999999999997,"5min":3.2389999999999999,"15min":2.7890000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":42.020000000000003,"5min":63.185000000000002,"15min":63.185000000000002},"last":2.1499999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.8239999999999998,"15min":3.5699999999999998},"min":{"1min":0.95899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.548999999999999,"5min":105.974,"15min":203.92699999999999},"last":1.194},{"interface":"front","average":{"1min":4.6369999999999996,"5min":4.0860000000000003,"15min":3.806},"min":{"1min":1.0529999999999999,"5min":0.627,"15min":0.42899999999999999},"max":{"1min":28.646000000000001,"5min":160.84700000000001,"15min":203.56899999999999},"last":1.357}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":9.5519999999999996,"5min":4.3310000000000004,"15min":3.0489999999999999},"min":{"1min":0.996,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":91.418000000000006,"5min":91.418000000000006,"15min":91.418000000000006},"last":1.8260000000000001},{"interface":"front","average":{"1min":5.2549999999999999,"5min":3.8029999999999999,"15min":3.0139999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":31.756,"5min":68.608000000000004,"15min":68.608000000000004},"last":1.474}]}]},{"osd":7,"up_from":13,"seq":55834575065,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":688060,"kb_used_data":418100,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93683780,"statfs":{"total":96636764160,"available":95932190720,"internally_reserved":0,"allocated":428134400,"data_stored":577932943,"data_compressed":95024446,"data_compressed_allocated":111251456,"data_compressed_original":261246976,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.3539999999999992,"5min":5.5549999999999997,"15min":4.4649999999999999},"min":{"1min":0.58199999999999996,"5min":0.501,"15min":0.39300000000000002},"max":{"1min":69.191999999999993,"5min":221.768,"15min":221.768},"last":1.0569999999999999},{"interface":"front","average":{"1min":7.1609999999999996,"5min":4.2290000000000001,"15min":3.3039999999999998},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.40699999999999997},"max":{"1min":63.854999999999997,"5min":93.781000000000006,"15min":93.781000000000006},"last":1.4690000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.5009999999999994,"5min":5.7460000000000004,"15min":4.3810000000000002},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.374},"max":{"1min":69.061999999999998,"5min":221.715,"15min":221.715},"last":1.109},{"interface":"front","average":{"1min":7.3419999999999996,"5min":4.3179999999999996,"15min":3.3969999999999998},"min":{"1min":0.74399999999999999,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":67.930999999999997,"5min":93.825000000000003,"15min":93.825000000000003},"last":1.7350000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.0329999999999999,"15min":4.3170000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47999999999999998},"max":{"1min":21.026,"5min":27.303000000000001,"15min":189.01400000000001},"last":1.446},{"interface":"front","average":{"1min":8.5289999999999999,"5min":5.7249999999999996,"15min":4.5910000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.48799999999999999},"max":{"1min":69.156999999999996,"5min":221.80600000000001,"15min":221.80600000000001},"last":1.129}]},{"osd":3,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":6.9409999999999998,"5min":3.3420000000000001,"15min":4.4829999999999997},"min":{"1min":0.82799999999999996,"5min":0.747,"15min":0.57399999999999995},"max":{"1min":64.206000000000003,"5min":64.206000000000003,"15min":198.696},"last":0.58399999999999996},{"interface":"front","average":{"1min":8.4770000000000003,"5min":5.7590000000000003,"15min":5.3120000000000003},"min":{"1min":0.78400000000000003,"5min":0.66200000000000003,"15min":0.46100000000000002},"max":{"1min":69.585999999999999,"5min":221.846,"15min":221.846},"last":1.02}]},{"osd":4,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":7.4640000000000004,"5min":4.5199999999999996,"15min":5.0640000000000001},"min":{"1min":0.48199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":63.634,"5min":93.890000000000001,"15min":245.36000000000001},"last":1.774},{"interface":"front","average":{"1min":5.5899999999999999,"5min":3.3530000000000002,"15min":4.7130000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.443},"max":{"1min":43.292000000000002,"5min":56.325000000000003,"15min":190.40799999999999},"last":1.488}]},{"osd":5,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.4879999999999995,"5min":6.4530000000000003,"15min":6.3959999999999999},"min":{"1min":0.46400000000000002,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":69.122,"5min":222.85499999999999,"15min":222.85499999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":9.5709999999999997,"5min":5.2539999999999996,"15min":6.181},"min":{"1min":0.63400000000000001,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":83.078000000000003,"5min":93.858000000000004,"15min":215.16900000000001},"last":1.425}]},{"osd":6,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.6600000000000001,"5min":4.9820000000000002,"15min":4.9980000000000002},"min":{"1min":0.80400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":68.109999999999999,"5min":94.079999999999998,"15min":94.079999999999998},"last":1.4990000000000001},{"interface":"front","average":{"1min":8.0809999999999995,"5min":4.0359999999999996,"15min":5.0140000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":63.673000000000002,"5min":63.673000000000002,"15min":188.935},"last":1.514}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080440,"data_compressed":14029799,"data_compressed_allocated":17076224,"data_compressed_original":84856832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16019456,"data_stored":58720326,"data_compressed":9168208,"data_compressed_allocated":11268096,"data_compressed_original":53972992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6418432,"data_stored":25166496,"data_compressed":3903195,"data_compressed_allocated":4784128,"data_compressed_original":23539712,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23810048,"data_stored":92275270,"data_compressed":14480988,"data_compressed_allocated":17752064,"data_compressed_original":86220800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":54527296,"data_compressed":8437806,"data_compressed_allocated":10407936,"data_compressed_original":49823744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22437888,"data_stored":79859933,"data_compressed":12510176,"data_compressed_allocated":15728640,"data_compressed_original":73162752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":79691776,"data_compressed":12654787,"data_compressed_allocated":15716352,"data_compressed_original":74809344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8978432,"data_stored":29836900,"data_compressed":4353530,"data_compressed_allocated":5603328,"data_compressed_original":26472448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344313856,"data_stored":465924096,"data_compressed":82404917,"data_compressed_allocated":97058816,"data_compressed_original":218669056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409116672,"data_stored":549949440,"data_compressed":97141047,"data_compressed_allocated":114851840,"data_compressed_original":255684608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":314249216,"data_stored":451452928,"data_compressed":84811640,"data_compressed_allocated":101961728,"data_compressed_original":239165440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":312856576,"data_stored":424542208,"data_compressed":70385955,"data_compressed_allocated":84119552,"data_compressed_original":195805184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":361660416,"data_stored":497172480,"data_compressed":89601823,"data_compressed_allocated":107122688,"data_compressed_original":242634752,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":419241984,"data_stored":548409344,"data_compressed":90682182,"data_compressed_allocated":105664512,"data_compressed_original":234831872,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:24:33.559 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.559 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.560 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.560 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.560 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.560 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.560 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.561 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.561 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.561 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.561 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.561 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.561 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.562 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.562 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.562 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.562 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.562 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.563 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.563 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.563 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.563 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.563 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.563 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.563 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.564 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.564 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.564 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.564 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.564 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.565 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.565 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.565 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.565 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.565 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.565 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.566 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.566 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.566 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.566 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.566 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.566 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.567 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.567 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.567 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.567 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.567 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.568 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-18T19:06:31.454786+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=31, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.568 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.568 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.568 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.568 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.568 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.569 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.569 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.569 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.569 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.569 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.569 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.570 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.570 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.570 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.570 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.570 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.570 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.571 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.571 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.571 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.571 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.571 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.572 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.572 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.572 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.572 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.572 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.572 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.573 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.573 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.573 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.573 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.573 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.573 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.574 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.574 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.574 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.574 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.574 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.575 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.575 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.575 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.575 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.575 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.575 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.576 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.576 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.576 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.576 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.576 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.576 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.577 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.577 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.577 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.577 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.577 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.577 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.578 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.578 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.578 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.578 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.578 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.579 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.579 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.579 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.579 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.579 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.579 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.580 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.580 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.580 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.580 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.580 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.580 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.581 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.581 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.581 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.581 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.581 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.581 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:33.582 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T19:24:53.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:24:53.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:24:53.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:24:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.865+0000 7fe1beee5640 1 Processor -- start 2023-11-18T19:24:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.865+0000 7fe1beee5640 1 -- start start 2023-11-18T19:24:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.867+0000 7fe1beee5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1b80c4500 0x7fe1b8159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.867+0000 7fe1beee5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b80c4960 con 0x7fe1b80aa7d0 2023-11-18T19:24:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.867+0000 7fe1beee5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b80c3a60 con 0x7fe1b81560e0 2023-11-18T19:24:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.867+0000 7fe1beee5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b80a9950 con 0x7fe1b80c4500 2023-11-18T19:24:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.868+0000 7fe1b7fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1b80c4500 0x7fe1b8159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.868+0000 7fe1bcc81640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe1b81560e0 0x7fe1b8159390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.45:33086/0 (socket says 172.21.15.45:33086) 2023-11-18T19:24:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.868+0000 7fe1bcc81640 1 -- 172.21.15.45:0/2203145298 learned_addr learned my addr 172.21.15.45:0/2203145298 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:24:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.868+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2203145298 >> v1:172.21.15.135:6789/0 conn(0x7fe1b81560e0 legacy=0x7fe1b8159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.868+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2203145298 >> v1:172.21.15.45:6789/0 conn(0x7fe1b80aa7d0 legacy=0x7fe1b8163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.868+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2203145298 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b80a8ee0 con 0x7fe1b80c4500 2023-11-18T19:24:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.870+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/2203145298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b8159e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40097a0 tx=0x7fe1a402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74482f968d64163 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.870+0000 7fe1b77fe640 1 -- 172.21.15.45:0/2203145298 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4031830 con 0x7fe1b80c4500 2023-11-18T19:24:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.871+0000 7fe1b77fe640 1 -- 172.21.15.45:0/2203145298 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4031990 con 0x7fe1b80c4500 2023-11-18T19:24:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.871+0000 7fe1b77fe640 1 -- 172.21.15.45:0/2203145298 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4031d20 con 0x7fe1b80c4500 2023-11-18T19:24:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.872+0000 7fe1beee5640 1 -- 172.21.15.45:0/2203145298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 msgr2=0x7fe1b8159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.872+0000 7fe1beee5640 1 --2- 172.21.15.45:0/2203145298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b8159e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40097a0 tx=0x7fe1a402b8d0 comp rx=0 tx=0).stop 2023-11-18T19:24:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.872+0000 7fe1beee5640 1 -- 172.21.15.45:0/2203145298 shutdown_connections 2023-11-18T19:24:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.872+0000 7fe1beee5640 1 --2- 172.21.15.45:0/2203145298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b8159e00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.872+0000 7fe1beee5640 1 -- 172.21.15.45:0/2203145298 >> 172.21.15.45:0/2203145298 conn(0x7fe1b806a500 msgr2=0x7fe1b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.872+0000 7fe1beee5640 1 -- 172.21.15.45:0/2203145298 shutdown_connections 2023-11-18T19:24:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.872+0000 7fe1beee5640 1 -- 172.21.15.45:0/2203145298 wait complete. 2023-11-18T19:24:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.875+0000 7fe1beee5640 1 Processor -- start 2023-11-18T19:24:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.875+0000 7fe1beee5640 1 -- start start 2023-11-18T19:24:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.878+0000 7fe1beee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b80aa7d0 0x7fe1b81effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.878+0000 7fe1beee5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b81ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.878+0000 7fe1beee5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1b81560e0 0x7fe1b80c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.879+0000 7fe1beee5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81efb30 con 0x7fe1b80aa7d0 2023-11-18T19:24:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.879+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b81ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.879+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b81ef5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:57542/0 (socket says 172.21.15.45:57542) 2023-11-18T19:24:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.879+0000 7fe1b7fff640 1 -- 172.21.15.45:0/342068348 learned_addr learned my addr 172.21.15.45:0/342068348 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:24:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.879+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b806dbe0 con 0x7fe1b80c4500 2023-11-18T19:24:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.879+0000 7fe1bcc81640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b80aa7d0 0x7fe1b81effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.879+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b806d620 con 0x7fe1b81560e0 2023-11-18T19:24:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.880+0000 7fe1b7fff640 1 -- 172.21.15.45:0/342068348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1b81560e0 msgr2=0x7fe1b80c11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.880+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1b81560e0 0x7fe1b80c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.880+0000 7fe1b7fff640 1 -- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b80aa7d0 msgr2=0x7fe1b81effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.881+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b80aa7d0 0x7fe1b81effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.881+0000 7fe1b7fff640 1 -- 172.21.15.45:0/342068348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009400 con 0x7fe1b80c4500 2023-11-18T19:24:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.881+0000 7fe1bcc81640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b80aa7d0 0x7fe1b81effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:24:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.882+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b81ef5f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1a402bee0 tx=0x7fe1a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.883+0000 7fe1b57fa640 1 -- 172.21.15.45:0/342068348 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a403bbf0 con 0x7fe1b80c4500 2023-11-18T19:24:53.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.883+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b806d900 con 0x7fe1b80c4500 2023-11-18T19:24:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.884+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b80c0c90 con 0x7fe1b80c4500 2023-11-18T19:24:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.884+0000 7fe1b57fa640 1 -- 172.21.15.45:0/342068348 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a403bd70 con 0x7fe1b80c4500 2023-11-18T19:24:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.884+0000 7fe1b57fa640 1 -- 172.21.15.45:0/342068348 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4045630 con 0x7fe1b80c4500 2023-11-18T19:24:53.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.888+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe198005250 con 0x7fe1b80c4500 2023-11-18T19:24:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.891+0000 7fe1b57fa640 1 -- 172.21.15.45:0/342068348 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1a404e450 con 0x7fe1b80c4500 2023-11-18T19:24:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.892+0000 7fe1b57fa640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe19c06ae40 0x7fe19c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:24:53.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.893+0000 7fe1b57fa640 1 -- 172.21.15.45:0/342068348 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fe1a40abb40 con 0x7fe1b80c4500 2023-11-18T19:24:53.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.894+0000 7fe1bcc81640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe19c06ae40 0x7fe19c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:24:53.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.896+0000 7fe1bcc81640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe19c06ae40 0x7fe19c06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac005880 tx=0x7fe1ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:24:53.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:53.904+0000 7fe1b57fa640 1 -- 172.21.15.45:0/342068348 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1a40769b0 con 0x7fe1b80c4500 2023-11-18T19:24:54.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.274+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe198000bc0 con 0x7fe19c06ae40 2023-11-18T19:24:54.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.295+0000 7fe1b57fa640 1 -- 172.21.15.45:0/342068348 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371860 (secure 0 0 0) 0x7fe198000bc0 con 0x7fe19c06ae40 2023-11-18T19:24:54.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:24:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:24:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.302+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe19c06ae40 msgr2=0x7fe19c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.302+0000 7fe1beee5640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe19c06ae40 0x7fe19c06d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac005880 tx=0x7fe1ac009040 comp rx=0 tx=0).stop 2023-11-18T19:24:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.302+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 msgr2=0x7fe1b81ef5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:24:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.302+0000 7fe1beee5640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b81ef5f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1a402bee0 tx=0x7fe1a40046c0 comp rx=0 tx=0).stop 2023-11-18T19:24:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.303+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 shutdown_connections 2023-11-18T19:24:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.303+0000 7fe1beee5640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fe19c06ae40 0x7fe19c06d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.303+0000 7fe1beee5640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1b81560e0 0x7fe1b80c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.303+0000 7fe1beee5640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b80c4500 0x7fe1b81ef5f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.303+0000 7fe1beee5640 1 --2- 172.21.15.45:0/342068348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b80aa7d0 0x7fe1b81effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:24:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.303+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 >> 172.21.15.45:0/342068348 conn(0x7fe1b806a500 msgr2=0x7fe1b8156780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:24:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.303+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 shutdown_connections 2023-11-18T19:24:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:24:54.305+0000 7fe1beee5640 1 -- 172.21.15.45:0/342068348 wait complete. 2023-11-18T19:24:54.341 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":575,"stamp":"2023-11-18T19:24:53.596663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1785258415,"num_objects":123806,"num_object_clones":0,"num_object_copies":392290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123806,"num_whiteouts":0,"num_read":995,"num_read_kb":1916,"num_write":271740,"num_write_kb":2424419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19167066,"num_omap_keys":33107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250332,"ondisk_log_size":250332,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5027924,"kb_used_data":2876692,"kb_used_omap":12,"kb_used_meta":2151155,"kb_avail":749946796,"statfs":{"total":773094113280,"available":767945519104,"internally_reserved":0,"allocated":2945732608,"data_stored":4327312972,"data_compressed":745766872,"data_compressed_allocated":891199488,"data_compressed_original":2274316288,"omap_allocated":12748,"internal_metadata":2202783284},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25688,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12885648,"num_omap_keys":22245,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004632"},"pg_stats":[{"pgid":"2.1f","version":"29'488","reported_seq":526,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.102863+0000","last_change":"2023-11-18T19:24:42.102998+0000","last_active":"2023-11-18T19:24:42.102863+0000","last_peered":"2023-11-18T19:24:42.102863+0000","last_clean":"2023-11-18T19:24:42.102863+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:42.102863+0000","last_undegraded":"2023-11-18T19:24:42.102863+0000","last_fullsized":"2023-11-18T19:24:42.102863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'488","last_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_deep_scrub":"29'488","last_deep_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.102683+0000","objects_scrubbed":92,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:36:53.767588+0000","scrub_duration":0.165977034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":592,"num_write_kb":13689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1058229,"num_omap_keys":1832,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'952","reported_seq":978,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.319260+0000","last_change":"2023-11-18T19:06:37.570993+0000","last_active":"2023-11-18T19:24:31.319260+0000","last_peered":"2023-11-18T19:24:31.319260+0000","last_clean":"2023-11-18T19:24:31.319260+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:24:31.319260+0000","last_undegraded":"2023-11-18T19:24:31.319260+0000","last_fullsized":"2023-11-18T19:24:31.319260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":731,"num_object_clones":0,"num_object_copies":1462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4515","reported_seq":4539,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.200183+0000","last_change":"2023-11-18T19:06:41.624319+0000","last_active":"2023-11-18T19:24:27.200183+0000","last_peered":"2023-11-18T19:24:27.200183+0000","last_clean":"2023-11-18T19:24:27.200183+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:27.200183+0000","last_undegraded":"2023-11-18T19:24:27.200183+0000","last_fullsized":"2023-11-18T19:24:27.200183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4515,"log_dups_size":0,"ondisk_log_size":4515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47448745,"num_objects":2214,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6085,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'399","reported_seq":437,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.562573+0000","last_change":"2023-11-18T19:24:49.562619+0000","last_active":"2023-11-18T19:24:49.562573+0000","last_peered":"2023-11-18T19:24:49.562573+0000","last_clean":"2023-11-18T19:24:49.562573+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:49.562573+0000","last_undegraded":"2023-11-18T19:24:49.562573+0000","last_fullsized":"2023-11-18T19:24:49.562573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'399","last_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_deep_scrub":"29'399","last_deep_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.562510+0000","objects_scrubbed":82,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:37.188456+0000","scrub_duration":0.114711435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":487,"num_write_kb":31117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":81,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207150,"num_omap_keys":3796,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'952","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.017301+0000","last_change":"2023-11-18T19:06:37.578825+0000","last_active":"2023-11-18T19:24:27.017301+0000","last_peered":"2023-11-18T19:24:27.017301+0000","last_clean":"2023-11-18T19:24:27.017301+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:24:27.017301+0000","last_undegraded":"2023-11-18T19:24:27.017301+0000","last_fullsized":"2023-11-18T19:24:27.017301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4583","reported_seq":4706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.235913+0000","last_change":"2023-11-18T19:24:51.235992+0000","last_active":"2023-11-18T19:24:51.235913+0000","last_peered":"2023-11-18T19:24:51.235913+0000","last_clean":"2023-11-18T19:24:51.235913+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:51.235913+0000","last_undegraded":"2023-11-18T19:24:51.235913+0000","last_fullsized":"2023-11-18T19:24:51.235913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4583","last_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_deep_scrub":"29'4583","last_deep_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.235758+0000","objects_scrubbed":2273,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:46.767646+0000","scrub_duration":1.556089611,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45442855,"num_objects":2273,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6171,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'601","reported_seq":637,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.673982+0000","last_change":"2023-11-18T19:24:42.674060+0000","last_active":"2023-11-18T19:24:42.673982+0000","last_peered":"2023-11-18T19:24:42.673982+0000","last_clean":"2023-11-18T19:24:42.673982+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:42.673982+0000","last_undegraded":"2023-11-18T19:24:42.673982+0000","last_fullsized":"2023-11-18T19:24:42.673982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'601","last_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_deep_scrub":"29'601","last_deep_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.673881+0000","objects_scrubbed":99,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:23.664922+0000","scrub_duration":0.096252519999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":701,"num_write_kb":33858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":98,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":793362,"num_omap_keys":1372,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'1765","reported_seq":1829,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.986185+0000","last_change":"2023-11-18T19:24:48.986210+0000","last_active":"2023-11-18T19:24:48.986185+0000","last_peered":"2023-11-18T19:24:48.986185+0000","last_clean":"2023-11-18T19:24:48.986185+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:48.986185+0000","last_undegraded":"2023-11-18T19:24:48.986185+0000","last_fullsized":"2023-11-18T19:24:48.986185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.986121+0000","objects_scrubbed":804,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:29.451254+0000","scrub_duration":0.73796645500000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":804,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4623","reported_seq":4646,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.046640+0000","last_change":"2023-11-18T19:06:41.604061+0000","last_active":"2023-11-18T19:24:27.046640+0000","last_peered":"2023-11-18T19:24:27.046640+0000","last_clean":"2023-11-18T19:24:27.046640+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:24:27.046640+0000","last_undegraded":"2023-11-18T19:24:27.046640+0000","last_fullsized":"2023-11-18T19:24:27.046640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48597389,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6213,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'348","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.660392+0000","last_change":"2023-11-18T19:24:49.660459+0000","last_active":"2023-11-18T19:24:49.660392+0000","last_peered":"2023-11-18T19:24:49.660392+0000","last_clean":"2023-11-18T19:24:49.660392+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:49.660392+0000","last_undegraded":"2023-11-18T19:24:49.660392+0000","last_fullsized":"2023-11-18T19:24:49.660392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'348","last_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_deep_scrub":"29'348","last_deep_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.660293+0000","objects_scrubbed":92,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:50.955578+0000","scrub_duration":0.126544825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":442,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750456,"num_omap_keys":1290,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'1000","reported_seq":1025,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.088812+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:24:27.088812+0000","last_peered":"2023-11-18T19:24:27.088812+0000","last_clean":"2023-11-18T19:24:27.088812+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:24:27.088812+0000","last_undegraded":"2023-11-18T19:24:27.088812+0000","last_fullsized":"2023-11-18T19:24:27.088812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":821,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4456","reported_seq":4480,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.060706+0000","last_change":"2023-11-18T19:06:41.616454+0000","last_active":"2023-11-18T19:24:27.060706+0000","last_peered":"2023-11-18T19:24:27.060706+0000","last_clean":"2023-11-18T19:24:27.060706+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:27.060706+0000","last_undegraded":"2023-11-18T19:24:27.060706+0000","last_fullsized":"2023-11-18T19:24:27.060706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4456,"log_dups_size":0,"ondisk_log_size":4456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44553589,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5936,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.744018+0000","last_change":"2023-11-18T19:24:39.744091+0000","last_active":"2023-11-18T19:24:39.744018+0000","last_peered":"2023-11-18T19:24:39.744018+0000","last_clean":"2023-11-18T19:24:39.744018+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:39.744018+0000","last_undegraded":"2023-11-18T19:24:39.744018+0000","last_fullsized":"2023-11-18T19:24:39.744018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.743952+0000","objects_scrubbed":742,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:27.369898+0000","scrub_duration":0.70226359599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'416","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.871916+0000","last_change":"2023-11-18T19:06:37.049304+0000","last_active":"2023-11-18T19:24:29.871916+0000","last_peered":"2023-11-18T19:24:29.871916+0000","last_clean":"2023-11-18T19:24:29.871916+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:24:29.871916+0000","last_undegraded":"2023-11-18T19:24:29.871916+0000","last_fullsized":"2023-11-18T19:24:29.871916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":29849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4620","reported_seq":4744,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.884423+0000","last_change":"2023-11-18T19:24:48.884469+0000","last_active":"2023-11-18T19:24:48.884423+0000","last_peered":"2023-11-18T19:24:48.884423+0000","last_clean":"2023-11-18T19:24:48.884423+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:48.884423+0000","last_undegraded":"2023-11-18T19:24:48.884423+0000","last_fullsized":"2023-11-18T19:24:48.884423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4620","last_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_deep_scrub":"29'4620","last_deep_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.884337+0000","objects_scrubbed":2305,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:31.229044+0000","scrub_duration":1.771489595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50701125,"num_objects":2305,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6229,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'1748","reported_seq":1812,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.444406+0000","last_change":"2023-11-18T19:24:49.444480+0000","last_active":"2023-11-18T19:24:49.444406+0000","last_peered":"2023-11-18T19:24:49.444406+0000","last_clean":"2023-11-18T19:24:49.444406+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:49.444406+0000","last_undegraded":"2023-11-18T19:24:49.444406+0000","last_fullsized":"2023-11-18T19:24:49.444406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.444303+0000","objects_scrubbed":785,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:21.815747+0000","scrub_duration":0.686602881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":785,"num_object_clones":0,"num_object_copies":1570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'524","reported_seq":562,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.697932+0000","last_change":"2023-11-18T19:24:37.698022+0000","last_active":"2023-11-18T19:24:37.697932+0000","last_peered":"2023-11-18T19:24:37.697932+0000","last_clean":"2023-11-18T19:24:37.697932+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:37.697932+0000","last_undegraded":"2023-11-18T19:24:37.697932+0000","last_fullsized":"2023-11-18T19:24:37.697932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'524","last_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_deep_scrub":"29'524","last_deep_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.697763+0000","objects_scrubbed":95,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:12.850295+0000","scrub_duration":0.185472308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":30122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1242455,"num_omap_keys":2145,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4571","reported_seq":4595,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.556036+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:24:27.556036+0000","last_peered":"2023-11-18T19:24:27.556036+0000","last_clean":"2023-11-18T19:24:27.556036+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:24:27.556036+0000","last_undegraded":"2023-11-18T19:24:27.556036+0000","last_fullsized":"2023-11-18T19:24:27.556036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4571,"log_dups_size":0,"ondisk_log_size":4571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6125,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'1789","reported_seq":1855,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:45.778711+0000","last_change":"2023-11-18T19:24:45.778740+0000","last_active":"2023-11-18T19:24:45.778711+0000","last_peered":"2023-11-18T19:24:45.778711+0000","last_clean":"2023-11-18T19:24:45.778711+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:45.778711+0000","last_undegraded":"2023-11-18T19:24:45.778711+0000","last_fullsized":"2023-11-18T19:24:45.778711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1789","last_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_deep_scrub":"29'1789","last_deep_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_clean_scrub_stamp":"2023-11-18T19:24:45.778650+0000","objects_scrubbed":808,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:47.073935+0000","scrub_duration":0.792586715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":808,"num_object_clones":0,"num_object_copies":1616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'542","reported_seq":581,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.181657+0000","last_change":"2023-11-18T19:24:34.181862+0000","last_active":"2023-11-18T19:24:34.181657+0000","last_peered":"2023-11-18T19:24:34.181657+0000","last_clean":"2023-11-18T19:24:34.181657+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:24:34.181657+0000","last_undegraded":"2023-11-18T19:24:34.181657+0000","last_fullsized":"2023-11-18T19:24:34.181657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'542","last_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_deep_scrub":"29'542","last_deep_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.181507+0000","objects_scrubbed":113,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.334039+0000","scrub_duration":0.31913006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":17586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":869889,"num_omap_keys":1501,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4609","reported_seq":4633,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:32.878191+0000","last_change":"2023-11-18T19:06:41.622011+0000","last_active":"2023-11-18T19:24:32.878191+0000","last_peered":"2023-11-18T19:24:32.878191+0000","last_clean":"2023-11-18T19:24:32.878191+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:24:32.878191+0000","last_undegraded":"2023-11-18T19:24:32.878191+0000","last_fullsized":"2023-11-18T19:24:32.878191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6233,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'989","reported_seq":1015,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.811758+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:24:26.811758+0000","last_peered":"2023-11-18T19:24:26.811758+0000","last_clean":"2023-11-18T19:24:26.811758+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:24:26.811758+0000","last_undegraded":"2023-11-18T19:24:26.811758+0000","last_fullsized":"2023-11-18T19:24:26.811758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'530","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:44.705515+0000","last_change":"2023-11-18T19:24:44.705608+0000","last_active":"2023-11-18T19:24:44.705515+0000","last_peered":"2023-11-18T19:24:44.705515+0000","last_clean":"2023-11-18T19:24:44.705515+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:44.705515+0000","last_undegraded":"2023-11-18T19:24:44.705515+0000","last_fullsized":"2023-11-18T19:24:44.705515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'530","last_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_deep_scrub":"29'530","last_deep_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:44.705369+0000","objects_scrubbed":70,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:22.256103+0000","scrub_duration":0.14586217300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":13046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522099,"num_omap_keys":901,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4549","reported_seq":4573,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.095463+0000","last_change":"2023-11-18T19:06:41.610150+0000","last_active":"2023-11-18T19:24:29.095463+0000","last_peered":"2023-11-18T19:24:29.095463+0000","last_clean":"2023-11-18T19:24:29.095463+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:24:29.095463+0000","last_undegraded":"2023-11-18T19:24:29.095463+0000","last_fullsized":"2023-11-18T19:24:29.095463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53723490,"num_objects":2311,"num_object_clones":0,"num_object_copies":9244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6133,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'997","reported_seq":1023,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.843576+0000","last_change":"2023-11-18T19:06:37.574189+0000","last_active":"2023-11-18T19:24:26.843576+0000","last_peered":"2023-11-18T19:24:26.843576+0000","last_clean":"2023-11-18T19:24:26.843576+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:26.843576+0000","last_undegraded":"2023-11-18T19:24:26.843576+0000","last_fullsized":"2023-11-18T19:24:26.843576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":783,"num_object_clones":0,"num_object_copies":1566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'294","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.246754+0000","last_change":"2023-11-18T19:06:37.053478+0000","last_active":"2023-11-18T19:24:24.246754+0000","last_peered":"2023-11-18T19:24:24.246754+0000","last_clean":"2023-11-18T19:24:24.246754+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:24:24.246754+0000","last_undegraded":"2023-11-18T19:24:24.246754+0000","last_fullsized":"2023-11-18T19:24:24.246754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":469,"num_write_kb":13215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4569","reported_seq":4614,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:52.062978+0000","last_change":"2023-11-18T19:24:51.757424+0000","last_active":"2023-11-18T19:24:52.062978+0000","last_peered":"2023-11-18T19:24:52.062978+0000","last_clean":"2023-11-18T19:24:52.062978+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:52.062978+0000","last_undegraded":"2023-11-18T19:24:52.062978+0000","last_fullsized":"2023-11-18T19:24:52.062978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":424,"log_size":4569,"log_dups_size":0,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58452634,"num_objects":2264,"num_object_clones":0,"num_object_copies":9056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6141,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'1596","reported_seq":1658,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.486739+0000","last_change":"2023-11-18T19:24:31.486782+0000","last_active":"2023-11-18T19:24:31.486739+0000","last_peered":"2023-11-18T19:24:31.486739+0000","last_clean":"2023-11-18T19:24:31.486739+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:31.486739+0000","last_undegraded":"2023-11-18T19:24:31.486739+0000","last_fullsized":"2023-11-18T19:24:31.486739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1596","last_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_deep_scrub":"29'1596","last_deep_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_clean_scrub_stamp":"2023-11-18T19:24:31.486678+0000","objects_scrubbed":721,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:03.765253+0000","scrub_duration":0.68181534700000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'623","reported_seq":661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.085333+0000","last_change":"2023-11-18T19:24:37.085379+0000","last_active":"2023-11-18T19:24:37.085333+0000","last_peered":"2023-11-18T19:24:37.085333+0000","last_clean":"2023-11-18T19:24:37.085333+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:37.085333+0000","last_undegraded":"2023-11-18T19:24:37.085333+0000","last_fullsized":"2023-11-18T19:24:37.085333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'623","last_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_deep_scrub":"29'623","last_deep_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.085251+0000","objects_scrubbed":96,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:19:26.864983+0000","scrub_duration":0.19450854400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1057,"num_write_kb":20813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1016762,"num_omap_keys":1760,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4574","reported_seq":4599,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:30.595067+0000","last_change":"2023-11-18T19:06:41.604560+0000","last_active":"2023-11-18T19:24:30.595067+0000","last_peered":"2023-11-18T19:24:30.595067+0000","last_clean":"2023-11-18T19:24:30.595067+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:24:30.595067+0000","last_undegraded":"2023-11-18T19:24:30.595067+0000","last_fullsized":"2023-11-18T19:24:30.595067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4574,"log_dups_size":0,"ondisk_log_size":4574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41932084,"num_objects":2267,"num_object_clones":0,"num_object_copies":9068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6154,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'1715","reported_seq":1780,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.117665+0000","last_change":"2023-11-18T19:24:50.117707+0000","last_active":"2023-11-18T19:24:50.117665+0000","last_peered":"2023-11-18T19:24:50.117665+0000","last_clean":"2023-11-18T19:24:50.117665+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:50.117665+0000","last_undegraded":"2023-11-18T19:24:50.117665+0000","last_fullsized":"2023-11-18T19:24:50.117665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1715","last_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_deep_scrub":"29'1715","last_deep_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.117602+0000","objects_scrubbed":789,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:54:42.963090+0000","scrub_duration":0.69843094500000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'306","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.637346+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:24:24.637346+0000","last_peered":"2023-11-18T19:24:24.637346+0000","last_clean":"2023-11-18T19:24:24.637346+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:24:24.637346+0000","last_undegraded":"2023-11-18T19:24:24.637346+0000","last_fullsized":"2023-11-18T19:24:24.637346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":21633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4621","reported_seq":4645,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.857096+0000","last_change":"2023-11-18T19:06:41.611426+0000","last_active":"2023-11-18T19:24:26.857096+0000","last_peered":"2023-11-18T19:24:26.857096+0000","last_clean":"2023-11-18T19:24:26.857096+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:24:26.857096+0000","last_undegraded":"2023-11-18T19:24:26.857096+0000","last_fullsized":"2023-11-18T19:24:26.857096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41011562,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6203,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'1615","reported_seq":1677,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.715592+0000","last_change":"2023-11-18T19:24:38.715645+0000","last_active":"2023-11-18T19:24:38.715592+0000","last_peered":"2023-11-18T19:24:38.715592+0000","last_clean":"2023-11-18T19:24:38.715592+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:38.715592+0000","last_undegraded":"2023-11-18T19:24:38.715592+0000","last_fullsized":"2023-11-18T19:24:38.715592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1615","last_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_deep_scrub":"29'1615","last_deep_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.715496+0000","objects_scrubbed":730,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:13.868028+0000","scrub_duration":1.1252372610000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'546","reported_seq":583,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.630385+0000","last_change":"2023-11-18T19:24:46.630412+0000","last_active":"2023-11-18T19:24:46.630385+0000","last_peered":"2023-11-18T19:24:46.630385+0000","last_clean":"2023-11-18T19:24:46.630385+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:46.630385+0000","last_undegraded":"2023-11-18T19:24:46.630385+0000","last_fullsized":"2023-11-18T19:24:46.630385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'546","last_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_deep_scrub":"29'546","last_deep_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.630325+0000","objects_scrubbed":81,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:42.162213+0000","scrub_duration":0.13360024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":17360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":748148,"num_omap_keys":1294,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4547","reported_seq":4571,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.959914+0000","last_change":"2023-11-18T19:06:41.619059+0000","last_active":"2023-11-18T19:24:26.959914+0000","last_peered":"2023-11-18T19:24:26.959914+0000","last_clean":"2023-11-18T19:24:26.959914+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:24:26.959914+0000","last_undegraded":"2023-11-18T19:24:26.959914+0000","last_fullsized":"2023-11-18T19:24:26.959914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47540604,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'987","reported_seq":1012,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.848428+0000","last_change":"2023-11-18T19:06:37.574396+0000","last_active":"2023-11-18T19:24:26.848428+0000","last_peered":"2023-11-18T19:24:26.848428+0000","last_clean":"2023-11-18T19:24:26.848428+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:26.848428+0000","last_undegraded":"2023-11-18T19:24:26.848428+0000","last_fullsized":"2023-11-18T19:24:26.848428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1183","reported_seq":1210,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.064343+0000","last_change":"2023-11-18T19:06:37.047015+0000","last_active":"2023-11-18T19:24:27.064343+0000","last_peered":"2023-11-18T19:24:27.064343+0000","last_clean":"2023-11-18T19:24:27.064343+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:24:27.064343+0000","last_undegraded":"2023-11-18T19:24:27.064343+0000","last_fullsized":"2023-11-18T19:24:27.064343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":1183,"log_dups_size":0,"ondisk_log_size":1183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4578","reported_seq":4605,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.026682+0000","last_change":"2023-11-18T19:06:41.616980+0000","last_active":"2023-11-18T19:24:27.026682+0000","last_peered":"2023-11-18T19:24:27.026682+0000","last_clean":"2023-11-18T19:24:27.026682+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:24:27.026682+0000","last_undegraded":"2023-11-18T19:24:27.026682+0000","last_fullsized":"2023-11-18T19:24:27.026682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39429542,"num_objects":2302,"num_object_clones":0,"num_object_copies":9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6195,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'988","reported_seq":1014,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.318571+0000","last_change":"2023-11-18T19:06:37.579527+0000","last_active":"2023-11-18T19:24:31.318571+0000","last_peered":"2023-11-18T19:24:31.318571+0000","last_clean":"2023-11-18T19:24:31.318571+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:31.318571+0000","last_undegraded":"2023-11-18T19:24:31.318571+0000","last_fullsized":"2023-11-18T19:24:31.318571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":778,"num_object_clones":0,"num_object_copies":1556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1989","reported_seq":2863,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.432984+0000","last_change":"2023-11-18T19:24:37.978888+0000","last_active":"2023-11-18T19:24:46.432984+0000","last_peered":"2023-11-18T19:24:46.432984+0000","last_clean":"2023-11-18T19:24:46.432984+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:46.432984+0000","last_undegraded":"2023-11-18T19:24:46.432984+0000","last_fullsized":"2023-11-18T19:24:46.432984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1980","last_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_deep_scrub":"29'1980","last_deep_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.978780+0000","objects_scrubbed":103,"log_size":1989,"log_dups_size":0,"ondisk_log_size":1989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:11:09.998369+0000","scrub_duration":0.181000729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13234816,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":836,"num_read_kb":1816,"num_write":2091,"num_write_kb":27218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":813940,"num_omap_keys":1408,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4483","reported_seq":4508,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.855345+0000","last_change":"2023-11-18T19:06:41.606335+0000","last_active":"2023-11-18T19:24:26.855345+0000","last_peered":"2023-11-18T19:24:26.855345+0000","last_clean":"2023-11-18T19:24:26.855345+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:24:26.855345+0000","last_undegraded":"2023-11-18T19:24:26.855345+0000","last_fullsized":"2023-11-18T19:24:26.855345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52629501,"num_objects":2217,"num_object_clones":0,"num_object_copies":8868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5979,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'928","reported_seq":954,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.695133+0000","last_change":"2023-11-18T19:06:37.555105+0000","last_active":"2023-11-18T19:24:26.695133+0000","last_peered":"2023-11-18T19:24:26.695133+0000","last_clean":"2023-11-18T19:24:26.695133+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:26.695133+0000","last_undegraded":"2023-11-18T19:24:26.695133+0000","last_fullsized":"2023-11-18T19:24:26.695133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'483","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.871801+0000","last_change":"2023-11-18T19:06:37.057025+0000","last_active":"2023-11-18T19:24:29.871801+0000","last_peered":"2023-11-18T19:24:29.871801+0000","last_clean":"2023-11-18T19:24:29.871801+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:24:29.871801+0000","last_undegraded":"2023-11-18T19:24:29.871801+0000","last_fullsized":"2023-11-18T19:24:29.871801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":29679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4675","reported_seq":4699,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.015976+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:24:27.015976+0000","last_peered":"2023-11-18T19:24:27.015976+0000","last_clean":"2023-11-18T19:24:27.015976+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:24:27.015976+0000","last_undegraded":"2023-11-18T19:24:27.015976+0000","last_fullsized":"2023-11-18T19:24:27.015976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43888851,"num_objects":2286,"num_object_clones":0,"num_object_copies":9144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6293,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'980","reported_seq":1006,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.787682+0000","last_change":"2023-11-18T19:06:37.560744+0000","last_active":"2023-11-18T19:24:26.787682+0000","last_peered":"2023-11-18T19:24:26.787682+0000","last_clean":"2023-11-18T19:24:26.787682+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:26.787682+0000","last_undegraded":"2023-11-18T19:24:26.787682+0000","last_fullsized":"2023-11-18T19:24:26.787682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":768,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'415","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.049697+0000","last_change":"2023-11-18T19:06:37.038215+0000","last_active":"2023-11-18T19:24:27.049697+0000","last_peered":"2023-11-18T19:24:27.049697+0000","last_clean":"2023-11-18T19:24:27.049697+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:24:27.049697+0000","last_undegraded":"2023-11-18T19:24:27.049697+0000","last_fullsized":"2023-11-18T19:24:27.049697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:30.359024+0000","last_change":"2023-11-18T19:24:30.359024+0000","last_active":"2023-11-18T19:24:30.359024+0000","last_peered":"2023-11-18T19:24:30.359024+0000","last_clean":"2023-11-18T19:24:30.359024+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:24:30.359024+0000","last_undegraded":"2023-11-18T19:24:30.359024+0000","last_fullsized":"2023-11-18T19:24:30.359024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_clean_scrub_stamp":"2023-11-18T19:24:30.358806+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:26.918519+0000","scrub_duration":0.011450409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4474","reported_seq":4498,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.118606+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:24:27.118606+0000","last_peered":"2023-11-18T19:24:27.118606+0000","last_clean":"2023-11-18T19:24:27.118606+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:24:27.118606+0000","last_undegraded":"2023-11-18T19:24:27.118606+0000","last_fullsized":"2023-11-18T19:24:27.118606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4474,"log_dups_size":0,"ondisk_log_size":4474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47903098,"num_objects":2231,"num_object_clones":0,"num_object_copies":8924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6002,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'984","reported_seq":1010,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.872165+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:24:29.872165+0000","last_peered":"2023-11-18T19:24:29.872165+0000","last_clean":"2023-11-18T19:24:29.872165+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:24:29.872165+0000","last_undegraded":"2023-11-18T19:24:29.872165+0000","last_fullsized":"2023-11-18T19:24:29.872165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'560","reported_seq":599,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.598604+0000","last_change":"2023-11-18T19:24:34.598604+0000","last_active":"2023-11-18T19:24:34.598604+0000","last_peered":"2023-11-18T19:24:34.598604+0000","last_clean":"2023-11-18T19:24:34.598604+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:24:34.598604+0000","last_undegraded":"2023-11-18T19:24:34.598604+0000","last_fullsized":"2023-11-18T19:24:34.598604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'560","last_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_deep_scrub":"29'560","last_deep_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.598509+0000","objects_scrubbed":106,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:12:43.193975+0000","scrub_duration":0.13571029200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":658,"num_write_kb":29852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":978255,"num_omap_keys":1693,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4629","reported_seq":4653,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.075858+0000","last_change":"2023-11-18T19:06:41.602183+0000","last_active":"2023-11-18T19:24:27.075858+0000","last_peered":"2023-11-18T19:24:27.075858+0000","last_clean":"2023-11-18T19:24:27.075858+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:24:27.075858+0000","last_undegraded":"2023-11-18T19:24:27.075858+0000","last_fullsized":"2023-11-18T19:24:27.075858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54570935,"num_objects":2278,"num_object_clones":0,"num_object_copies":9112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6188,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'952","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.555419+0000","last_change":"2023-11-18T19:06:37.572844+0000","last_active":"2023-11-18T19:24:27.555419+0000","last_peered":"2023-11-18T19:24:27.555419+0000","last_clean":"2023-11-18T19:24:27.555419+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:27.555419+0000","last_undegraded":"2023-11-18T19:24:27.555419+0000","last_fullsized":"2023-11-18T19:24:27.555419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'892","reported_seq":919,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:42.090176+0000","last_change":"2023-11-18T19:24:48.492681+0000","last_active":"2023-11-18T19:24:42.090176+0000","last_peered":"2023-11-18T19:24:42.090176+0000","last_clean":"2023-11-18T19:24:42.090176+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:24:42.090176+0000","last_undegraded":"2023-11-18T19:24:42.090176+0000","last_fullsized":"2023-11-18T19:24:42.090176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":34394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4679","reported_seq":4704,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.319099+0000","last_change":"2023-11-18T19:06:41.604807+0000","last_active":"2023-11-18T19:24:31.319099+0000","last_peered":"2023-11-18T19:24:31.319099+0000","last_clean":"2023-11-18T19:24:31.319099+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:24:31.319099+0000","last_undegraded":"2023-11-18T19:24:31.319099+0000","last_fullsized":"2023-11-18T19:24:31.319099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46904542,"num_objects":2317,"num_object_clones":0,"num_object_copies":9268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2317,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6289,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'970","reported_seq":995,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.555697+0000","last_change":"2023-11-18T19:06:37.576405+0000","last_active":"2023-11-18T19:24:27.555697+0000","last_peered":"2023-11-18T19:24:27.555697+0000","last_clean":"2023-11-18T19:24:27.555697+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:24:27.555697+0000","last_undegraded":"2023-11-18T19:24:27.555697+0000","last_fullsized":"2023-11-18T19:24:27.555697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":970,"log_dups_size":0,"ondisk_log_size":970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'674","reported_seq":712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.172427+0000","last_change":"2023-11-18T19:24:43.172427+0000","last_active":"2023-11-18T19:24:43.172427+0000","last_peered":"2023-11-18T19:24:43.172427+0000","last_clean":"2023-11-18T19:24:43.172427+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:43.172427+0000","last_undegraded":"2023-11-18T19:24:43.172427+0000","last_fullsized":"2023-11-18T19:24:43.172427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'674","last_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_deep_scrub":"29'674","last_deep_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.172207+0000","objects_scrubbed":87,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:29.245092+0000","scrub_duration":0.19110829500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":764,"num_write_kb":21557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":780047,"num_omap_keys":1353,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4788","reported_seq":4814,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.131001+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:24:27.131001+0000","last_peered":"2023-11-18T19:24:27.131001+0000","last_clean":"2023-11-18T19:24:27.131001+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:24:27.131001+0000","last_undegraded":"2023-11-18T19:24:27.131001+0000","last_fullsized":"2023-11-18T19:24:27.131001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53454220,"num_objects":2315,"num_object_clones":0,"num_object_copies":9260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2315,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6433,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'1690","reported_seq":1754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.385083+0000","last_change":"2023-11-18T19:24:46.385114+0000","last_active":"2023-11-18T19:24:46.385083+0000","last_peered":"2023-11-18T19:24:46.385083+0000","last_clean":"2023-11-18T19:24:46.385083+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:46.385083+0000","last_undegraded":"2023-11-18T19:24:46.385083+0000","last_fullsized":"2023-11-18T19:24:46.385083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1690","last_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_deep_scrub":"29'1690","last_deep_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.385005+0000","objects_scrubbed":779,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:23.935739+0000","scrub_duration":0.68843222599999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'301","reported_seq":327,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.555543+0000","last_change":"2023-11-18T19:06:37.063207+0000","last_active":"2023-11-18T19:24:27.555543+0000","last_peered":"2023-11-18T19:24:27.555543+0000","last_clean":"2023-11-18T19:24:27.555543+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:27.555543+0000","last_undegraded":"2023-11-18T19:24:27.555543+0000","last_fullsized":"2023-11-18T19:24:27.555543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":464,"num_write_kb":13159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4549","reported_seq":4623,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:50.226277+0000","last_change":"2023-11-18T19:24:49.238509+0000","last_active":"2023-11-18T19:24:50.226277+0000","last_peered":"2023-11-18T19:24:50.226277+0000","last_clean":"2023-11-18T19:24:50.226277+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:50.226277+0000","last_undegraded":"2023-11-18T19:24:50.226277+0000","last_fullsized":"2023-11-18T19:24:50.226277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":1099,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6093,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'1720","reported_seq":1784,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.763642+0000","last_change":"2023-11-18T19:24:40.763675+0000","last_active":"2023-11-18T19:24:40.763642+0000","last_peered":"2023-11-18T19:24:40.763642+0000","last_clean":"2023-11-18T19:24:40.763642+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:40.763642+0000","last_undegraded":"2023-11-18T19:24:40.763642+0000","last_fullsized":"2023-11-18T19:24:40.763642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1720","last_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_deep_scrub":"29'1720","last_deep_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.763553+0000","objects_scrubbed":775,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:21.551774+0000","scrub_duration":0.70050171100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'457","reported_seq":495,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.976618+0000","last_change":"2023-11-18T19:24:35.976674+0000","last_active":"2023-11-18T19:24:35.976618+0000","last_peered":"2023-11-18T19:24:35.976618+0000","last_clean":"2023-11-18T19:24:35.976618+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:35.976618+0000","last_undegraded":"2023-11-18T19:24:35.976618+0000","last_fullsized":"2023-11-18T19:24:35.976618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'457","last_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_deep_scrub":"29'457","last_deep_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.976524+0000","objects_scrubbed":106,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:11.920966+0000","scrub_duration":0.135262152,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":559,"num_write_kb":13211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":791411,"num_omap_keys":1371,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4506","reported_seq":4538,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.044015+0000","last_change":"2023-11-18T19:07:25.182659+0000","last_active":"2023-11-18T19:24:27.044015+0000","last_peered":"2023-11-18T19:24:27.044015+0000","last_clean":"2023-11-18T19:24:27.044015+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:24:27.044015+0000","last_undegraded":"2023-11-18T19:24:27.044015+0000","last_fullsized":"2023-11-18T19:24:27.044015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40895696,"num_objects":2243,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6032,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.229729+0000","last_change":"2023-11-18T19:24:35.229793+0000","last_active":"2023-11-18T19:24:35.229729+0000","last_peered":"2023-11-18T19:24:35.229729+0000","last_clean":"2023-11-18T19:24:35.229729+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:35.229729+0000","last_undegraded":"2023-11-18T19:24:35.229729+0000","last_fullsized":"2023-11-18T19:24:35.229729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.229558+0000","objects_scrubbed":760,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:59.305496+0000","scrub_duration":0.89828437900000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":760,"num_object_clones":0,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'378","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.761154+0000","last_change":"2023-11-18T19:24:40.761185+0000","last_active":"2023-11-18T19:24:40.761154+0000","last_peered":"2023-11-18T19:24:40.761154+0000","last_clean":"2023-11-18T19:24:40.761154+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:40.761154+0000","last_undegraded":"2023-11-18T19:24:40.761154+0000","last_fullsized":"2023-11-18T19:24:40.761154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'378","last_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_deep_scrub":"29'378","last_deep_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.761091+0000","objects_scrubbed":103,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.893620+0000","scrub_duration":0.17205548400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":490,"num_write_kb":9347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960166,"num_omap_keys":1656,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4642","reported_seq":4665,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.021869+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:24:27.021869+0000","last_peered":"2023-11-18T19:24:27.021869+0000","last_clean":"2023-11-18T19:24:27.021869+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:24:27.021869+0000","last_undegraded":"2023-11-18T19:24:27.021869+0000","last_fullsized":"2023-11-18T19:24:27.021869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4642,"log_dups_size":0,"ondisk_log_size":4642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39856077,"num_objects":2314,"num_object_clones":0,"num_object_copies":9256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6236,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'1678","reported_seq":1748,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:52.077463+0000","last_change":"2023-11-18T19:24:52.077506+0000","last_active":"2023-11-18T19:24:52.077463+0000","last_peered":"2023-11-18T19:24:52.077463+0000","last_clean":"2023-11-18T19:24:52.077463+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:52.077463+0000","last_undegraded":"2023-11-18T19:24:52.077463+0000","last_fullsized":"2023-11-18T19:24:52.077463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1678","last_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_deep_scrub":"29'1678","last_deep_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_clean_scrub_stamp":"2023-11-18T19:24:52.077370+0000","objects_scrubbed":752,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:34.158108+0000","scrub_duration":0.83265436500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'432","reported_seq":458,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.898334+0000","last_change":"2023-11-18T19:06:37.054122+0000","last_active":"2023-11-18T19:24:24.898334+0000","last_peered":"2023-11-18T19:24:24.898334+0000","last_clean":"2023-11-18T19:24:24.898334+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:24:24.898334+0000","last_undegraded":"2023-11-18T19:24:24.898334+0000","last_fullsized":"2023-11-18T19:24:24.898334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":667,"num_write_kb":5679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":118,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4441","reported_seq":4464,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.983031+0000","last_change":"2023-11-18T19:06:41.617923+0000","last_active":"2023-11-18T19:24:26.983031+0000","last_peered":"2023-11-18T19:24:26.983031+0000","last_clean":"2023-11-18T19:24:26.983031+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:24:26.983031+0000","last_undegraded":"2023-11-18T19:24:26.983031+0000","last_fullsized":"2023-11-18T19:24:26.983031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54095014,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'1598","reported_seq":1661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.624746+0000","last_change":"2023-11-18T19:24:47.624774+0000","last_active":"2023-11-18T19:24:47.624746+0000","last_peered":"2023-11-18T19:24:47.624746+0000","last_clean":"2023-11-18T19:24:47.624746+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:47.624746+0000","last_undegraded":"2023-11-18T19:24:47.624746+0000","last_fullsized":"2023-11-18T19:24:47.624746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1598","last_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_deep_scrub":"29'1598","last_deep_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.624684+0000","objects_scrubbed":728,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:24.581876+0000","scrub_duration":1.2034515859999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'473","reported_seq":510,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.898058+0000","last_change":"2023-11-18T19:24:40.898110+0000","last_active":"2023-11-18T19:24:40.898058+0000","last_peered":"2023-11-18T19:24:40.898058+0000","last_clean":"2023-11-18T19:24:40.898058+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:40.898058+0000","last_undegraded":"2023-11-18T19:24:40.898058+0000","last_fullsized":"2023-11-18T19:24:40.898058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.897977+0000","objects_scrubbed":109,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:16:56.736936+0000","scrub_duration":0.11219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":17513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":107,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983835,"num_omap_keys":1695,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4424","reported_seq":4447,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.121295+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:24:27.121295+0000","last_peered":"2023-11-18T19:24:27.121295+0000","last_clean":"2023-11-18T19:24:27.121295+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:24:27.121295+0000","last_undegraded":"2023-11-18T19:24:27.121295+0000","last_fullsized":"2023-11-18T19:24:27.121295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4424,"log_dups_size":0,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46166125,"num_objects":2199,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5987,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'946","reported_seq":970,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.751371+0000","last_change":"2023-11-18T19:06:37.567366+0000","last_active":"2023-11-18T19:24:26.751371+0000","last_peered":"2023-11-18T19:24:26.751371+0000","last_clean":"2023-11-18T19:24:26.751371+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:26.751371+0000","last_undegraded":"2023-11-18T19:24:26.751371+0000","last_fullsized":"2023-11-18T19:24:26.751371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":735,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'709","reported_seq":746,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.886066+0000","last_change":"2023-11-18T19:24:29.886066+0000","last_active":"2023-11-18T19:24:29.886066+0000","last_peered":"2023-11-18T19:24:29.886066+0000","last_clean":"2023-11-18T19:24:29.886066+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:29.886066+0000","last_undegraded":"2023-11-18T19:24:29.886066+0000","last_fullsized":"2023-11-18T19:24:29.886066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'708","last_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_deep_scrub":"29'708","last_deep_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_clean_scrub_stamp":"2023-11-18T19:24:29.885926+0000","objects_scrubbed":114,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:27.530776+0000","scrub_duration":0.20191796100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":819,"num_write_kb":30026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1073426,"num_omap_keys":1850,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4438","reported_seq":4461,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.031830+0000","last_change":"2023-11-18T19:06:41.601374+0000","last_active":"2023-11-18T19:24:27.031830+0000","last_peered":"2023-11-18T19:24:27.031830+0000","last_clean":"2023-11-18T19:24:27.031830+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:24:27.031830+0000","last_undegraded":"2023-11-18T19:24:27.031830+0000","last_fullsized":"2023-11-18T19:24:27.031830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4438,"log_dups_size":0,"ondisk_log_size":4438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53099612,"num_objects":2240,"num_object_clones":0,"num_object_copies":8960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'1645","reported_seq":1708,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.764493+0000","last_change":"2023-11-18T19:24:42.764519+0000","last_active":"2023-11-18T19:24:42.764493+0000","last_peered":"2023-11-18T19:24:42.764493+0000","last_clean":"2023-11-18T19:24:42.764493+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:42.764493+0000","last_undegraded":"2023-11-18T19:24:42.764493+0000","last_fullsized":"2023-11-18T19:24:42.764493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1645","last_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_deep_scrub":"29'1645","last_deep_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.764426+0000","objects_scrubbed":754,"log_size":1645,"log_dups_size":0,"ondisk_log_size":1645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:47:41.052967+0000","scrub_duration":0.66715310100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'864","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.887022+0000","last_change":"2023-11-18T19:24:38.887069+0000","last_active":"2023-11-18T19:24:38.887022+0000","last_peered":"2023-11-18T19:24:38.887022+0000","last_clean":"2023-11-18T19:24:38.887022+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:38.887022+0000","last_undegraded":"2023-11-18T19:24:38.887022+0000","last_fullsized":"2023-11-18T19:24:38.887022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'864","last_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_deep_scrub":"29'864","last_deep_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.886964+0000","objects_scrubbed":105,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:30.822719+0000","scrub_duration":0.11150884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":978,"num_write_kb":22256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1222405,"num_omap_keys":2117,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4525","reported_seq":4548,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.049330+0000","last_change":"2023-11-18T19:06:41.611656+0000","last_active":"2023-11-18T19:24:27.049330+0000","last_peered":"2023-11-18T19:24:27.049330+0000","last_clean":"2023-11-18T19:24:27.049330+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:27.049330+0000","last_undegraded":"2023-11-18T19:24:27.049330+0000","last_fullsized":"2023-11-18T19:24:27.049330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879149,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6129,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'1659","reported_seq":1721,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.452862+0000","last_change":"2023-11-18T19:24:39.452988+0000","last_active":"2023-11-18T19:24:39.452862+0000","last_peered":"2023-11-18T19:24:39.452862+0000","last_clean":"2023-11-18T19:24:39.452862+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:39.452862+0000","last_undegraded":"2023-11-18T19:24:39.452862+0000","last_fullsized":"2023-11-18T19:24:39.452862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.452680+0000","objects_scrubbed":759,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:20.443722+0000","scrub_duration":0.99957551600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":759,"num_object_clones":0,"num_object_copies":1518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'374","reported_seq":400,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:27.555299+0000","last_change":"2023-11-18T19:24:48.562303+0000","last_active":"2023-11-18T19:24:27.555299+0000","last_peered":"2023-11-18T19:24:27.555299+0000","last_clean":"2023-11-18T19:24:27.555299+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:24:27.555299+0000","last_undegraded":"2023-11-18T19:24:27.555299+0000","last_fullsized":"2023-11-18T19:24:27.555299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":562,"num_write_kb":25902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4461","reported_seq":4485,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.089084+0000","last_change":"2023-11-18T19:06:41.620343+0000","last_active":"2023-11-18T19:24:27.089084+0000","last_peered":"2023-11-18T19:24:27.089084+0000","last_clean":"2023-11-18T19:24:27.089084+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:27.089084+0000","last_undegraded":"2023-11-18T19:24:27.089084+0000","last_fullsized":"2023-11-18T19:24:27.089084+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66632640,"num_objects":2174,"num_object_clones":0,"num_object_copies":8696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5996,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1636","reported_seq":1697,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.238531+0000","last_change":"2023-11-18T19:24:43.238571+0000","last_active":"2023-11-18T19:24:43.238531+0000","last_peered":"2023-11-18T19:24:43.238531+0000","last_clean":"2023-11-18T19:24:43.238531+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:43.238531+0000","last_undegraded":"2023-11-18T19:24:43.238531+0000","last_fullsized":"2023-11-18T19:24:43.238531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1636","last_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_deep_scrub":"29'1636","last_deep_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.238470+0000","objects_scrubbed":739,"log_size":1636,"log_dups_size":0,"ondisk_log_size":1636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.195661+0000","scrub_duration":0.60574622300000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1304","reported_seq":1340,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.520069+0000","last_change":"2023-11-18T19:24:33.520162+0000","last_active":"2023-11-18T19:24:33.520069+0000","last_peered":"2023-11-18T19:24:33.520069+0000","last_clean":"2023-11-18T19:24:33.520069+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:33.520069+0000","last_undegraded":"2023-11-18T19:24:33.520069+0000","last_fullsized":"2023-11-18T19:24:33.520069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1304","last_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_deep_scrub":"29'1304","last_deep_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.519964+0000","objects_scrubbed":92,"log_size":1304,"log_dups_size":0,"ondisk_log_size":1304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:51.501118+0000","scrub_duration":0.21152945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1397,"num_write_kb":22068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":927405,"num_omap_keys":1607,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4689","reported_seq":4721,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.942767+0000","last_change":"2023-11-18T19:07:25.179857+0000","last_active":"2023-11-18T19:24:26.942767+0000","last_peered":"2023-11-18T19:24:26.942767+0000","last_clean":"2023-11-18T19:24:26.942767+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:24:26.942767+0000","last_undegraded":"2023-11-18T19:24:26.942767+0000","last_fullsized":"2023-11-18T19:24:26.942767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111025,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6322,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4432","reported_seq":4458,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:30.595324+0000","last_change":"2023-11-18T19:06:41.604360+0000","last_active":"2023-11-18T19:24:30.595324+0000","last_peered":"2023-11-18T19:24:30.595324+0000","last_clean":"2023-11-18T19:24:30.595324+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:24:30.595324+0000","last_undegraded":"2023-11-18T19:24:30.595324+0000","last_fullsized":"2023-11-18T19:24:30.595324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32576492,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5932,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'1679","reported_seq":1742,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.978485+0000","last_change":"2023-11-18T19:24:48.978523+0000","last_active":"2023-11-18T19:24:48.978485+0000","last_peered":"2023-11-18T19:24:48.978485+0000","last_clean":"2023-11-18T19:24:48.978485+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:48.978485+0000","last_undegraded":"2023-11-18T19:24:48.978485+0000","last_fullsized":"2023-11-18T19:24:48.978485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1679","last_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_deep_scrub":"29'1679","last_deep_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.978288+0000","objects_scrubbed":751,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:07:55.106118+0000","scrub_duration":1.0109235620000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":751,"num_object_clones":0,"num_object_copies":1502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'533","reported_seq":559,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.133744+0000","last_change":"2023-11-18T19:06:37.049660+0000","last_active":"2023-11-18T19:24:27.133744+0000","last_peered":"2023-11-18T19:24:27.133744+0000","last_clean":"2023-11-18T19:24:27.133744+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:24:27.133744+0000","last_undegraded":"2023-11-18T19:24:27.133744+0000","last_fullsized":"2023-11-18T19:24:27.133744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":714,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4401","reported_seq":4425,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.047810+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:24:27.047810+0000","last_peered":"2023-11-18T19:24:27.047810+0000","last_clean":"2023-11-18T19:24:27.047810+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:24:27.047810+0000","last_undegraded":"2023-11-18T19:24:27.047810+0000","last_fullsized":"2023-11-18T19:24:27.047810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48972751,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5897,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'1031","reported_seq":1055,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.805494+0000","last_change":"2023-11-18T19:06:37.569062+0000","last_active":"2023-11-18T19:24:26.805494+0000","last_peered":"2023-11-18T19:24:26.805494+0000","last_clean":"2023-11-18T19:24:26.805494+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:26.805494+0000","last_undegraded":"2023-11-18T19:24:26.805494+0000","last_fullsized":"2023-11-18T19:24:26.805494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":790,"num_object_clones":0,"num_object_copies":1580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'395","reported_seq":432,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.625437+0000","last_change":"2023-11-18T19:24:35.625514+0000","last_active":"2023-11-18T19:24:35.625437+0000","last_peered":"2023-11-18T19:24:35.625437+0000","last_clean":"2023-11-18T19:24:35.625437+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:35.625437+0000","last_undegraded":"2023-11-18T19:24:35.625437+0000","last_fullsized":"2023-11-18T19:24:35.625437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'395","last_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_deep_scrub":"29'395","last_deep_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.625354+0000","objects_scrubbed":89,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:07.903929+0000","scrub_duration":0.13174055800000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":17267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624270,"num_omap_keys":1080,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'675","reported_seq":701,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.071456+0000","last_change":"2023-11-18T19:06:37.062179+0000","last_active":"2023-11-18T19:24:27.071456+0000","last_peered":"2023-11-18T19:24:27.071456+0000","last_clean":"2023-11-18T19:24:27.071456+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:24:27.071456+0000","last_undegraded":"2023-11-18T19:24:27.071456+0000","last_fullsized":"2023-11-18T19:24:27.071456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":33823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'969","reported_seq":994,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.746499+0000","last_change":"2023-11-18T19:06:37.582768+0000","last_active":"2023-11-18T19:24:26.746499+0000","last_peered":"2023-11-18T19:24:26.746499+0000","last_clean":"2023-11-18T19:24:26.746499+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:26.746499+0000","last_undegraded":"2023-11-18T19:24:26.746499+0000","last_fullsized":"2023-11-18T19:24:26.746499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":753,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4623","reported_seq":4646,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.933780+0000","last_change":"2023-11-18T19:06:41.620172+0000","last_active":"2023-11-18T19:24:26.933780+0000","last_peered":"2023-11-18T19:24:26.933780+0000","last_clean":"2023-11-18T19:24:26.933780+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:24:26.933780+0000","last_undegraded":"2023-11-18T19:24:26.933780+0000","last_fullsized":"2023-11-18T19:24:26.933780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50816520,"num_objects":2330,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6227,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'347","reported_seq":383,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.606792+0000","last_change":"2023-11-18T19:24:47.606905+0000","last_active":"2023-11-18T19:24:47.606792+0000","last_peered":"2023-11-18T19:24:47.606792+0000","last_clean":"2023-11-18T19:24:47.606792+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:24:47.606792+0000","last_undegraded":"2023-11-18T19:24:47.606792+0000","last_fullsized":"2023-11-18T19:24:47.606792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'347","last_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_deep_scrub":"29'347","last_deep_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.606700+0000","objects_scrubbed":94,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:30.134246+0000","scrub_duration":0.098167455000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":92,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":803356,"num_omap_keys":1386,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'1649","reported_seq":1711,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.232037+0000","last_change":"2023-11-18T19:24:36.232095+0000","last_active":"2023-11-18T19:24:36.232037+0000","last_peered":"2023-11-18T19:24:36.232037+0000","last_clean":"2023-11-18T19:24:36.232037+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:36.232037+0000","last_undegraded":"2023-11-18T19:24:36.232037+0000","last_fullsized":"2023-11-18T19:24:36.232037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1649","last_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_deep_scrub":"29'1649","last_deep_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.231937+0000","objects_scrubbed":750,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:22.588964+0000","scrub_duration":0.88128349299999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4639","reported_seq":4662,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.925684+0000","last_change":"2023-11-18T19:06:41.617427+0000","last_active":"2023-11-18T19:24:26.925684+0000","last_peered":"2023-11-18T19:24:26.925684+0000","last_clean":"2023-11-18T19:24:26.925684+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:24:26.925684+0000","last_undegraded":"2023-11-18T19:24:26.925684+0000","last_fullsized":"2023-11-18T19:24:26.925684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38511782,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6251,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'1674","reported_seq":1736,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.367244+0000","last_change":"2023-11-18T19:24:36.367314+0000","last_active":"2023-11-18T19:24:36.367244+0000","last_peered":"2023-11-18T19:24:36.367244+0000","last_clean":"2023-11-18T19:24:36.367244+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:36.367244+0000","last_undegraded":"2023-11-18T19:24:36.367244+0000","last_fullsized":"2023-11-18T19:24:36.367244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1674","last_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_deep_scrub":"29'1674","last_deep_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.367175+0000","objects_scrubbed":749,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:16.832308+0000","scrub_duration":0.77027508200000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":749,"num_object_clones":0,"num_object_copies":1498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'1755","reported_seq":1818,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.422452+0000","last_change":"2023-11-18T19:24:51.422509+0000","last_active":"2023-11-18T19:24:51.422452+0000","last_peered":"2023-11-18T19:24:51.422452+0000","last_clean":"2023-11-18T19:24:51.422452+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:51.422452+0000","last_undegraded":"2023-11-18T19:24:51.422452+0000","last_fullsized":"2023-11-18T19:24:51.422452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1755","last_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_deep_scrub":"29'1755","last_deep_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.422369+0000","objects_scrubbed":772,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:34:08.088915+0000","scrub_duration":0.69839206799999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":846,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'1665","reported_seq":1729,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.392072+0000","last_change":"2023-11-18T19:24:47.392170+0000","last_active":"2023-11-18T19:24:47.392072+0000","last_peered":"2023-11-18T19:24:47.392072+0000","last_clean":"2023-11-18T19:24:47.392072+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:47.392072+0000","last_undegraded":"2023-11-18T19:24:47.392072+0000","last_fullsized":"2023-11-18T19:24:47.392072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1665","last_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_deep_scrub":"29'1665","last_deep_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.391954+0000","objects_scrubbed":747,"log_size":1665,"log_dups_size":0,"ondisk_log_size":1665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:28.856279+0000","scrub_duration":1.3015815769999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'1697","reported_seq":1761,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.060639+0000","last_change":"2023-11-18T19:24:37.060679+0000","last_active":"2023-11-18T19:24:37.060639+0000","last_peered":"2023-11-18T19:24:37.060639+0000","last_clean":"2023-11-18T19:24:37.060639+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:37.060639+0000","last_undegraded":"2023-11-18T19:24:37.060639+0000","last_fullsized":"2023-11-18T19:24:37.060639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1697","last_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_deep_scrub":"29'1697","last_deep_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.060556+0000","objects_scrubbed":776,"log_size":1697,"log_dups_size":0,"ondisk_log_size":1697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:32.193085+0000","scrub_duration":0.65753342699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'981","reported_seq":1007,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.983318+0000","last_change":"2023-11-18T19:06:37.567968+0000","last_active":"2023-11-18T19:24:26.983318+0000","last_peered":"2023-11-18T19:24:26.983318+0000","last_clean":"2023-11-18T19:24:26.983318+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:24:26.983318+0000","last_undegraded":"2023-11-18T19:24:26.983318+0000","last_fullsized":"2023-11-18T19:24:26.983318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'961","reported_seq":987,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.688928+0000","last_change":"2023-11-18T19:06:37.574450+0000","last_active":"2023-11-18T19:24:26.688928+0000","last_peered":"2023-11-18T19:24:26.688928+0000","last_clean":"2023-11-18T19:24:26.688928+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:24:26.688928+0000","last_undegraded":"2023-11-18T19:24:26.688928+0000","last_fullsized":"2023-11-18T19:24:26.688928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":802,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'1737","reported_seq":1801,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.490923+0000","last_change":"2023-11-18T19:24:39.490959+0000","last_active":"2023-11-18T19:24:39.490923+0000","last_peered":"2023-11-18T19:24:39.490923+0000","last_clean":"2023-11-18T19:24:39.490923+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:39.490923+0000","last_undegraded":"2023-11-18T19:24:39.490923+0000","last_fullsized":"2023-11-18T19:24:39.490923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1737","last_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_deep_scrub":"29'1737","last_deep_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.490839+0000","objects_scrubbed":775,"log_size":1737,"log_dups_size":0,"ondisk_log_size":1737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:03.420048+0000","scrub_duration":0.91801021400000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'957","reported_seq":982,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.011086+0000","last_change":"2023-11-18T19:06:37.579882+0000","last_active":"2023-11-18T19:24:27.011086+0000","last_peered":"2023-11-18T19:24:27.011086+0000","last_clean":"2023-11-18T19:24:27.011086+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:24:27.011086+0000","last_undegraded":"2023-11-18T19:24:27.011086+0000","last_fullsized":"2023-11-18T19:24:27.011086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":957,"log_dups_size":0,"ondisk_log_size":957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'1670","reported_seq":1734,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.792839+0000","last_change":"2023-11-18T19:24:36.792888+0000","last_active":"2023-11-18T19:24:36.792839+0000","last_peered":"2023-11-18T19:24:36.792839+0000","last_clean":"2023-11-18T19:24:36.792839+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:36.792839+0000","last_undegraded":"2023-11-18T19:24:36.792839+0000","last_fullsized":"2023-11-18T19:24:36.792839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.792770+0000","objects_scrubbed":756,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:19.320316+0000","scrub_duration":0.74211921199999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'952","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.319662+0000","last_change":"2023-11-18T19:06:37.567237+0000","last_active":"2023-11-18T19:24:31.319662+0000","last_peered":"2023-11-18T19:24:31.319662+0000","last_clean":"2023-11-18T19:24:31.319662+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:31.319662+0000","last_undegraded":"2023-11-18T19:24:31.319662+0000","last_fullsized":"2023-11-18T19:24:31.319662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":762,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1670","reported_seq":1733,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.259703+0000","last_change":"2023-11-18T19:24:39.259703+0000","last_active":"2023-11-18T19:24:39.259703+0000","last_peered":"2023-11-18T19:24:39.259703+0000","last_clean":"2023-11-18T19:24:39.259703+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:39.259703+0000","last_undegraded":"2023-11-18T19:24:39.259703+0000","last_fullsized":"2023-11-18T19:24:39.259703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.259562+0000","objects_scrubbed":757,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:51.163210+0000","scrub_duration":0.86967187400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":757,"num_object_clones":0,"num_object_copies":1514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'993","reported_seq":1019,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:30.594999+0000","last_change":"2023-11-18T19:06:37.568786+0000","last_active":"2023-11-18T19:24:30.594999+0000","last_peered":"2023-11-18T19:24:30.594999+0000","last_clean":"2023-11-18T19:24:30.594999+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:30.594999+0000","last_undegraded":"2023-11-18T19:24:30.594999+0000","last_fullsized":"2023-11-18T19:24:30.594999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":780,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'1686","reported_seq":1749,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:28.333003+0000","last_change":"2023-11-18T19:24:28.333003+0000","last_active":"2023-11-18T19:24:28.333003+0000","last_peered":"2023-11-18T19:24:28.333003+0000","last_clean":"2023-11-18T19:24:28.333003+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:28.333003+0000","last_undegraded":"2023-11-18T19:24:28.333003+0000","last_fullsized":"2023-11-18T19:24:28.333003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1686","last_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_deep_scrub":"29'1686","last_deep_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_clean_scrub_stamp":"2023-11-18T19:24:28.332899+0000","objects_scrubbed":752,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:08.798032+0000","scrub_duration":0.58671065600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'999","reported_seq":1025,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.872447+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:24:29.872447+0000","last_peered":"2023-11-18T19:24:29.872447+0000","last_clean":"2023-11-18T19:24:29.872447+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:24:29.872447+0000","last_undegraded":"2023-11-18T19:24:29.872447+0000","last_fullsized":"2023-11-18T19:24:29.872447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'1517","reported_seq":1556,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:52.333980+0000","last_change":"2023-11-18T19:24:51.773514+0000","last_active":"2023-11-18T19:24:52.333980+0000","last_peered":"2023-11-18T19:24:52.333980+0000","last_clean":"2023-11-18T19:24:52.333980+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:52.333980+0000","last_undegraded":"2023-11-18T19:24:52.333980+0000","last_fullsized":"2023-11-18T19:24:52.333980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":624,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1748","reported_seq":1813,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.744348+0000","last_change":"2023-11-18T19:24:33.744380+0000","last_active":"2023-11-18T19:24:33.744348+0000","last_peered":"2023-11-18T19:24:33.744348+0000","last_clean":"2023-11-18T19:24:33.744348+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:33.744348+0000","last_undegraded":"2023-11-18T19:24:33.744348+0000","last_fullsized":"2023-11-18T19:24:33.744348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.744286+0000","objects_scrubbed":806,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:19.817171+0000","scrub_duration":0.70702235400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":806,"num_object_clones":0,"num_object_copies":1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'948","reported_seq":973,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.125525+0000","last_change":"2023-11-18T19:06:37.563955+0000","last_active":"2023-11-18T19:24:27.125525+0000","last_peered":"2023-11-18T19:24:27.125525+0000","last_clean":"2023-11-18T19:24:27.125525+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:27.125525+0000","last_undegraded":"2023-11-18T19:24:27.125525+0000","last_fullsized":"2023-11-18T19:24:27.125525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":727,"num_object_clones":0,"num_object_copies":1454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'997","reported_seq":1021,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.076114+0000","last_change":"2023-11-18T19:06:37.574814+0000","last_active":"2023-11-18T19:24:27.076114+0000","last_peered":"2023-11-18T19:24:27.076114+0000","last_clean":"2023-11-18T19:24:27.076114+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:27.076114+0000","last_undegraded":"2023-11-18T19:24:27.076114+0000","last_fullsized":"2023-11-18T19:24:27.076114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'938","reported_seq":963,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.829794+0000","last_change":"2023-11-18T19:06:37.575011+0000","last_active":"2023-11-18T19:24:26.829794+0000","last_peered":"2023-11-18T19:24:26.829794+0000","last_clean":"2023-11-18T19:24:26.829794+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:26.829794+0000","last_undegraded":"2023-11-18T19:24:26.829794+0000","last_fullsized":"2023-11-18T19:24:26.829794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'1655","reported_seq":1718,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.314040+0000","last_change":"2023-11-18T19:24:41.314085+0000","last_active":"2023-11-18T19:24:41.314040+0000","last_peered":"2023-11-18T19:24:41.314040+0000","last_clean":"2023-11-18T19:24:41.314040+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:41.314040+0000","last_undegraded":"2023-11-18T19:24:41.314040+0000","last_fullsized":"2023-11-18T19:24:41.314040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1655","last_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_deep_scrub":"29'1655","last_deep_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.313951+0000","objects_scrubbed":761,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:17.258394+0000","scrub_duration":0.75370882100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":761,"num_object_clones":0,"num_object_copies":1522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'941","reported_seq":965,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.957452+0000","last_change":"2023-11-18T19:06:37.568424+0000","last_active":"2023-11-18T19:24:26.957452+0000","last_peered":"2023-11-18T19:24:26.957452+0000","last_clean":"2023-11-18T19:24:26.957452+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:26.957452+0000","last_undegraded":"2023-11-18T19:24:26.957452+0000","last_fullsized":"2023-11-18T19:24:26.957452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":741,"num_object_clones":0,"num_object_copies":1482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'960","reported_seq":984,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.861383+0000","last_change":"2023-11-18T19:06:37.584379+0000","last_active":"2023-11-18T19:24:26.861383+0000","last_peered":"2023-11-18T19:24:26.861383+0000","last_clean":"2023-11-18T19:24:26.861383+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:24:26.861383+0000","last_undegraded":"2023-11-18T19:24:26.861383+0000","last_fullsized":"2023-11-18T19:24:26.861383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'942","reported_seq":966,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.771702+0000","last_change":"2023-11-18T19:06:37.571341+0000","last_active":"2023-11-18T19:24:26.771702+0000","last_peered":"2023-11-18T19:24:26.771702+0000","last_clean":"2023-11-18T19:24:26.771702+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:24:26.771702+0000","last_undegraded":"2023-11-18T19:24:26.771702+0000","last_fullsized":"2023-11-18T19:24:26.771702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":738,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'1010","reported_seq":1035,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:28.397923+0000","last_change":"2023-11-18T19:24:47.246740+0000","last_active":"2023-11-18T19:24:28.397923+0000","last_peered":"2023-11-18T19:24:28.397923+0000","last_clean":"2023-11-18T19:24:28.397923+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:28.397923+0000","last_undegraded":"2023-11-18T19:24:28.397923+0000","last_fullsized":"2023-11-18T19:24:28.397923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'1609","reported_seq":1670,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.191904+0000","last_change":"2023-11-18T19:24:41.191959+0000","last_active":"2023-11-18T19:24:41.191904+0000","last_peered":"2023-11-18T19:24:41.191904+0000","last_clean":"2023-11-18T19:24:41.191904+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:41.191904+0000","last_undegraded":"2023-11-18T19:24:41.191904+0000","last_fullsized":"2023-11-18T19:24:41.191904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1609","last_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_deep_scrub":"29'1609","last_deep_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.191821+0000","objects_scrubbed":748,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:18.742555+0000","scrub_duration":0.72283178699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":748,"num_object_clones":0,"num_object_copies":1496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'1660","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.717494+0000","last_change":"2023-11-18T19:24:34.717527+0000","last_active":"2023-11-18T19:24:34.717494+0000","last_peered":"2023-11-18T19:24:34.717494+0000","last_clean":"2023-11-18T19:24:34.717494+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:34.717494+0000","last_undegraded":"2023-11-18T19:24:34.717494+0000","last_fullsized":"2023-11-18T19:24:34.717494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1660","last_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_deep_scrub":"29'1660","last_deep_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.717426+0000","objects_scrubbed":755,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.869959+0000","scrub_duration":1.054464544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":755,"num_object_clones":0,"num_object_copies":1510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'1550","reported_seq":1610,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.576796+0000","last_change":"2023-11-18T19:24:40.576837+0000","last_active":"2023-11-18T19:24:40.576796+0000","last_peered":"2023-11-18T19:24:40.576796+0000","last_clean":"2023-11-18T19:24:40.576796+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:40.576796+0000","last_undegraded":"2023-11-18T19:24:40.576796+0000","last_fullsized":"2023-11-18T19:24:40.576796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1550","last_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_deep_scrub":"29'1550","last_deep_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.576715+0000","objects_scrubbed":702,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.709244+0000","scrub_duration":0.96416932899999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":702,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'1015","reported_seq":1039,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.863063+0000","last_change":"2023-11-18T19:06:37.574249+0000","last_active":"2023-11-18T19:24:26.863063+0000","last_peered":"2023-11-18T19:24:26.863063+0000","last_clean":"2023-11-18T19:24:26.863063+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:26.863063+0000","last_undegraded":"2023-11-18T19:24:26.863063+0000","last_fullsized":"2023-11-18T19:24:26.863063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'1642","reported_seq":1705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:32.764155+0000","last_change":"2023-11-18T19:24:32.764235+0000","last_active":"2023-11-18T19:24:32.764155+0000","last_peered":"2023-11-18T19:24:32.764155+0000","last_clean":"2023-11-18T19:24:32.764155+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:32.764155+0000","last_undegraded":"2023-11-18T19:24:32.764155+0000","last_fullsized":"2023-11-18T19:24:32.764155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1642","last_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_deep_scrub":"29'1642","last_deep_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_clean_scrub_stamp":"2023-11-18T19:24:32.764034+0000","objects_scrubbed":744,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:09:02.008162+0000","scrub_duration":1.1096721409999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":744,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'1732","reported_seq":1796,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.250863+0000","last_change":"2023-11-18T19:24:36.250918+0000","last_active":"2023-11-18T19:24:36.250863+0000","last_peered":"2023-11-18T19:24:36.250863+0000","last_clean":"2023-11-18T19:24:36.250863+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:36.250863+0000","last_undegraded":"2023-11-18T19:24:36.250863+0000","last_fullsized":"2023-11-18T19:24:36.250863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1732","last_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_deep_scrub":"29'1732","last_deep_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.250801+0000","objects_scrubbed":789,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:00.180010+0000","scrub_duration":0.83764093900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'941","reported_seq":966,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.018811+0000","last_change":"2023-11-18T19:06:37.578836+0000","last_active":"2023-11-18T19:24:27.018811+0000","last_peered":"2023-11-18T19:24:27.018811+0000","last_clean":"2023-11-18T19:24:27.018811+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:24:27.018811+0000","last_undegraded":"2023-11-18T19:24:27.018811+0000","last_fullsized":"2023-11-18T19:24:27.018811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'918","reported_seq":943,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.853070+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:24:26.853070+0000","last_peered":"2023-11-18T19:24:26.853070+0000","last_clean":"2023-11-18T19:24:26.853070+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:24:26.853070+0000","last_undegraded":"2023-11-18T19:24:26.853070+0000","last_fullsized":"2023-11-18T19:24:26.853070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1532356433,"num_objects":72339,"num_object_clones":0,"num_object_copies":289356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72339,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":196167,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2809622528,"data_stored":3820519424,"data_compressed":666760082,"data_compressed_allocated":793534464,"data_compressed_original":1804431360,"omap_allocated":0,"internal_metadata":0},"log_size":145913,"ondisk_log_size":145913,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":48368,"num_object_clones":0,"num_object_copies":96736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51796,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85245,"ondisk_log_size":85245,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":252311614,"num_objects":3097,"num_object_clones":0,"num_object_copies":6194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3097,"num_whiteouts":0,"num_read":864,"num_read_kb":1816,"num_write":23618,"num_write_kb":732011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19167066,"num_omap_keys":33107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133521408,"data_stored":504623228,"data_compressed":78941764,"data_compressed_allocated":97574912,"data_compressed_original":468738048,"omap_allocated":0,"internal_metadata":0},"log_size":19055,"ondisk_log_size":19055,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509661,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":639400,"kb_used_data":373600,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93732440,"statfs":{"total":96636764160,"available":95982018560,"internally_reserved":0,"allocated":382566400,"data_stored":576987954,"data_compressed":102256610,"data_compressed_allocated":122839040,"data_compressed_original":317444096,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":4.327,"15min":4.8049999999999997},"min":{"1min":0.65100000000000002,"5min":0.45800000000000002,"15min":0.372},"max":{"1min":2.4529999999999998,"5min":248.00800000000001,"15min":248.00800000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.5469999999999999,"5min":4.516,"15min":5.0270000000000001},"min":{"1min":0.72899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.4210000000000003,"5min":175.095,"15min":384.19499999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":2.4630000000000001,"15min":4.0839999999999996},"min":{"1min":0.748,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":4.681,"5min":53.398000000000003,"15min":199.179},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.587,"5min":4.5679999999999996,"15min":5.2869999999999999},"min":{"1min":0.72399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":6.4619999999999997,"5min":175.06800000000001,"15min":384.09699999999998},"last":1.3720000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.952,"15min":3.2559999999999998},"min":{"1min":0.63600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.8279999999999998,"5min":15.159000000000001,"15min":207.149},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.357,"5min":2.4900000000000002,"15min":5.4939999999999998},"min":{"1min":0.71299999999999997,"5min":0.51800000000000002,"15min":0.47299999999999998},"max":{"1min":2.4969999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":1.0469999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":4.593,"15min":5.6929999999999996},"min":{"1min":0.73299999999999998,"5min":0.51400000000000001,"15min":0.44600000000000001},"max":{"1min":6.4909999999999997,"5min":175.02600000000001,"15min":384.04700000000003},"last":1.413},{"interface":"front","average":{"1min":1.472,"5min":2.4580000000000002,"15min":3.4009999999999998},"min":{"1min":0.755,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":2.8700000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":0.75600000000000001}]},{"osd":4,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":3.1269999999999998,"15min":5.0049999999999999},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":4.9420000000000002,"5min":86.346999999999994,"15min":199.393},"last":0.624},{"interface":"front","average":{"1min":2.8420000000000001,"5min":5.4690000000000003,"15min":6.5700000000000003},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":26.733000000000001,"5min":204.786,"15min":384.161},"last":1.488}]},{"osd":5,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":3.1309999999999998,"15min":4.4429999999999996},"min":{"1min":0.53000000000000003,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":2.8959999999999999,"5min":79.472999999999999,"15min":220.36500000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":2.0169999999999999,"5min":4.9050000000000002,"15min":5.5800000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":6.2699999999999996,"5min":160.107,"15min":212.68100000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Nov 18 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":5.1760000000000002,"15min":8.9359999999999999},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":6.8769999999999998,"5min":205.01400000000001,"15min":410.60000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":2.8530000000000002,"5min":2.6150000000000002,"15min":4.0279999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":21.158000000000001,"5min":28.329999999999998,"15min":207.85300000000001},"last":0.81899999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509662,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":594028,"kb_used_data":328228,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93777812,"statfs":{"total":96636764160,"available":96028479488,"internally_reserved":0,"allocated":336105472,"data_stored":505600046,"data_compressed":82941676,"data_compressed_allocated":99913728,"data_compressed_original":269606912,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.5720000000000001,"15min":4.1859999999999999},"min":{"1min":0.73999999999999999,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":8.1440000000000001,"5min":14.576000000000001,"15min":248.32400000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.7689999999999999,"15min":2.7909999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.3959999999999999,"5min":26.890000000000001,"15min":93.090999999999994},"last":0.83299999999999996}]},{"osd":1,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":2.113,"15min":5.3600000000000003},"min":{"1min":0.84199999999999997,"5min":0.49199999999999999,"15min":0.47899999999999998},"max":{"1min":7.9390000000000001,"5min":41.881,"15min":335.11799999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":2.8999999999999999,"5min":2.0619999999999998,"15min":3.9340000000000002},"min":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.432},"max":{"1min":22.524000000000001,"5min":22.524000000000001,"15min":278.17700000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4060000000000001,"5min":2.3849999999999998,"15min":3.5470000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":36.954999999999998,"5min":50.735999999999997,"15min":144.68700000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.893,"5min":2.0230000000000001,"15min":3.7120000000000002},"min":{"1min":0.77200000000000002,"5min":0.56499999999999995,"15min":0.504},"max":{"1min":7.8840000000000003,"5min":24.286999999999999,"15min":247.267},"last":0.67400000000000004}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.0209999999999999,"5min":1.9750000000000001,"15min":4.819},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":12.032,"5min":30.957999999999998,"15min":207.93799999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.887,"5min":2.1139999999999999,"15min":4.5300000000000002},"min":{"1min":0.73099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":7.976,"5min":24.491,"15min":265.82600000000002},"last":0.78200000000000003}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7,"5min":2.3250000000000002,"15min":4.633},"min":{"1min":0.55100000000000005,"5min":0.52000000000000002,"15min":0.42199999999999999},"max":{"1min":8.1039999999999992,"5min":28.951000000000001,"15min":303.19200000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.1360000000000001,"15min":4.7229999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41599999999999998},"max":{"1min":12.207000000000001,"5min":31.018999999999998,"15min":210.78899999999999},"last":1.026}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.577,"5min":2.5600000000000001,"15min":6.6859999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":41.378,"5min":41.378,"15min":308.47500000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":2.9550000000000001,"5min":2.226,"15min":4.1150000000000002},"min":{"1min":0.58999999999999997,"5min":0.44400000000000001,"15min":0.34000000000000002},"max":{"1min":22.57,"5min":24.411000000000001,"15min":303.23599999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2429999999999999,"5min":2.7789999999999999,"15min":5.2800000000000002},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.41199999999999998},"max":{"1min":11.987,"5min":63.313000000000002,"15min":252.18299999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":2.0499999999999998,"5min":1.9259999999999999,"15min":4.8479999999999999},"min":{"1min":0.56999999999999995,"5min":0.49099999999999999,"15min":0.437},"max":{"1min":8.0169999999999995,"5min":14.84,"15min":309.029},"last":1.046}]}]},{"osd":4,"up_from":15,"seq":64424509662,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569708,"kb_used_data":321956,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93802132,"statfs":{"total":96636764160,"available":96053383168,"internally_reserved":0,"allocated":329682944,"data_stored":506103922,"data_compressed":93249446,"data_compressed_allocated":112369664,"data_compressed_original":288989184,"omap_allocated":1592,"internal_metadata":253688264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.6660000000000004,"5min":3.8220000000000001,"15min":2.5840000000000001},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":51.582999999999998,"5min":51.582999999999998,"15min":58.200000000000003},"last":1.0920000000000001},{"interface":"front","average":{"1min":5.0609999999999999,"5min":2.6120000000000001,"15min":2.3540000000000001},"min":{"1min":0.52900000000000003,"5min":0.40999999999999998,"15min":0.35999999999999999},"max":{"1min":56.402999999999999,"5min":56.402999999999999,"15min":56.402999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":2.3559999999999999,"15min":2.1949999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":11.771000000000001,"5min":36.024999999999999,"15min":36.024999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":7.2030000000000003,"5min":3.851,"15min":2.7309999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":51.542999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":5.6900000000000004,"5min":3.0270000000000001,"15min":2.6070000000000002},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":56.494,"5min":56.494,"15min":56.494},"last":1.129},{"interface":"front","average":{"1min":3.4809999999999999,"5min":2.8319999999999999,"15min":2.605},"min":{"1min":0.622,"5min":0.622,"15min":0.42799999999999999},"max":{"1min":18.276,"5min":36.057000000000002,"15min":36.057000000000002},"last":0.96699999999999997}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":6.9779999999999998,"5min":3.8759999999999999,"15min":2.9460000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":51.643000000000001,"5min":51.643000000000001,"15min":58.039999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":5.2889999999999997,"5min":2.8999999999999999,"15min":2.7719999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46500000000000002},"max":{"1min":56.530999999999999,"5min":56.530999999999999,"15min":56.530999999999999},"last":1.2030000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.0039999999999996,"5min":4.5250000000000004,"15min":3.7200000000000002},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.33200000000000002},"max":{"1min":68.007000000000005,"5min":68.007000000000005,"15min":68.007000000000005},"last":1.4059999999999999},{"interface":"front","average":{"1min":10.465999999999999,"5min":4.702,"15min":3.8290000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38600000000000001},"max":{"1min":72.611000000000004,"5min":72.611000000000004,"15min":72.611000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.811,"5min":4.2919999999999998,"15min":3.911},"min":{"1min":0.52700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":72.915999999999997,"5min":72.915999999999997,"15min":161.898},"last":0.76900000000000002},{"interface":"front","average":{"1min":14.786,"5min":6.0739999999999998,"15min":4.7030000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":105.387,"5min":105.387,"15min":163.33600000000001},"last":1.3200000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":7.2610000000000001,"5min":4.6710000000000003,"15min":4.1390000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":51.615000000000002,"5min":66.341999999999999,"15min":66.341999999999999},"last":1.228},{"interface":"front","average":{"1min":6.8499999999999996,"5min":4.1790000000000003,"15min":4.101},"min":{"1min":0.65800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":56.454000000000001,"5min":58.427999999999997,"15min":66.665000000000006},"last":0.72299999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509663,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":732464,"kb_used_data":422312,"kb_used_omap":1,"kb_used_meta":310142,"kb_avail":93639376,"statfs":{"total":96636764160,"available":95886721024,"internally_reserved":0,"allocated":432447488,"data_stored":638154104,"data_compressed":111010512,"data_compressed_allocated":131817472,"data_compressed_original":337711104,"omap_allocated":1593,"internal_metadata":317585863},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.538,"15min":1.1679999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6919999999999999,"5min":44.363,"15min":44.363},"last":1.345},{"interface":"front","average":{"1min":2.3540000000000001,"5min":1.992,"15min":1.956},"min":{"1min":0.44500000000000001,"5min":0.28899999999999998,"15min":0.26800000000000002},"max":{"1min":27.032,"5min":58.844999999999999,"15min":62.512999999999998},"last":0.745}]},{"osd":1,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.861,"15min":3.1539999999999999},"min":{"1min":0.626,"5min":0.315,"15min":0.26900000000000002},"max":{"1min":11.923,"5min":33.281999999999996,"15min":202.65000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.996,"5min":2.2909999999999999,"15min":2.5369999999999999},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":16.783999999999999,"5min":84.191999999999993,"15min":114.221},"last":0.69399999999999995}]},{"osd":2,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":1.8799999999999999,"5min":1.712,"15min":1.5669999999999999},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":15.013,"5min":27.433,"15min":43.747999999999998},"last":1.387},{"interface":"front","average":{"1min":1.4279999999999999,"5min":2.524,"15min":2.3660000000000001},"min":{"1min":0.48699999999999999,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":1.98,"5min":50.006,"15min":50.006},"last":0.64700000000000002}]},{"osd":4,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":3,"15min":4.2930000000000001},"min":{"1min":0.91900000000000004,"5min":0.66400000000000003,"15min":0.42499999999999999},"max":{"1min":12.43,"5min":51.384,"15min":202.821},"last":1.163},{"interface":"front","average":{"1min":2.3180000000000001,"5min":2.5089999999999999,"15min":3.2570000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":23.635000000000002,"5min":53.720999999999997,"15min":234.68700000000001},"last":1.367}]},{"osd":5,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.782,"5min":3.8900000000000001,"15min":4.3440000000000003},"min":{"1min":0.94199999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":57.360999999999997,"5min":57.360999999999997,"15min":190.827},"last":0.78800000000000003},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.9550000000000001,"15min":4.6980000000000004},"min":{"1min":0.97799999999999998,"5min":0.58199999999999996,"15min":0.54700000000000004},"max":{"1min":39.981999999999999,"5min":70.242000000000004,"15min":213.03999999999999},"last":1.056}]},{"osd":6,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":6.0220000000000002,"5min":3.335,"15min":3.0529999999999999},"min":{"1min":0.93000000000000005,"5min":0.78300000000000003,"15min":0.46800000000000003},"max":{"1min":89.710999999999999,"5min":89.710999999999999,"15min":89.710999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.9610000000000001,"5min":3.2839999999999998,"15min":3.9489999999999998},"min":{"1min":1.093,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":12.269,"5min":50.899000000000001,"15min":202.78299999999999},"last":1.131}]},{"osd":7,"last update":"Sat Nov 18 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":4.625,"5min":3.2719999999999998,"15min":4.1950000000000003},"min":{"1min":1.014,"5min":0.745,"15min":0.58299999999999996},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":82.248000000000005},"last":1.0780000000000001},{"interface":"front","average":{"1min":4.0449999999999999,"5min":4.6319999999999997,"15min":6.069},"min":{"1min":1.087,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":42.883000000000003,"5min":113.44,"15min":233.44800000000001},"last":1.103}]}]},{"osd":2,"up_from":15,"seq":64424509663,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":603044,"kb_used_data":342812,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":93768796,"statfs":{"total":96636764160,"available":96019247104,"internally_reserved":0,"allocated":351039488,"data_stored":491214290,"data_compressed":86308112,"data_compressed_allocated":101842944,"data_compressed_original":242208768,"omap_allocated":1595,"internal_metadata":266467781},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.2029999999999998,"15min":1.9870000000000001},"min":{"1min":0.58999999999999997,"5min":0.28299999999999997,"15min":0.26000000000000001},"max":{"1min":15.622,"5min":83.817999999999998,"15min":83.817999999999998},"last":0.873},{"interface":"front","average":{"1min":2.7709999999999999,"5min":2.448,"15min":3.4689999999999999},"min":{"1min":0.621,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":16.433,"5min":83.266999999999996,"15min":248.16999999999999},"last":1.2290000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":1.7709999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":15.384,"5min":19.004999999999999,"15min":30.504999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.157,"15min":3.3540000000000001},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.28100000000000003},"max":{"1min":14.863,"5min":47.768999999999998,"15min":255.315},"last":0.97499999999999998}]},{"osd":3,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":4.7300000000000004,"5min":1.98,"15min":1.976},"min":{"1min":0.77300000000000002,"5min":0.40799999999999997,"15min":0.315},"max":{"1min":30.062999999999999,"5min":30.062999999999999,"15min":84.840999999999994},"last":1.323},{"interface":"front","average":{"1min":2.899,"5min":2.145,"15min":2.7589999999999999},"min":{"1min":0.73699999999999999,"5min":0.54700000000000004,"15min":0.36599999999999999},"max":{"1min":15.587,"5min":27.283000000000001,"15min":128.976},"last":1.381}]},{"osd":4,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":5.9710000000000001,"5min":3.0840000000000001,"15min":4.9109999999999996},"min":{"1min":1.0669999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":37.795000000000002,"5min":47.432000000000002,"15min":255.25700000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":3.7160000000000002,"5min":2.4159999999999999,"15min":3.4340000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.48299999999999998},"max":{"1min":15.198,"5min":34.531999999999996,"15min":128.655},"last":1.8819999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.7000000000000002,"15min":4.7380000000000004},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.53300000000000003},"max":{"1min":24.016999999999999,"5min":138.905,"15min":153.417},"last":1.728},{"interface":"front","average":{"1min":7.109,"5min":3.3610000000000002,"15min":5.6150000000000002},"min":{"1min":0.97999999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":59.981000000000002,"5min":63.884,"15min":255.34899999999999},"last":1.694}]},{"osd":6,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":2.2330000000000001,"5min":2.5209999999999999,"15min":3.492},"min":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.55400000000000005},"max":{"1min":10.231,"5min":82.388999999999996,"15min":138.33099999999999},"last":1.96},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.835,"15min":5.0419999999999998},"min":{"1min":0.85099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":15.726000000000001,"5min":127.44799999999999,"15min":187.29599999999999},"last":1.5109999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":8.3079999999999998,"5min":4.3659999999999997,"15min":6.3360000000000003},"min":{"1min":1.026,"5min":0.95499999999999996,"15min":0.60899999999999999},"max":{"1min":67.837999999999994,"5min":81.165999999999997,"15min":211.17500000000001},"last":1.9239999999999999},{"interface":"front","average":{"1min":8.5269999999999992,"5min":3.2949999999999999,"15min":4.7069999999999999},"min":{"1min":0.92000000000000004,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":72.992999999999995,"5min":72.992999999999995,"15min":173.53999999999999},"last":2.1000000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509663,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":709008,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93662832,"statfs":{"total":96636764160,"available":95910739968,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106231679,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":3.968,"5min":1.617,"15min":1.478},"min":{"1min":0.76500000000000001,"5min":0.30199999999999999,"15min":0.22500000000000001},"max":{"1min":21.655999999999999,"5min":21.655999999999999,"15min":51.420999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":3.3959999999999999,"5min":1.768,"15min":1.722},"min":{"1min":0.59899999999999998,"5min":0.34200000000000003,"15min":0.255},"max":{"1min":22.587,"5min":22.587,"15min":48.802999999999997},"last":1.5309999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":1.768,"15min":2.544},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.308},"max":{"1min":24.036999999999999,"5min":24.036999999999999,"15min":131.321},"last":1.079},{"interface":"front","average":{"1min":4.6660000000000004,"5min":1.962,"15min":1.635},"min":{"1min":0.61499999999999999,"5min":0.40699999999999997,"15min":0.27800000000000002},"max":{"1min":26.029,"5min":26.029,"15min":26.029},"last":1.4450000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.343,"5min":2.2610000000000001,"15min":2.6800000000000002},"min":{"1min":0.65800000000000003,"5min":0.42799999999999999,"15min":0.26700000000000002},"max":{"1min":43.832999999999998,"5min":43.832999999999998,"15min":197.43899999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":5.843,"5min":2.4249999999999998,"15min":2.5129999999999999},"min":{"1min":0.54600000000000004,"5min":0.39600000000000002,"15min":0.32100000000000001},"max":{"1min":54.316000000000003,"5min":54.316000000000003,"15min":156.316},"last":1.345}]},{"osd":4,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.0209999999999999,"5min":2.722,"15min":3.3300000000000001},"min":{"1min":0.83899999999999997,"5min":0.64900000000000002,"15min":0.44800000000000001},"max":{"1min":48.799999999999997,"5min":48.799999999999997,"15min":159.84299999999999},"last":1.208},{"interface":"front","average":{"1min":5.1520000000000001,"5min":3.214,"15min":3.1389999999999998},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.51700000000000002},"max":{"1min":28.405999999999999,"5min":43.418999999999997,"15min":62.978999999999999},"last":1.2589999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":10.071,"5min":3.726,"15min":3.347},"min":{"1min":0.90400000000000003,"5min":0.72999999999999998,"15min":0.50600000000000001},"max":{"1min":107.88500000000001,"5min":107.88500000000001,"15min":107.88500000000001},"last":2.0150000000000001},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.6800000000000002,"15min":3.1150000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":19.553999999999998,"5min":24.309999999999999,"15min":133.685},"last":1.3109999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":7.4649999999999999,"5min":3.1819999999999999,"15min":3.5950000000000002},"min":{"1min":1.1140000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":54.220999999999997,"5min":54.220999999999997,"15min":142.84100000000001},"last":2.1459999999999999},{"interface":"front","average":{"1min":3.8700000000000001,"5min":2.278,"15min":3.706},"min":{"1min":1.006,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":23.998999999999999,"5min":23.998999999999999,"15min":146.69900000000001},"last":1.502}]},{"osd":7,"last update":"Sat Nov 18 19:24:01 2023","interfaces":[{"interface":"back","average":{"1min":5.3479999999999999,"5min":3.0499999999999998,"15min":2.7200000000000002},"min":{"1min":0.753,"5min":0.753,"15min":0.56299999999999994},"max":{"1min":31.096,"5min":31.096,"15min":35.783999999999999},"last":1.677},{"interface":"front","average":{"1min":7.819,"5min":3.5209999999999999,"15min":3.359},"min":{"1min":1.351,"5min":0.997,"15min":0.63600000000000001},"max":{"1min":34.281999999999996,"5min":34.281999999999996,"15min":57.134999999999998},"last":2.2519999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509664,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":499980,"kb_used_data":248132,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93871860,"statfs":{"total":96636764160,"available":96124784640,"internally_reserved":0,"allocated":254087168,"data_stored":412922730,"data_compressed":68731359,"data_compressed_allocated":83857408,"data_compressed_original":242884608,"omap_allocated":1594,"internal_metadata":257882566},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":3.3330000000000002,"5min":1.859,"15min":1.7569999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.21099999999999999},"max":{"1min":30.565000000000001,"5min":30.565000000000001,"15min":74.326999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":3.9260000000000002,"5min":2.1829999999999998,"15min":1.5900000000000001},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.25700000000000001},"max":{"1min":32.871000000000002,"5min":33.957999999999998,"15min":43.518000000000001},"last":1.232}]},{"osd":2,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":14.217000000000001,"5min":4.2910000000000004,"15min":2.282},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":181.27099999999999,"5min":181.27099999999999,"15min":181.27099999999999},"last":1.524},{"interface":"front","average":{"1min":4.3620000000000001,"5min":2.4119999999999999,"15min":1.827},"min":{"1min":0.504,"5min":0.436,"15min":0.24099999999999999},"max":{"1min":41.810000000000002,"5min":41.810000000000002,"15min":46.984999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.7089999999999996,"5min":2.3239999999999998,"15min":1.788},"min":{"1min":0.53000000000000003,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":31.562000000000001,"5min":31.562000000000001,"15min":36.642000000000003},"last":1.161},{"interface":"front","average":{"1min":12.118,"5min":3.8759999999999999,"15min":2.5350000000000001},"min":{"1min":1.2010000000000001,"5min":0.48599999999999999,"15min":0.28799999999999998},"max":{"1min":94.373000000000005,"5min":94.373000000000005,"15min":94.373000000000005},"last":1.75}]},{"osd":4,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":11.656000000000001,"5min":4.141,"15min":3.3159999999999998},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":135.547,"5min":135.547,"15min":135.547},"last":1.5700000000000001},{"interface":"front","average":{"1min":10.077999999999999,"5min":3.8639999999999999,"15min":3.3370000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":131.07599999999999,"5min":131.07599999999999,"15min":131.07599999999999},"last":1.6200000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":4.5460000000000003,"5min":2.9660000000000002,"15min":2.6829999999999998},"min":{"1min":1.1619999999999999,"5min":0.56699999999999995,"15min":0.38700000000000001},"max":{"1min":41.412999999999997,"5min":63.134999999999998,"15min":63.134999999999998},"last":2.2349999999999999},{"interface":"front","average":{"1min":4.5469999999999997,"5min":3.2389999999999999,"15min":2.7890000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":42.020000000000003,"5min":63.185000000000002,"15min":63.185000000000002},"last":2.3660000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.8239999999999998,"15min":3.5699999999999998},"min":{"1min":0.95899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.548999999999999,"5min":105.974,"15min":203.92699999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":4.6369999999999996,"5min":4.0860000000000003,"15min":3.806},"min":{"1min":1.0529999999999999,"5min":0.627,"15min":0.42899999999999999},"max":{"1min":28.646000000000001,"5min":160.84700000000001,"15min":203.56899999999999},"last":2.4089999999999998}]},{"osd":7,"last update":"Sat Nov 18 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":9.5519999999999996,"5min":4.3310000000000004,"15min":3.0489999999999999},"min":{"1min":0.996,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":91.418000000000006,"5min":91.418000000000006,"15min":91.418000000000006},"last":2.0800000000000001},{"interface":"front","average":{"1min":5.2549999999999999,"5min":3.8029999999999999,"15min":3.0139999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":31.756,"5min":68.608000000000004,"15min":68.608000000000004},"last":1.734}]}]},{"osd":7,"up_from":13,"seq":55834575070,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":680292,"kb_used_data":418652,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93691548,"statfs":{"total":96636764160,"available":95940145152,"internally_reserved":0,"allocated":428699648,"data_stored":578545198,"data_compressed":95037478,"data_compressed_allocated":111271936,"data_compressed_original":261312512,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.3539999999999992,"5min":5.5549999999999997,"15min":4.4649999999999999},"min":{"1min":0.58199999999999996,"5min":0.501,"15min":0.39300000000000002},"max":{"1min":69.191999999999993,"5min":221.768,"15min":221.768},"last":1.321},{"interface":"front","average":{"1min":7.1609999999999996,"5min":4.2290000000000001,"15min":3.3039999999999998},"min":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.40699999999999997},"max":{"1min":63.854999999999997,"5min":93.781000000000006,"15min":93.781000000000006},"last":1.069}]},{"osd":1,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.5009999999999994,"5min":5.7460000000000004,"15min":4.3810000000000002},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.374},"max":{"1min":69.061999999999998,"5min":221.715,"15min":221.715},"last":1.4099999999999999},{"interface":"front","average":{"1min":7.3419999999999996,"5min":4.3179999999999996,"15min":3.3969999999999998},"min":{"1min":0.74399999999999999,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":67.930999999999997,"5min":93.825000000000003,"15min":93.825000000000003},"last":1.542}]},{"osd":2,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.0329999999999999,"15min":4.3170000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.47999999999999998},"max":{"1min":21.026,"5min":27.303000000000001,"15min":189.01400000000001},"last":1.7070000000000001},{"interface":"front","average":{"1min":8.5289999999999999,"5min":5.7249999999999996,"15min":4.5910000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.48799999999999999},"max":{"1min":69.156999999999996,"5min":221.80600000000001,"15min":221.80600000000001},"last":1.1659999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":6.9409999999999998,"5min":3.3420000000000001,"15min":4.4829999999999997},"min":{"1min":0.82799999999999996,"5min":0.747,"15min":0.57399999999999995},"max":{"1min":64.206000000000003,"5min":64.206000000000003,"15min":198.696},"last":1.3560000000000001},{"interface":"front","average":{"1min":8.4770000000000003,"5min":5.7590000000000003,"15min":5.3120000000000003},"min":{"1min":0.78400000000000003,"5min":0.66200000000000003,"15min":0.46100000000000002},"max":{"1min":69.585999999999999,"5min":221.846,"15min":221.846},"last":1.486}]},{"osd":4,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":7.4640000000000004,"5min":4.5199999999999996,"15min":5.0640000000000001},"min":{"1min":0.48199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":63.634,"5min":93.890000000000001,"15min":245.36000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":5.5899999999999999,"5min":3.3530000000000002,"15min":4.7130000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.443},"max":{"1min":43.292000000000002,"5min":56.325000000000003,"15min":190.40799999999999},"last":1.246}]},{"osd":5,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.4879999999999995,"5min":6.4530000000000003,"15min":6.3959999999999999},"min":{"1min":0.46400000000000002,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":69.122,"5min":222.85499999999999,"15min":222.85499999999999},"last":1.595},{"interface":"front","average":{"1min":9.5709999999999997,"5min":5.2539999999999996,"15min":6.181},"min":{"1min":0.63400000000000001,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":83.078000000000003,"5min":93.858000000000004,"15min":215.16900000000001},"last":1.647}]},{"osd":6,"last update":"Sat Nov 18 19:24:08 2023","interfaces":[{"interface":"back","average":{"1min":8.6600000000000001,"5min":4.9820000000000002,"15min":4.9980000000000002},"min":{"1min":0.80400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":68.109999999999999,"5min":94.079999999999998,"15min":94.079999999999998},"last":1.7490000000000001},{"interface":"front","average":{"1min":8.0809999999999995,"5min":4.0359999999999996,"15min":5.0140000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":63.673000000000002,"5min":63.673000000000002,"15min":188.935},"last":1.7969999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080440,"data_compressed":14029799,"data_compressed_allocated":17076224,"data_compressed_original":84856832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16019456,"data_stored":58720326,"data_compressed":9168208,"data_compressed_allocated":11268096,"data_compressed_original":53972992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6418432,"data_stored":25166496,"data_compressed":3903195,"data_compressed_allocated":4784128,"data_compressed_original":23539712,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23023616,"data_stored":88080966,"data_compressed":13869465,"data_compressed_allocated":16965632,"data_compressed_original":82026496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":54527296,"data_compressed":8437806,"data_compressed_allocated":10407936,"data_compressed_original":49823744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22876160,"data_stored":80343772,"data_compressed":12523208,"data_compressed_allocated":15749120,"data_compressed_original":73228288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":79691776,"data_compressed":12654787,"data_compressed_allocated":15716352,"data_compressed_original":74809344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":30012156,"data_compressed":4355296,"data_compressed_allocated":5607424,"data_compressed_original":26480640,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344313856,"data_stored":465924096,"data_compressed":82404917,"data_compressed_allocated":97058816,"data_compressed_original":218669056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409116672,"data_stored":549949440,"data_compressed":97141047,"data_compressed_allocated":114851840,"data_compressed_original":255684608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":314249216,"data_stored":451452928,"data_compressed":84811640,"data_compressed_allocated":101961728,"data_compressed_original":239165440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":312856576,"data_stored":424542208,"data_compressed":70385955,"data_compressed_allocated":84119552,"data_compressed_original":195805184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":361660416,"data_stored":497172480,"data_compressed":89601823,"data_compressed_allocated":107122688,"data_compressed_original":242634752,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":419241984,"data_stored":548409344,"data_compressed":90682182,"data_compressed_allocated":105664512,"data_compressed_original":234831872,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:24:54.348 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.349 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.349 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.349 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.349 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.349 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.350 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.350 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.350 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.350 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.350 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.351 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.351 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.351 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.351 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.351 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.352 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.352 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.352 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.352 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.352 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.352 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.353 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.353 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.353 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.353 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.353 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.353 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.354 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.354 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.354 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.354 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.354 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.355 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.355 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.355 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.355 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.355 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.356 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.356 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.356 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.356 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.356 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.356 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.357 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.357 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.357 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.357 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.357 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.358 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.358 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.358 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.358 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.358 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.358 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.359 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.359 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.359 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.359 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.359 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.360 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.360 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.360 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.360 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.360 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.360 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.361 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.361 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.361 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.361 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.361 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.362 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.362 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.362 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:24:54.362 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T19:25:14.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:25:14.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.577+0000 7fc4da46f640 1 Processor -- start 2023-11-18T19:25:14.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.577+0000 7fc4da46f640 1 -- start start 2023-11-18T19:25:14.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.578+0000 7fc4da46f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 0x7fc4d4159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4da46f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d40c4960 con 0x7fc4d41560e0 2023-11-18T19:25:14.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4da46f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d40c3a60 con 0x7fc4d40aa7d0 2023-11-18T19:25:14.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4da46f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40a9950 con 0x7fc4d40c4500 2023-11-18T19:25:14.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4d3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc4d41560e0 0x7fc4d4159390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54882/0 (socket says 172.21.15.45:54882) 2023-11-18T19:25:14.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4d3fff640 1 -- 172.21.15.45:0/173217769 learned_addr learned my addr 172.21.15.45:0/173217769 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:25:14.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208017093 0 0) 0x7fc4d40c4960 con 0x7fc4d41560e0 2023-11-18T19:25:14.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4cb7fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 0x7fc4d4159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:14.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.579+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c0003520 con 0x7fc4d41560e0 2023-11-18T19:25:14.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2734285500 0 0) 0x7fc4c0003520 con 0x7fc4d41560e0 2023-11-18T19:25:14.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 msgr2=0x7fc4d4159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:14.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 0x7fc4d4159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 >> v1:172.21.15.135:6789/0 conn(0x7fc4d40aa7d0 legacy=0x7fc4d4163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:14.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40a8ee0 con 0x7fc4d41560e0 2023-11-18T19:25:14.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7fc4c4001670 con 0x7fc4d41560e0 2023-11-18T19:25:14.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 >> v1:172.21.15.45:6789/0 conn(0x7fc4d41560e0 legacy=0x7fc4d4159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:14.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c00039a0 0x7fc4c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 0x7fc4c00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c000ba60 con 0x7fc4c00047c0 2023-11-18T19:25:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c000bbd0 con 0x7fc4c00039a0 2023-11-18T19:25:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c000bd90 con 0x7fc4d40c4500 2023-11-18T19:25:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4cb7fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.580+0000 7fc4d3fff640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c00039a0 0x7fc4c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4d8a0c640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 0x7fc4c00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4cb7fe640 1 -- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 msgr2=0x7fc4c00051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4cb7fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 0x7fc4c00051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4cb7fe640 1 -- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c00039a0 msgr2=0x7fc4c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4cb7fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c00039a0 0x7fc4c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4cb7fe640 1 -- 172.21.15.45:0/173217769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c0003520 con 0x7fc4c00047c0 2023-11-18T19:25:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4d3fff640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4c00039a0 0x7fc4c0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.581+0000 7fc4d8a0c640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d40c4500 0x7fc4c00051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.582+0000 7fc4cb7fe640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4c0004c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009fc0 tx=0x7fc4c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448ecf79e574728a server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.582+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc02cbf0 con 0x7fc4c00047c0 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.582+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00f040 con 0x7fc4c00047c0 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.582+0000 7fc4d37fe640 1 -- 172.21.15.45:0/173217769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc034440 con 0x7fc4c00047c0 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.583+0000 7fc4da46f640 1 -- 172.21.15.45:0/173217769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 msgr2=0x7fc4c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.583+0000 7fc4da46f640 1 --2- 172.21.15.45:0/173217769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4c0004c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009fc0 tx=0x7fc4c00057f0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.583+0000 7fc4d8a0c640 1 -- 172.21.15.45:0/173217769 reap_dead start 2023-11-18T19:25:14.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.583+0000 7fc4da46f640 1 -- 172.21.15.45:0/173217769 shutdown_connections 2023-11-18T19:25:14.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.583+0000 7fc4da46f640 1 -- 172.21.15.45:0/173217769 >> 172.21.15.45:0/173217769 conn(0x7fc4d406a500 msgr2=0x7fc4d406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:14.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.583+0000 7fc4da46f640 1 -- 172.21.15.45:0/173217769 shutdown_connections 2023-11-18T19:25:14.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.583+0000 7fc4da46f640 1 -- 172.21.15.45:0/173217769 wait complete. 2023-11-18T19:25:14.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.585+0000 7fc4da46f640 1 Processor -- start 2023-11-18T19:25:14.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.585+0000 7fc4da46f640 1 -- start start 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4da46f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4d4158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4da46f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d41f1590 0x7fc4d4156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4da46f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d4157290 0x7fc4d41eb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4da46f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4157890 con 0x7fc4c00047c0 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4da46f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40726e0 con 0x7fc4d4157290 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4da46f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4158a90 con 0x7fc4d41f1590 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4d4158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:14.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4d4158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60052/0 (socket says 172.21.15.45:60052) 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 -- 172.21.15.45:0/713567264 learned_addr learned my addr 172.21.15.45:0/713567264 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 -- 172.21.15.45:0/713567264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d41f1590 msgr2=0x7fc4d4156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d41f1590 0x7fc4d4156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 -- 172.21.15.45:0/713567264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d4157290 msgr2=0x7fc4d41eb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d4157290 0x7fc4d41eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.586+0000 7fc4d3fff640 1 -- 172.21.15.45:0/713567264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40702f0 con 0x7fc4c00047c0 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.587+0000 7fc4d3fff640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4d4158550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400dae0 tx=0x7fc4c4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:14.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.587+0000 7fc4d17fa640 1 -- 172.21.15.45:0/713567264 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40075a0 con 0x7fc4c00047c0 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.587+0000 7fc4d17fa640 1 -- 172.21.15.45:0/713567264 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4007700 con 0x7fc4c00047c0 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.587+0000 7fc4d17fa640 1 -- 172.21.15.45:0/713567264 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40049e0 con 0x7fc4c00047c0 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.587+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d4072980 con 0x7fc4c00047c0 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.587+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d41f1a10 con 0x7fc4c00047c0 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.588+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d4067940 con 0x7fc4c00047c0 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.589+0000 7fc4d17fa640 1 -- 172.21.15.45:0/713567264 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4c4004b40 con 0x7fc4c00047c0 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.590+0000 7fc4d17fa640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc4b406ae70 0x7fc4b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.590+0000 7fc4d17fa640 1 -- 172.21.15.45:0/713567264 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc4c4089680 con 0x7fc4c00047c0 2023-11-18T19:25:14.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.591+0000 7fc4cb7fe640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc4b406ae70 0x7fc4b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:14.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.591+0000 7fc4cb7fe640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc4b406ae70 0x7fc4b406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc036000 tx=0x7fc4bc02e070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:14.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.597+0000 7fc4d17fa640 1 -- 172.21.15.45:0/713567264 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4c4054470 con 0x7fc4c00047c0 2023-11-18T19:25:14.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.788+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4d40c4ff0 con 0x7fc4b406ae70 2023-11-18T19:25:14.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.805+0000 7fc4d17fa640 1 -- 172.21.15.45:0/713567264 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+375557 (secure 0 0 0) 0x7fc4d40c4ff0 con 0x7fc4b406ae70 2023-11-18T19:25:14.811 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:25:14.813 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:25:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc4b406ae70 msgr2=0x7fc4b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc4b406ae70 0x7fc4b406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc036000 tx=0x7fc4bc02e070 comp rx=0 tx=0).stop 2023-11-18T19:25:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 msgr2=0x7fc4d4158550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4d4158550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400dae0 tx=0x7fc4c4007e10 comp rx=0 tx=0).stop 2023-11-18T19:25:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 shutdown_connections 2023-11-18T19:25:14.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d4157290 0x7fc4d41eb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fc4b406ae70 0x7fc4b406d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4d41f1590 0x7fc4d4156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 --2- 172.21.15.45:0/713567264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00047c0 0x7fc4d4158550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:14.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 >> 172.21.15.45:0/713567264 conn(0x7fc4d406a500 msgr2=0x7fc4d4154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:14.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 shutdown_connections 2023-11-18T19:25:14.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:14.812+0000 7fc4da46f640 1 -- 172.21.15.45:0/713567264 wait complete. 2023-11-18T19:25:14.833 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":585,"stamp":"2023-11-18T19:25:13.603807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1785263879,"num_objects":123806,"num_object_clones":0,"num_object_copies":392290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123806,"num_whiteouts":0,"num_read":995,"num_read_kb":1916,"num_write":271743,"num_write_kb":2424425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27291673,"num_omap_keys":47151,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270685,"ondisk_log_size":270685,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5082076,"kb_used_data":2876700,"kb_used_omap":12,"kb_used_meta":2205299,"kb_avail":749892644,"statfs":{"total":773094113280,"available":767890067456,"internally_reserved":0,"allocated":2945740800,"data_stored":4327323900,"data_compressed":745766872,"data_compressed_allocated":891199488,"data_compressed_original":2274316288,"omap_allocated":12748,"internal_metadata":2258226740},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6629518,"num_omap_keys":11457,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004371"},"pg_stats":[{"pgid":"2.1f","version":"29'488","reported_seq":526,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.102863+0000","last_change":"2023-11-18T19:24:42.102998+0000","last_active":"2023-11-18T19:24:42.102863+0000","last_peered":"2023-11-18T19:24:42.102863+0000","last_clean":"2023-11-18T19:24:42.102863+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:42.102863+0000","last_undegraded":"2023-11-18T19:24:42.102863+0000","last_fullsized":"2023-11-18T19:24:42.102863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'488","last_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_deep_scrub":"29'488","last_deep_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.102683+0000","objects_scrubbed":92,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:36:53.767588+0000","scrub_duration":0.165977034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":592,"num_write_kb":13689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1058229,"num_omap_keys":1832,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'1683","reported_seq":1747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.141937+0000","last_change":"2023-11-18T19:25:07.141982+0000","last_active":"2023-11-18T19:25:07.141937+0000","last_peered":"2023-11-18T19:25:07.141937+0000","last_clean":"2023-11-18T19:25:07.141937+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:25:07.141937+0000","last_undegraded":"2023-11-18T19:25:07.141937+0000","last_fullsized":"2023-11-18T19:25:07.141937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1683","last_scrub_stamp":"2023-11-18T19:25:07.141845+0000","last_deep_scrub":"29'1683","last_deep_scrub_stamp":"2023-11-18T19:25:07.141845+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.141845+0000","objects_scrubbed":731,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:51:10.143990+0000","scrub_duration":0.64930619099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":731,"num_object_clones":0,"num_object_copies":1462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4515","reported_seq":4635,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.295641+0000","last_change":"2023-11-18T19:24:59.295673+0000","last_active":"2023-11-18T19:24:59.295641+0000","last_peered":"2023-11-18T19:24:59.295641+0000","last_clean":"2023-11-18T19:24:59.295641+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:59.295641+0000","last_undegraded":"2023-11-18T19:24:59.295641+0000","last_fullsized":"2023-11-18T19:24:59.295641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4515","last_scrub_stamp":"2023-11-18T19:24:59.295546+0000","last_deep_scrub":"29'4515","last_deep_scrub_stamp":"2023-11-18T19:24:59.295546+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.295546+0000","objects_scrubbed":2214,"log_size":4515,"log_dups_size":0,"ondisk_log_size":4515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:31:11.433037+0000","scrub_duration":1.3914833550000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47448745,"num_objects":2214,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6085,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'399","reported_seq":437,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.562573+0000","last_change":"2023-11-18T19:24:49.562619+0000","last_active":"2023-11-18T19:24:49.562573+0000","last_peered":"2023-11-18T19:24:49.562573+0000","last_clean":"2023-11-18T19:24:49.562573+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:49.562573+0000","last_undegraded":"2023-11-18T19:24:49.562573+0000","last_fullsized":"2023-11-18T19:24:49.562573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'399","last_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_deep_scrub":"29'399","last_deep_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.562510+0000","objects_scrubbed":82,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:37.188456+0000","scrub_duration":0.114711435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":487,"num_write_kb":31117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":81,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207150,"num_omap_keys":3796,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'1691","reported_seq":1754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.183200+0000","last_change":"2023-11-18T19:25:04.183200+0000","last_active":"2023-11-18T19:25:04.183200+0000","last_peered":"2023-11-18T19:25:04.183200+0000","last_clean":"2023-11-18T19:25:04.183200+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:25:04.183200+0000","last_undegraded":"2023-11-18T19:25:04.183200+0000","last_fullsized":"2023-11-18T19:25:04.183200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1691","last_scrub_stamp":"2023-11-18T19:25:04.183067+0000","last_deep_scrub":"29'1691","last_deep_scrub_stamp":"2023-11-18T19:25:04.183067+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.183067+0000","objects_scrubbed":739,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:57.624730+0000","scrub_duration":0.67777383599999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4583","reported_seq":4706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.235913+0000","last_change":"2023-11-18T19:24:51.235992+0000","last_active":"2023-11-18T19:24:51.235913+0000","last_peered":"2023-11-18T19:24:51.235913+0000","last_clean":"2023-11-18T19:24:51.235913+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:51.235913+0000","last_undegraded":"2023-11-18T19:24:51.235913+0000","last_fullsized":"2023-11-18T19:24:51.235913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4583","last_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_deep_scrub":"29'4583","last_deep_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.235758+0000","objects_scrubbed":2273,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:46.767646+0000","scrub_duration":1.556089611,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45442855,"num_objects":2273,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6171,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'601","reported_seq":637,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.673982+0000","last_change":"2023-11-18T19:24:42.674060+0000","last_active":"2023-11-18T19:24:42.673982+0000","last_peered":"2023-11-18T19:24:42.673982+0000","last_clean":"2023-11-18T19:24:42.673982+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:42.673982+0000","last_undegraded":"2023-11-18T19:24:42.673982+0000","last_fullsized":"2023-11-18T19:24:42.673982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'601","last_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_deep_scrub":"29'601","last_deep_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.673881+0000","objects_scrubbed":99,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:23.664922+0000","scrub_duration":0.096252519999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":701,"num_write_kb":33858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":98,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":793362,"num_omap_keys":1372,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'1765","reported_seq":1829,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.986185+0000","last_change":"2023-11-18T19:24:48.986210+0000","last_active":"2023-11-18T19:24:48.986185+0000","last_peered":"2023-11-18T19:24:48.986185+0000","last_clean":"2023-11-18T19:24:48.986185+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:48.986185+0000","last_undegraded":"2023-11-18T19:24:48.986185+0000","last_fullsized":"2023-11-18T19:24:48.986185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.986121+0000","objects_scrubbed":804,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:29.451254+0000","scrub_duration":0.73796645500000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":804,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4623","reported_seq":4743,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:05.472427+0000","last_change":"2023-11-18T19:25:05.472494+0000","last_active":"2023-11-18T19:25:05.472427+0000","last_peered":"2023-11-18T19:25:05.472427+0000","last_clean":"2023-11-18T19:25:05.472427+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:25:05.472427+0000","last_undegraded":"2023-11-18T19:25:05.472427+0000","last_fullsized":"2023-11-18T19:25:05.472427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4623","last_scrub_stamp":"2023-11-18T19:25:05.472319+0000","last_deep_scrub":"29'4623","last_deep_scrub_stamp":"2023-11-18T19:25:05.472319+0000","last_clean_scrub_stamp":"2023-11-18T19:25:05.472319+0000","objects_scrubbed":2248,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:46.936644+0000","scrub_duration":1.6102027730000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48597389,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6213,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'348","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.660392+0000","last_change":"2023-11-18T19:24:49.660459+0000","last_active":"2023-11-18T19:24:49.660392+0000","last_peered":"2023-11-18T19:24:49.660392+0000","last_clean":"2023-11-18T19:24:49.660392+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:49.660392+0000","last_undegraded":"2023-11-18T19:24:49.660392+0000","last_fullsized":"2023-11-18T19:24:49.660392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'348","last_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_deep_scrub":"29'348","last_deep_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.660293+0000","objects_scrubbed":92,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:50.955578+0000","scrub_duration":0.126544825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":442,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750456,"num_omap_keys":1290,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'1000","reported_seq":1025,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.088812+0000","last_change":"2023-11-18T19:06:37.579923+0000","last_active":"2023-11-18T19:24:27.088812+0000","last_peered":"2023-11-18T19:24:27.088812+0000","last_clean":"2023-11-18T19:24:27.088812+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:24:27.088812+0000","last_undegraded":"2023-11-18T19:24:27.088812+0000","last_fullsized":"2023-11-18T19:24:27.088812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":821,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4456","reported_seq":4577,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.785149+0000","last_change":"2023-11-18T19:24:57.785191+0000","last_active":"2023-11-18T19:24:57.785149+0000","last_peered":"2023-11-18T19:24:57.785149+0000","last_clean":"2023-11-18T19:24:57.785149+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:57.785149+0000","last_undegraded":"2023-11-18T19:24:57.785149+0000","last_fullsized":"2023-11-18T19:24:57.785149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4456","last_scrub_stamp":"2023-11-18T19:24:57.785048+0000","last_deep_scrub":"29'4456","last_deep_scrub_stamp":"2023-11-18T19:24:57.785048+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.785048+0000","objects_scrubbed":2218,"log_size":4456,"log_dups_size":0,"ondisk_log_size":4456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:27:55.199202+0000","scrub_duration":2.0432324529999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44553589,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5936,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.744018+0000","last_change":"2023-11-18T19:24:39.744091+0000","last_active":"2023-11-18T19:24:39.744018+0000","last_peered":"2023-11-18T19:24:39.744018+0000","last_clean":"2023-11-18T19:24:39.744018+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:39.744018+0000","last_undegraded":"2023-11-18T19:24:39.744018+0000","last_fullsized":"2023-11-18T19:24:39.744018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.743952+0000","objects_scrubbed":742,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:27.369898+0000","scrub_duration":0.70226359599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'519","reported_seq":558,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:10.417517+0000","last_change":"2023-11-18T19:25:10.417545+0000","last_active":"2023-11-18T19:25:10.417517+0000","last_peered":"2023-11-18T19:25:10.417517+0000","last_clean":"2023-11-18T19:25:10.417517+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:25:10.417517+0000","last_undegraded":"2023-11-18T19:25:10.417517+0000","last_fullsized":"2023-11-18T19:25:10.417517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'519","last_scrub_stamp":"2023-11-18T19:25:10.417438+0000","last_deep_scrub":"29'519","last_deep_scrub_stamp":"2023-11-18T19:25:10.417438+0000","last_clean_scrub_stamp":"2023-11-18T19:25:10.417438+0000","objects_scrubbed":103,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:34.362117+0000","scrub_duration":0.182611199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":29849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":885582,"num_omap_keys":1535,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4620","reported_seq":4744,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.884423+0000","last_change":"2023-11-18T19:24:48.884469+0000","last_active":"2023-11-18T19:24:48.884423+0000","last_peered":"2023-11-18T19:24:48.884423+0000","last_clean":"2023-11-18T19:24:48.884423+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:48.884423+0000","last_undegraded":"2023-11-18T19:24:48.884423+0000","last_fullsized":"2023-11-18T19:24:48.884423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4620","last_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_deep_scrub":"29'4620","last_deep_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.884337+0000","objects_scrubbed":2305,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:31.229044+0000","scrub_duration":1.771489595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50701125,"num_objects":2305,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6229,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'1748","reported_seq":1812,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.444406+0000","last_change":"2023-11-18T19:24:49.444480+0000","last_active":"2023-11-18T19:24:49.444406+0000","last_peered":"2023-11-18T19:24:49.444406+0000","last_clean":"2023-11-18T19:24:49.444406+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:49.444406+0000","last_undegraded":"2023-11-18T19:24:49.444406+0000","last_fullsized":"2023-11-18T19:24:49.444406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.444303+0000","objects_scrubbed":785,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:21.815747+0000","scrub_duration":0.686602881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":785,"num_object_clones":0,"num_object_copies":1570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'524","reported_seq":562,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.697932+0000","last_change":"2023-11-18T19:24:37.698022+0000","last_active":"2023-11-18T19:24:37.697932+0000","last_peered":"2023-11-18T19:24:37.697932+0000","last_clean":"2023-11-18T19:24:37.697932+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:37.697932+0000","last_undegraded":"2023-11-18T19:24:37.697932+0000","last_fullsized":"2023-11-18T19:24:37.697932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'524","last_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_deep_scrub":"29'524","last_deep_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.697763+0000","objects_scrubbed":95,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:12.850295+0000","scrub_duration":0.185472308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":30122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1242455,"num_omap_keys":2145,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4571","reported_seq":4595,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.556036+0000","last_change":"2023-11-18T19:06:41.609164+0000","last_active":"2023-11-18T19:24:27.556036+0000","last_peered":"2023-11-18T19:24:27.556036+0000","last_clean":"2023-11-18T19:24:27.556036+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:24:27.556036+0000","last_undegraded":"2023-11-18T19:24:27.556036+0000","last_fullsized":"2023-11-18T19:24:27.556036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4571,"log_dups_size":0,"ondisk_log_size":4571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6125,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'1789","reported_seq":1855,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:45.778711+0000","last_change":"2023-11-18T19:24:45.778740+0000","last_active":"2023-11-18T19:24:45.778711+0000","last_peered":"2023-11-18T19:24:45.778711+0000","last_clean":"2023-11-18T19:24:45.778711+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:45.778711+0000","last_undegraded":"2023-11-18T19:24:45.778711+0000","last_fullsized":"2023-11-18T19:24:45.778711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1789","last_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_deep_scrub":"29'1789","last_deep_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_clean_scrub_stamp":"2023-11-18T19:24:45.778650+0000","objects_scrubbed":808,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:47.073935+0000","scrub_duration":0.792586715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":808,"num_object_clones":0,"num_object_copies":1616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'542","reported_seq":581,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.181657+0000","last_change":"2023-11-18T19:24:34.181862+0000","last_active":"2023-11-18T19:24:34.181657+0000","last_peered":"2023-11-18T19:24:34.181657+0000","last_clean":"2023-11-18T19:24:34.181657+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:24:34.181657+0000","last_undegraded":"2023-11-18T19:24:34.181657+0000","last_fullsized":"2023-11-18T19:24:34.181657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'542","last_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_deep_scrub":"29'542","last_deep_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.181507+0000","objects_scrubbed":113,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.334039+0000","scrub_duration":0.31913006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":17586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":869889,"num_omap_keys":1501,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4609","reported_seq":4732,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.297236+0000","last_change":"2023-11-18T19:25:00.297272+0000","last_active":"2023-11-18T19:25:00.297236+0000","last_peered":"2023-11-18T19:25:00.297236+0000","last_clean":"2023-11-18T19:25:00.297236+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:25:00.297236+0000","last_undegraded":"2023-11-18T19:25:00.297236+0000","last_fullsized":"2023-11-18T19:25:00.297236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4609","last_scrub_stamp":"2023-11-18T19:25:00.297156+0000","last_deep_scrub":"29'4609","last_deep_scrub_stamp":"2023-11-18T19:25:00.297156+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.297156+0000","objects_scrubbed":2293,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:49.521582+0000","scrub_duration":1.357820765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6233,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'989","reported_seq":1015,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.811758+0000","last_change":"2023-11-18T19:06:37.581181+0000","last_active":"2023-11-18T19:24:26.811758+0000","last_peered":"2023-11-18T19:24:26.811758+0000","last_clean":"2023-11-18T19:24:26.811758+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:24:26.811758+0000","last_undegraded":"2023-11-18T19:24:26.811758+0000","last_fullsized":"2023-11-18T19:24:26.811758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'530","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:44.705515+0000","last_change":"2023-11-18T19:24:44.705608+0000","last_active":"2023-11-18T19:24:44.705515+0000","last_peered":"2023-11-18T19:24:44.705515+0000","last_clean":"2023-11-18T19:24:44.705515+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:44.705515+0000","last_undegraded":"2023-11-18T19:24:44.705515+0000","last_fullsized":"2023-11-18T19:24:44.705515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'530","last_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_deep_scrub":"29'530","last_deep_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:44.705369+0000","objects_scrubbed":70,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:22.256103+0000","scrub_duration":0.14586217300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":13046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522099,"num_omap_keys":901,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4549","reported_seq":4673,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.067111+0000","last_change":"2023-11-18T19:25:06.067167+0000","last_active":"2023-11-18T19:25:06.067111+0000","last_peered":"2023-11-18T19:25:06.067111+0000","last_clean":"2023-11-18T19:25:06.067111+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:25:06.067111+0000","last_undegraded":"2023-11-18T19:25:06.067111+0000","last_fullsized":"2023-11-18T19:25:06.067111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4549","last_scrub_stamp":"2023-11-18T19:25:06.066995+0000","last_deep_scrub":"29'4549","last_deep_scrub_stamp":"2023-11-18T19:25:06.066995+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.066995+0000","objects_scrubbed":2311,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:41.908526+0000","scrub_duration":1.1642892309999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53723490,"num_objects":2311,"num_object_clones":0,"num_object_copies":9244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6133,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'1771","reported_seq":1836,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.658737+0000","last_change":"2023-11-18T19:24:55.658786+0000","last_active":"2023-11-18T19:24:55.658737+0000","last_peered":"2023-11-18T19:24:55.658737+0000","last_clean":"2023-11-18T19:24:55.658737+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:55.658737+0000","last_undegraded":"2023-11-18T19:24:55.658737+0000","last_fullsized":"2023-11-18T19:24:55.658737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1771","last_scrub_stamp":"2023-11-18T19:24:55.658661+0000","last_deep_scrub":"29'1771","last_deep_scrub_stamp":"2023-11-18T19:24:55.658661+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.658661+0000","objects_scrubbed":783,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:28.294107+0000","scrub_duration":0.71135849100000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":783,"num_object_clones":0,"num_object_copies":1566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'385","reported_seq":423,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:08.441949+0000","last_change":"2023-11-18T19:25:08.442011+0000","last_active":"2023-11-18T19:25:08.441949+0000","last_peered":"2023-11-18T19:25:08.441949+0000","last_clean":"2023-11-18T19:25:08.441949+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:25:08.441949+0000","last_undegraded":"2023-11-18T19:25:08.441949+0000","last_fullsized":"2023-11-18T19:25:08.441949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'385","last_scrub_stamp":"2023-11-18T19:25:08.441876+0000","last_deep_scrub":"29'385","last_deep_scrub_stamp":"2023-11-18T19:25:08.441876+0000","last_clean_scrub_stamp":"2023-11-18T19:25:08.441876+0000","objects_scrubbed":91,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:05:20.605127+0000","scrub_duration":0.16475478399999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":469,"num_write_kb":13215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":800497,"num_omap_keys":1387,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4569","reported_seq":4692,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.291786+0000","last_change":"2023-11-18T19:24:53.291854+0000","last_active":"2023-11-18T19:24:53.291786+0000","last_peered":"2023-11-18T19:24:53.291786+0000","last_clean":"2023-11-18T19:24:53.291786+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:53.291786+0000","last_undegraded":"2023-11-18T19:24:53.291786+0000","last_fullsized":"2023-11-18T19:24:53.291786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4569","last_scrub_stamp":"2023-11-18T19:24:53.291684+0000","last_deep_scrub":"29'4569","last_deep_scrub_stamp":"2023-11-18T19:24:53.291684+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.291684+0000","objects_scrubbed":2264,"log_size":4569,"log_dups_size":0,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:35.819230+0000","scrub_duration":1.533954364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58452634,"num_objects":2264,"num_object_clones":0,"num_object_copies":9056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6141,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'1596","reported_seq":1658,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.486739+0000","last_change":"2023-11-18T19:24:31.486782+0000","last_active":"2023-11-18T19:24:31.486739+0000","last_peered":"2023-11-18T19:24:31.486739+0000","last_clean":"2023-11-18T19:24:31.486739+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:31.486739+0000","last_undegraded":"2023-11-18T19:24:31.486739+0000","last_fullsized":"2023-11-18T19:24:31.486739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1596","last_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_deep_scrub":"29'1596","last_deep_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_clean_scrub_stamp":"2023-11-18T19:24:31.486678+0000","objects_scrubbed":721,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:03.765253+0000","scrub_duration":0.68181534700000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'623","reported_seq":661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.085333+0000","last_change":"2023-11-18T19:24:37.085379+0000","last_active":"2023-11-18T19:24:37.085333+0000","last_peered":"2023-11-18T19:24:37.085333+0000","last_clean":"2023-11-18T19:24:37.085333+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:37.085333+0000","last_undegraded":"2023-11-18T19:24:37.085333+0000","last_fullsized":"2023-11-18T19:24:37.085333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'623","last_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_deep_scrub":"29'623","last_deep_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.085251+0000","objects_scrubbed":96,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:19:26.864983+0000","scrub_duration":0.19450854400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1057,"num_write_kb":20813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1016762,"num_omap_keys":1760,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4574","reported_seq":4697,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.127582+0000","last_change":"2023-11-18T19:25:06.127667+0000","last_active":"2023-11-18T19:25:06.127582+0000","last_peered":"2023-11-18T19:25:06.127582+0000","last_clean":"2023-11-18T19:25:06.127582+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:25:06.127582+0000","last_undegraded":"2023-11-18T19:25:06.127582+0000","last_fullsized":"2023-11-18T19:25:06.127582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4574","last_scrub_stamp":"2023-11-18T19:25:06.127397+0000","last_deep_scrub":"29'4574","last_deep_scrub_stamp":"2023-11-18T19:25:06.127397+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.127397+0000","objects_scrubbed":2267,"log_size":4574,"log_dups_size":0,"ondisk_log_size":4574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:40.560101+0000","scrub_duration":1.131583945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41932084,"num_objects":2267,"num_object_clones":0,"num_object_copies":9068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6154,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'1715","reported_seq":1780,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.117665+0000","last_change":"2023-11-18T19:24:50.117707+0000","last_active":"2023-11-18T19:24:50.117665+0000","last_peered":"2023-11-18T19:24:50.117665+0000","last_clean":"2023-11-18T19:24:50.117665+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:50.117665+0000","last_undegraded":"2023-11-18T19:24:50.117665+0000","last_fullsized":"2023-11-18T19:24:50.117665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1715","last_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_deep_scrub":"29'1715","last_deep_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.117602+0000","objects_scrubbed":789,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:54:42.963090+0000","scrub_duration":0.69843094500000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'306","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:24.637346+0000","last_change":"2023-11-18T19:06:37.052224+0000","last_active":"2023-11-18T19:24:24.637346+0000","last_peered":"2023-11-18T19:24:24.637346+0000","last_clean":"2023-11-18T19:24:24.637346+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:24:24.637346+0000","last_undegraded":"2023-11-18T19:24:24.637346+0000","last_fullsized":"2023-11-18T19:24:24.637346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":21633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4621","reported_seq":4744,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.977024+0000","last_change":"2023-11-18T19:25:04.977082+0000","last_active":"2023-11-18T19:25:04.977024+0000","last_peered":"2023-11-18T19:25:04.977024+0000","last_clean":"2023-11-18T19:25:04.977024+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:25:04.977024+0000","last_undegraded":"2023-11-18T19:25:04.977024+0000","last_fullsized":"2023-11-18T19:25:04.977024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4621","last_scrub_stamp":"2023-11-18T19:25:04.976895+0000","last_deep_scrub":"29'4621","last_deep_scrub_stamp":"2023-11-18T19:25:04.976895+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.976895+0000","objects_scrubbed":2287,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:08.539872+0000","scrub_duration":1.5362857939999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41011562,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6203,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'1615","reported_seq":1677,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.715592+0000","last_change":"2023-11-18T19:24:38.715645+0000","last_active":"2023-11-18T19:24:38.715592+0000","last_peered":"2023-11-18T19:24:38.715592+0000","last_clean":"2023-11-18T19:24:38.715592+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:38.715592+0000","last_undegraded":"2023-11-18T19:24:38.715592+0000","last_fullsized":"2023-11-18T19:24:38.715592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1615","last_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_deep_scrub":"29'1615","last_deep_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.715496+0000","objects_scrubbed":730,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:13.868028+0000","scrub_duration":1.1252372610000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'546","reported_seq":583,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.630385+0000","last_change":"2023-11-18T19:24:46.630412+0000","last_active":"2023-11-18T19:24:46.630385+0000","last_peered":"2023-11-18T19:24:46.630385+0000","last_clean":"2023-11-18T19:24:46.630385+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:46.630385+0000","last_undegraded":"2023-11-18T19:24:46.630385+0000","last_fullsized":"2023-11-18T19:24:46.630385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'546","last_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_deep_scrub":"29'546","last_deep_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.630325+0000","objects_scrubbed":81,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:42.162213+0000","scrub_duration":0.13360024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":17360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":748148,"num_omap_keys":1294,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4547","reported_seq":4669,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.715516+0000","last_change":"2023-11-18T19:25:07.715559+0000","last_active":"2023-11-18T19:25:07.715516+0000","last_peered":"2023-11-18T19:25:07.715516+0000","last_clean":"2023-11-18T19:25:07.715516+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:25:07.715516+0000","last_undegraded":"2023-11-18T19:25:07.715516+0000","last_fullsized":"2023-11-18T19:25:07.715516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4547","last_scrub_stamp":"2023-11-18T19:25:07.715413+0000","last_deep_scrub":"29'4547","last_deep_scrub_stamp":"2023-11-18T19:25:07.715413+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.715413+0000","objects_scrubbed":2248,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:43.556944+0000","scrub_duration":1.2605765070000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47540604,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'1732","reported_seq":1795,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.289720+0000","last_change":"2023-11-18T19:24:56.289765+0000","last_active":"2023-11-18T19:24:56.289720+0000","last_peered":"2023-11-18T19:24:56.289720+0000","last_clean":"2023-11-18T19:24:56.289720+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:56.289720+0000","last_undegraded":"2023-11-18T19:24:56.289720+0000","last_fullsized":"2023-11-18T19:24:56.289720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1732","last_scrub_stamp":"2023-11-18T19:24:56.289631+0000","last_deep_scrub":"29'1732","last_deep_scrub_stamp":"2023-11-18T19:24:56.289631+0000","last_clean_scrub_stamp":"2023-11-18T19:24:56.289631+0000","objects_scrubbed":754,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:58.169206+0000","scrub_duration":0.72373005700000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1282","reported_seq":1320,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:02.498428+0000","last_change":"2023-11-18T19:25:02.498508+0000","last_active":"2023-11-18T19:25:02.498428+0000","last_peered":"2023-11-18T19:25:02.498428+0000","last_clean":"2023-11-18T19:25:02.498428+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:25:02.498428+0000","last_undegraded":"2023-11-18T19:25:02.498428+0000","last_fullsized":"2023-11-18T19:25:02.498428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1282","last_scrub_stamp":"2023-11-18T19:25:02.498331+0000","last_deep_scrub":"29'1282","last_deep_scrub_stamp":"2023-11-18T19:25:02.498331+0000","last_clean_scrub_stamp":"2023-11-18T19:25:02.498331+0000","objects_scrubbed":99,"log_size":1282,"log_dups_size":0,"ondisk_log_size":1282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:34.100927+0000","scrub_duration":0.177219503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1036880,"num_omap_keys":1796,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4578","reported_seq":4705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.781525+0000","last_change":"2023-11-18T19:25:03.781572+0000","last_active":"2023-11-18T19:25:03.781525+0000","last_peered":"2023-11-18T19:25:03.781525+0000","last_clean":"2023-11-18T19:25:03.781525+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:25:03.781525+0000","last_undegraded":"2023-11-18T19:25:03.781525+0000","last_fullsized":"2023-11-18T19:25:03.781525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4578","last_scrub_stamp":"2023-11-18T19:25:03.781403+0000","last_deep_scrub":"29'4578","last_deep_scrub_stamp":"2023-11-18T19:25:03.781403+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.781403+0000","objects_scrubbed":2302,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:05.660977+0000","scrub_duration":1.3622234500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39429542,"num_objects":2302,"num_object_clones":0,"num_object_copies":9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6195,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'1765","reported_seq":1830,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.508287+0000","last_change":"2023-11-18T19:24:57.508330+0000","last_active":"2023-11-18T19:24:57.508287+0000","last_peered":"2023-11-18T19:24:57.508287+0000","last_clean":"2023-11-18T19:24:57.508287+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:57.508287+0000","last_undegraded":"2023-11-18T19:24:57.508287+0000","last_fullsized":"2023-11-18T19:24:57.508287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:24:57.508195+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:24:57.508195+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.508195+0000","objects_scrubbed":778,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:01.071172+0000","scrub_duration":0.98722459500000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":778,"num_object_clones":0,"num_object_copies":1556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1992","reported_seq":2867,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.414699+0000","last_change":"2023-11-18T19:24:37.978888+0000","last_active":"2023-11-18T19:24:56.414699+0000","last_peered":"2023-11-18T19:24:56.414699+0000","last_clean":"2023-11-18T19:24:56.414699+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:56.414699+0000","last_undegraded":"2023-11-18T19:24:56.414699+0000","last_fullsized":"2023-11-18T19:24:56.414699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1980","last_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_deep_scrub":"29'1980","last_deep_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.978780+0000","objects_scrubbed":103,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:11:09.998369+0000","scrub_duration":0.181000729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13240280,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":836,"num_read_kb":1816,"num_write":2094,"num_write_kb":27224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":813940,"num_omap_keys":1408,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4483","reported_seq":4604,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:11.900529+0000","last_change":"2023-11-18T19:25:11.900602+0000","last_active":"2023-11-18T19:25:11.900529+0000","last_peered":"2023-11-18T19:25:11.900529+0000","last_clean":"2023-11-18T19:25:11.900529+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:25:11.900529+0000","last_undegraded":"2023-11-18T19:25:11.900529+0000","last_fullsized":"2023-11-18T19:25:11.900529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4483","last_scrub_stamp":"2023-11-18T19:25:11.900419+0000","last_deep_scrub":"29'4483","last_deep_scrub_stamp":"2023-11-18T19:25:11.900419+0000","last_clean_scrub_stamp":"2023-11-18T19:25:11.900419+0000","objects_scrubbed":2217,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:13.457948+0000","scrub_duration":1.4797586389999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52629501,"num_objects":2217,"num_object_clones":0,"num_object_copies":8868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5979,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'1648","reported_seq":1711,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.144308+0000","last_change":"2023-11-18T19:24:56.144332+0000","last_active":"2023-11-18T19:24:56.144308+0000","last_peered":"2023-11-18T19:24:56.144308+0000","last_clean":"2023-11-18T19:24:56.144308+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:56.144308+0000","last_undegraded":"2023-11-18T19:24:56.144308+0000","last_fullsized":"2023-11-18T19:24:56.144308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1648","last_scrub_stamp":"2023-11-18T19:24:56.144205+0000","last_deep_scrub":"29'1648","last_deep_scrub_stamp":"2023-11-18T19:24:56.144205+0000","last_clean_scrub_stamp":"2023-11-18T19:24:56.144205+0000","objects_scrubbed":729,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:38.671750+0000","scrub_duration":0.71927640299999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'574","reported_seq":613,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:01.538510+0000","last_change":"2023-11-18T19:25:01.538580+0000","last_active":"2023-11-18T19:25:01.538510+0000","last_peered":"2023-11-18T19:25:01.538510+0000","last_clean":"2023-11-18T19:25:01.538510+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:25:01.538510+0000","last_undegraded":"2023-11-18T19:25:01.538510+0000","last_fullsized":"2023-11-18T19:25:01.538510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'574","last_scrub_stamp":"2023-11-18T19:25:01.538406+0000","last_deep_scrub":"29'574","last_deep_scrub_stamp":"2023-11-18T19:25:01.538406+0000","last_clean_scrub_stamp":"2023-11-18T19:25:01.538406+0000","objects_scrubbed":91,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:09.053712+0000","scrub_duration":0.217749737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":29679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":793019,"num_omap_keys":1373,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4675","reported_seq":4699,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.015976+0000","last_change":"2023-11-18T19:06:41.614746+0000","last_active":"2023-11-18T19:24:27.015976+0000","last_peered":"2023-11-18T19:24:27.015976+0000","last_clean":"2023-11-18T19:24:27.015976+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:24:27.015976+0000","last_undegraded":"2023-11-18T19:24:27.015976+0000","last_fullsized":"2023-11-18T19:24:27.015976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43888851,"num_objects":2286,"num_object_clones":0,"num_object_copies":9144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6293,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'1725","reported_seq":1789,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.794104+0000","last_change":"2023-11-18T19:24:54.794174+0000","last_active":"2023-11-18T19:24:54.794104+0000","last_peered":"2023-11-18T19:24:54.794104+0000","last_clean":"2023-11-18T19:24:54.794104+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:54.794104+0000","last_undegraded":"2023-11-18T19:24:54.794104+0000","last_fullsized":"2023-11-18T19:24:54.794104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1725","last_scrub_stamp":"2023-11-18T19:24:54.794006+0000","last_deep_scrub":"29'1725","last_deep_scrub_stamp":"2023-11-18T19:24:54.794006+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.794006+0000","objects_scrubbed":768,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:35.582227+0000","scrub_duration":0.79753717599999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":768,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'520","reported_seq":559,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.397265+0000","last_change":"2023-11-18T19:25:06.397296+0000","last_active":"2023-11-18T19:25:06.397265+0000","last_peered":"2023-11-18T19:25:06.397265+0000","last_clean":"2023-11-18T19:25:06.397265+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:25:06.397265+0000","last_undegraded":"2023-11-18T19:25:06.397265+0000","last_fullsized":"2023-11-18T19:25:06.397265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'520","last_scrub_stamp":"2023-11-18T19:25:06.397201+0000","last_deep_scrub":"29'520","last_deep_scrub_stamp":"2023-11-18T19:25:06.397201+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.397201+0000","objects_scrubbed":105,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:02:21.146299+0000","scrub_duration":0.117494062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1043588,"num_omap_keys":1792,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:30.359024+0000","last_change":"2023-11-18T19:24:30.359024+0000","last_active":"2023-11-18T19:24:30.359024+0000","last_peered":"2023-11-18T19:24:30.359024+0000","last_clean":"2023-11-18T19:24:30.359024+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:24:30.359024+0000","last_undegraded":"2023-11-18T19:24:30.359024+0000","last_fullsized":"2023-11-18T19:24:30.359024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_clean_scrub_stamp":"2023-11-18T19:24:30.358806+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:26.918519+0000","scrub_duration":0.011450409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4474","reported_seq":4498,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.118606+0000","last_change":"2023-11-18T19:06:41.594543+0000","last_active":"2023-11-18T19:24:27.118606+0000","last_peered":"2023-11-18T19:24:27.118606+0000","last_clean":"2023-11-18T19:24:27.118606+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:24:27.118606+0000","last_undegraded":"2023-11-18T19:24:27.118606+0000","last_fullsized":"2023-11-18T19:24:27.118606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4474,"log_dups_size":0,"ondisk_log_size":4474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47903098,"num_objects":2231,"num_object_clones":0,"num_object_copies":8924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6002,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'984","reported_seq":1010,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.872165+0000","last_change":"2023-11-18T19:06:37.582765+0000","last_active":"2023-11-18T19:24:29.872165+0000","last_peered":"2023-11-18T19:24:29.872165+0000","last_clean":"2023-11-18T19:24:29.872165+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:24:29.872165+0000","last_undegraded":"2023-11-18T19:24:29.872165+0000","last_fullsized":"2023-11-18T19:24:29.872165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'560","reported_seq":599,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.598604+0000","last_change":"2023-11-18T19:24:34.598604+0000","last_active":"2023-11-18T19:24:34.598604+0000","last_peered":"2023-11-18T19:24:34.598604+0000","last_clean":"2023-11-18T19:24:34.598604+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:24:34.598604+0000","last_undegraded":"2023-11-18T19:24:34.598604+0000","last_fullsized":"2023-11-18T19:24:34.598604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'560","last_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_deep_scrub":"29'560","last_deep_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.598509+0000","objects_scrubbed":106,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:12:43.193975+0000","scrub_duration":0.13571029200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":658,"num_write_kb":29852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":978255,"num_omap_keys":1693,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4629","reported_seq":4754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.189441+0000","last_change":"2023-11-18T19:25:07.189475+0000","last_active":"2023-11-18T19:25:07.189441+0000","last_peered":"2023-11-18T19:25:07.189441+0000","last_clean":"2023-11-18T19:25:07.189441+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:25:07.189441+0000","last_undegraded":"2023-11-18T19:25:07.189441+0000","last_fullsized":"2023-11-18T19:25:07.189441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4629","last_scrub_stamp":"2023-11-18T19:25:07.189345+0000","last_deep_scrub":"29'4629","last_deep_scrub_stamp":"2023-11-18T19:25:07.189345+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.189345+0000","objects_scrubbed":2278,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:44.817645+0000","scrub_duration":1.3284081409999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54570935,"num_objects":2278,"num_object_clones":0,"num_object_copies":9112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6188,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'1644","reported_seq":1705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.496598+0000","last_change":"2023-11-18T19:24:53.496662+0000","last_active":"2023-11-18T19:24:53.496598+0000","last_peered":"2023-11-18T19:24:53.496598+0000","last_clean":"2023-11-18T19:24:53.496598+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:53.496598+0000","last_undegraded":"2023-11-18T19:24:53.496598+0000","last_fullsized":"2023-11-18T19:24:53.496598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1644","last_scrub_stamp":"2023-11-18T19:24:53.496501+0000","last_deep_scrub":"29'1644","last_deep_scrub_stamp":"2023-11-18T19:24:53.496501+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.496501+0000","objects_scrubbed":717,"log_size":1644,"log_dups_size":0,"ondisk_log_size":1644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:41.122447+0000","scrub_duration":0.98882590699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'892","reported_seq":919,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:42.090176+0000","last_change":"2023-11-18T19:24:48.492681+0000","last_active":"2023-11-18T19:24:42.090176+0000","last_peered":"2023-11-18T19:24:42.090176+0000","last_clean":"2023-11-18T19:24:42.090176+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:24:42.090176+0000","last_undegraded":"2023-11-18T19:24:42.090176+0000","last_fullsized":"2023-11-18T19:24:42.090176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":34394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4679","reported_seq":4804,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:09.150475+0000","last_change":"2023-11-18T19:25:09.150552+0000","last_active":"2023-11-18T19:25:09.150475+0000","last_peered":"2023-11-18T19:25:09.150475+0000","last_clean":"2023-11-18T19:25:09.150475+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:25:09.150475+0000","last_undegraded":"2023-11-18T19:25:09.150475+0000","last_fullsized":"2023-11-18T19:25:09.150475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4679","last_scrub_stamp":"2023-11-18T19:25:09.150298+0000","last_deep_scrub":"29'4679","last_deep_scrub_stamp":"2023-11-18T19:25:09.150298+0000","last_clean_scrub_stamp":"2023-11-18T19:25:09.150298+0000","objects_scrubbed":2317,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:58.225327+0000","scrub_duration":1.677471261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46904542,"num_objects":2317,"num_object_clones":0,"num_object_copies":9268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2317,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6289,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'1726","reported_seq":1789,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:08.653452+0000","last_change":"2023-11-18T19:25:08.653486+0000","last_active":"2023-11-18T19:25:08.653452+0000","last_peered":"2023-11-18T19:25:08.653452+0000","last_clean":"2023-11-18T19:25:08.653452+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:25:08.653452+0000","last_undegraded":"2023-11-18T19:25:08.653452+0000","last_fullsized":"2023-11-18T19:25:08.653452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1726","last_scrub_stamp":"2023-11-18T19:25:08.653384+0000","last_deep_scrub":"29'1726","last_deep_scrub_stamp":"2023-11-18T19:25:08.653384+0000","last_clean_scrub_stamp":"2023-11-18T19:25:08.653384+0000","objects_scrubbed":756,"log_size":1726,"log_dups_size":0,"ondisk_log_size":1726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:43.086088+0000","scrub_duration":0.73062439300000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'674","reported_seq":712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.172427+0000","last_change":"2023-11-18T19:24:43.172427+0000","last_active":"2023-11-18T19:24:43.172427+0000","last_peered":"2023-11-18T19:24:43.172427+0000","last_clean":"2023-11-18T19:24:43.172427+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:43.172427+0000","last_undegraded":"2023-11-18T19:24:43.172427+0000","last_fullsized":"2023-11-18T19:24:43.172427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'674","last_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_deep_scrub":"29'674","last_deep_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.172207+0000","objects_scrubbed":87,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:29.245092+0000","scrub_duration":0.19110829500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":764,"num_write_kb":21557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":780047,"num_omap_keys":1353,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4788","reported_seq":4814,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.131001+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:24:27.131001+0000","last_peered":"2023-11-18T19:24:27.131001+0000","last_clean":"2023-11-18T19:24:27.131001+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:24:27.131001+0000","last_undegraded":"2023-11-18T19:24:27.131001+0000","last_fullsized":"2023-11-18T19:24:27.131001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53454220,"num_objects":2315,"num_object_clones":0,"num_object_copies":9260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2315,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6433,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'1690","reported_seq":1754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.385083+0000","last_change":"2023-11-18T19:24:46.385114+0000","last_active":"2023-11-18T19:24:46.385083+0000","last_peered":"2023-11-18T19:24:46.385083+0000","last_clean":"2023-11-18T19:24:46.385083+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:46.385083+0000","last_undegraded":"2023-11-18T19:24:46.385083+0000","last_fullsized":"2023-11-18T19:24:46.385083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1690","last_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_deep_scrub":"29'1690","last_deep_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.385005+0000","objects_scrubbed":779,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:23.935739+0000","scrub_duration":0.68843222599999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'380","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.618846+0000","last_change":"2023-11-18T19:24:50.618882+0000","last_active":"2023-11-18T19:24:50.618846+0000","last_peered":"2023-11-18T19:24:50.618846+0000","last_clean":"2023-11-18T19:24:50.618846+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:50.618846+0000","last_undegraded":"2023-11-18T19:24:50.618846+0000","last_fullsized":"2023-11-18T19:24:50.618846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'380","last_scrub_stamp":"2023-11-18T19:24:50.618783+0000","last_deep_scrub":"29'380","last_deep_scrub_stamp":"2023-11-18T19:24:50.618783+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.618783+0000","objects_scrubbed":85,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:20:10.226608+0000","scrub_duration":0.092155729000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":464,"num_write_kb":13159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760791,"num_omap_keys":1317,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4549","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.915418+0000","last_change":"2023-11-18T19:24:50.915485+0000","last_active":"2023-11-18T19:24:50.915418+0000","last_peered":"2023-11-18T19:24:50.915418+0000","last_clean":"2023-11-18T19:24:50.915418+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:50.915418+0000","last_undegraded":"2023-11-18T19:24:50.915418+0000","last_fullsized":"2023-11-18T19:24:50.915418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4549","last_scrub_stamp":"2023-11-18T19:24:50.915309+0000","last_deep_scrub":"29'4549","last_deep_scrub_stamp":"2023-11-18T19:24:50.915309+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.915309+0000","objects_scrubbed":2272,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:26.067841+0000","scrub_duration":1.6764920270000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6093,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'1720","reported_seq":1784,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.763642+0000","last_change":"2023-11-18T19:24:40.763675+0000","last_active":"2023-11-18T19:24:40.763642+0000","last_peered":"2023-11-18T19:24:40.763642+0000","last_clean":"2023-11-18T19:24:40.763642+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:40.763642+0000","last_undegraded":"2023-11-18T19:24:40.763642+0000","last_fullsized":"2023-11-18T19:24:40.763642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1720","last_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_deep_scrub":"29'1720","last_deep_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.763553+0000","objects_scrubbed":775,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:21.551774+0000","scrub_duration":0.70050171100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'457","reported_seq":496,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.976674+0000","last_change":"2023-11-18T19:24:35.976674+0000","last_active":"2023-11-18T19:24:35.976674+0000","last_peered":"2023-11-18T19:24:35.976674+0000","last_clean":"2023-11-18T19:24:35.976674+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:35.976674+0000","last_undegraded":"2023-11-18T19:24:35.976674+0000","last_fullsized":"2023-11-18T19:24:35.976674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'457","last_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_deep_scrub":"29'457","last_deep_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.976524+0000","objects_scrubbed":106,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:11.920966+0000","scrub_duration":0.135262152,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":559,"num_write_kb":13211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":791411,"num_omap_keys":1371,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4506","reported_seq":4588,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:25:12.118115+0000","last_change":"2023-11-18T19:25:11.536042+0000","last_active":"2023-11-18T19:25:12.118115+0000","last_peered":"2023-11-18T19:25:12.118115+0000","last_clean":"2023-11-18T19:25:12.118115+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:25:12.118115+0000","last_undegraded":"2023-11-18T19:25:12.118115+0000","last_fullsized":"2023-11-18T19:25:12.118115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":1149,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40895696,"num_objects":2243,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6032,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.229729+0000","last_change":"2023-11-18T19:24:35.229793+0000","last_active":"2023-11-18T19:24:35.229729+0000","last_peered":"2023-11-18T19:24:35.229729+0000","last_clean":"2023-11-18T19:24:35.229729+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:35.229729+0000","last_undegraded":"2023-11-18T19:24:35.229729+0000","last_fullsized":"2023-11-18T19:24:35.229729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.229558+0000","objects_scrubbed":760,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:59.305496+0000","scrub_duration":0.89828437900000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":760,"num_object_clones":0,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'378","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.761154+0000","last_change":"2023-11-18T19:24:40.761185+0000","last_active":"2023-11-18T19:24:40.761154+0000","last_peered":"2023-11-18T19:24:40.761154+0000","last_clean":"2023-11-18T19:24:40.761154+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:40.761154+0000","last_undegraded":"2023-11-18T19:24:40.761154+0000","last_fullsized":"2023-11-18T19:24:40.761154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'378","last_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_deep_scrub":"29'378","last_deep_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.761091+0000","objects_scrubbed":103,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.893620+0000","scrub_duration":0.17205548400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":490,"num_write_kb":9347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960166,"num_omap_keys":1656,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4642","reported_seq":4665,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.021869+0000","last_change":"2023-11-18T19:06:41.610201+0000","last_active":"2023-11-18T19:24:27.021869+0000","last_peered":"2023-11-18T19:24:27.021869+0000","last_clean":"2023-11-18T19:24:27.021869+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:24:27.021869+0000","last_undegraded":"2023-11-18T19:24:27.021869+0000","last_fullsized":"2023-11-18T19:24:27.021869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4642,"log_dups_size":0,"ondisk_log_size":4642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39856077,"num_objects":2314,"num_object_clones":0,"num_object_copies":9256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6236,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'1678","reported_seq":1748,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:52.077463+0000","last_change":"2023-11-18T19:24:52.077506+0000","last_active":"2023-11-18T19:24:52.077463+0000","last_peered":"2023-11-18T19:24:52.077463+0000","last_clean":"2023-11-18T19:24:52.077463+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:52.077463+0000","last_undegraded":"2023-11-18T19:24:52.077463+0000","last_fullsized":"2023-11-18T19:24:52.077463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1678","last_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_deep_scrub":"29'1678","last_deep_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_clean_scrub_stamp":"2023-11-18T19:24:52.077370+0000","objects_scrubbed":752,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:34.158108+0000","scrub_duration":0.83265436500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'551","reported_seq":589,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:09.485967+0000","last_change":"2023-11-18T19:25:09.486063+0000","last_active":"2023-11-18T19:25:09.485967+0000","last_peered":"2023-11-18T19:25:09.485967+0000","last_clean":"2023-11-18T19:25:09.485967+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:25:09.485967+0000","last_undegraded":"2023-11-18T19:25:09.485967+0000","last_fullsized":"2023-11-18T19:25:09.485967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'551","last_scrub_stamp":"2023-11-18T19:25:09.485788+0000","last_deep_scrub":"29'551","last_deep_scrub_stamp":"2023-11-18T19:25:09.485788+0000","last_clean_scrub_stamp":"2023-11-18T19:25:09.485788+0000","objects_scrubbed":119,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:20:49.049700+0000","scrub_duration":0.22252060300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":667,"num_write_kb":5679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":118,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1383140,"num_omap_keys":2394,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4441","reported_seq":4547,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:25:12.358330+0000","last_change":"2023-11-18T19:25:11.397416+0000","last_active":"2023-11-18T19:25:12.358330+0000","last_peered":"2023-11-18T19:25:12.358330+0000","last_clean":"2023-11-18T19:25:12.358330+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:25:12.358330+0000","last_undegraded":"2023-11-18T19:25:12.358330+0000","last_fullsized":"2023-11-18T19:25:12.358330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":1974,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54095014,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'1598","reported_seq":1661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.624746+0000","last_change":"2023-11-18T19:24:47.624774+0000","last_active":"2023-11-18T19:24:47.624746+0000","last_peered":"2023-11-18T19:24:47.624746+0000","last_clean":"2023-11-18T19:24:47.624746+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:47.624746+0000","last_undegraded":"2023-11-18T19:24:47.624746+0000","last_fullsized":"2023-11-18T19:24:47.624746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1598","last_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_deep_scrub":"29'1598","last_deep_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.624684+0000","objects_scrubbed":728,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:24.581876+0000","scrub_duration":1.2034515859999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'473","reported_seq":510,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.898058+0000","last_change":"2023-11-18T19:24:40.898110+0000","last_active":"2023-11-18T19:24:40.898058+0000","last_peered":"2023-11-18T19:24:40.898058+0000","last_clean":"2023-11-18T19:24:40.898058+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:40.898058+0000","last_undegraded":"2023-11-18T19:24:40.898058+0000","last_fullsized":"2023-11-18T19:24:40.898058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.897977+0000","objects_scrubbed":109,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:16:56.736936+0000","scrub_duration":0.11219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":17513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":107,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983835,"num_omap_keys":1695,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4424","reported_seq":4447,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.121295+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:24:27.121295+0000","last_peered":"2023-11-18T19:24:27.121295+0000","last_clean":"2023-11-18T19:24:27.121295+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:24:27.121295+0000","last_undegraded":"2023-11-18T19:24:27.121295+0000","last_fullsized":"2023-11-18T19:24:27.121295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4424,"log_dups_size":0,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46166125,"num_objects":2199,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5987,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'1681","reported_seq":1742,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.616613+0000","last_change":"2023-11-18T19:24:57.616644+0000","last_active":"2023-11-18T19:24:57.616613+0000","last_peered":"2023-11-18T19:24:57.616613+0000","last_clean":"2023-11-18T19:24:57.616613+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:57.616613+0000","last_undegraded":"2023-11-18T19:24:57.616613+0000","last_fullsized":"2023-11-18T19:24:57.616613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1681","last_scrub_stamp":"2023-11-18T19:24:57.616554+0000","last_deep_scrub":"29'1681","last_deep_scrub_stamp":"2023-11-18T19:24:57.616554+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.616554+0000","objects_scrubbed":735,"log_size":1681,"log_dups_size":0,"ondisk_log_size":1681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:39.080879+0000","scrub_duration":1.0186718859999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":735,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'709","reported_seq":746,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.886066+0000","last_change":"2023-11-18T19:24:29.886066+0000","last_active":"2023-11-18T19:24:29.886066+0000","last_peered":"2023-11-18T19:24:29.886066+0000","last_clean":"2023-11-18T19:24:29.886066+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:29.886066+0000","last_undegraded":"2023-11-18T19:24:29.886066+0000","last_fullsized":"2023-11-18T19:24:29.886066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'708","last_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_deep_scrub":"29'708","last_deep_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_clean_scrub_stamp":"2023-11-18T19:24:29.885926+0000","objects_scrubbed":114,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:27.530776+0000","scrub_duration":0.20191796100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":819,"num_write_kb":30026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1073426,"num_omap_keys":1850,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4438","reported_seq":4462,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:30.595226+0000","last_change":"2023-11-18T19:25:06.044365+0000","last_active":"2023-11-18T19:24:30.595226+0000","last_peered":"2023-11-18T19:24:30.595226+0000","last_clean":"2023-11-18T19:24:30.595226+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:24:30.595226+0000","last_undegraded":"2023-11-18T19:24:30.595226+0000","last_fullsized":"2023-11-18T19:24:30.595226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4438,"log_dups_size":0,"ondisk_log_size":4438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53099612,"num_objects":2240,"num_object_clones":0,"num_object_copies":8960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'1645","reported_seq":1708,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.764493+0000","last_change":"2023-11-18T19:24:42.764519+0000","last_active":"2023-11-18T19:24:42.764493+0000","last_peered":"2023-11-18T19:24:42.764493+0000","last_clean":"2023-11-18T19:24:42.764493+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:42.764493+0000","last_undegraded":"2023-11-18T19:24:42.764493+0000","last_fullsized":"2023-11-18T19:24:42.764493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1645","last_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_deep_scrub":"29'1645","last_deep_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.764426+0000","objects_scrubbed":754,"log_size":1645,"log_dups_size":0,"ondisk_log_size":1645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:47:41.052967+0000","scrub_duration":0.66715310100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'864","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.887022+0000","last_change":"2023-11-18T19:24:38.887069+0000","last_active":"2023-11-18T19:24:38.887022+0000","last_peered":"2023-11-18T19:24:38.887022+0000","last_clean":"2023-11-18T19:24:38.887022+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:38.887022+0000","last_undegraded":"2023-11-18T19:24:38.887022+0000","last_fullsized":"2023-11-18T19:24:38.887022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'864","last_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_deep_scrub":"29'864","last_deep_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.886964+0000","objects_scrubbed":105,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:30.822719+0000","scrub_duration":0.11150884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":978,"num_write_kb":22256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1222405,"num_omap_keys":2117,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4525","reported_seq":4647,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.091569+0000","last_change":"2023-11-18T19:24:59.091600+0000","last_active":"2023-11-18T19:24:59.091569+0000","last_peered":"2023-11-18T19:24:59.091569+0000","last_clean":"2023-11-18T19:24:59.091569+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:59.091569+0000","last_undegraded":"2023-11-18T19:24:59.091569+0000","last_fullsized":"2023-11-18T19:24:59.091569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4525","last_scrub_stamp":"2023-11-18T19:24:59.091460+0000","last_deep_scrub":"29'4525","last_deep_scrub_stamp":"2023-11-18T19:24:59.091460+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.091460+0000","objects_scrubbed":2280,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:31.726906+0000","scrub_duration":1.355858741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879149,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6129,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'1659","reported_seq":1721,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.452862+0000","last_change":"2023-11-18T19:24:39.452988+0000","last_active":"2023-11-18T19:24:39.452862+0000","last_peered":"2023-11-18T19:24:39.452862+0000","last_clean":"2023-11-18T19:24:39.452862+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:39.452862+0000","last_undegraded":"2023-11-18T19:24:39.452862+0000","last_fullsized":"2023-11-18T19:24:39.452862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.452680+0000","objects_scrubbed":759,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:20.443722+0000","scrub_duration":0.99957551600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":759,"num_object_clones":0,"num_object_copies":1518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'374","reported_seq":400,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:24:27.555299+0000","last_change":"2023-11-18T19:24:48.562303+0000","last_active":"2023-11-18T19:24:27.555299+0000","last_peered":"2023-11-18T19:24:27.555299+0000","last_clean":"2023-11-18T19:24:27.555299+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:24:27.555299+0000","last_undegraded":"2023-11-18T19:24:27.555299+0000","last_fullsized":"2023-11-18T19:24:27.555299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:35.999688+0000","last_clean_scrub_stamp":"2023-11-18T19:06:35.999688+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":562,"num_write_kb":25902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4461","reported_seq":4580,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.396551+0000","last_change":"2023-11-18T19:24:55.396551+0000","last_active":"2023-11-18T19:24:55.396551+0000","last_peered":"2023-11-18T19:24:55.396551+0000","last_clean":"2023-11-18T19:24:55.396551+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:55.396551+0000","last_undegraded":"2023-11-18T19:24:55.396551+0000","last_fullsized":"2023-11-18T19:24:55.396551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4461","last_scrub_stamp":"2023-11-18T19:24:55.396432+0000","last_deep_scrub":"29'4461","last_deep_scrub_stamp":"2023-11-18T19:24:55.396432+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.396432+0000","objects_scrubbed":2174,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:12:03.605551+0000","scrub_duration":1.6315117909999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66632640,"num_objects":2174,"num_object_clones":0,"num_object_copies":8696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5996,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1636","reported_seq":1697,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.238531+0000","last_change":"2023-11-18T19:24:43.238571+0000","last_active":"2023-11-18T19:24:43.238531+0000","last_peered":"2023-11-18T19:24:43.238531+0000","last_clean":"2023-11-18T19:24:43.238531+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:43.238531+0000","last_undegraded":"2023-11-18T19:24:43.238531+0000","last_fullsized":"2023-11-18T19:24:43.238531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1636","last_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_deep_scrub":"29'1636","last_deep_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.238470+0000","objects_scrubbed":739,"log_size":1636,"log_dups_size":0,"ondisk_log_size":1636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.195661+0000","scrub_duration":0.60574622300000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1304","reported_seq":1340,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.520069+0000","last_change":"2023-11-18T19:24:33.520162+0000","last_active":"2023-11-18T19:24:33.520069+0000","last_peered":"2023-11-18T19:24:33.520069+0000","last_clean":"2023-11-18T19:24:33.520069+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:33.520069+0000","last_undegraded":"2023-11-18T19:24:33.520069+0000","last_fullsized":"2023-11-18T19:24:33.520069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1304","last_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_deep_scrub":"29'1304","last_deep_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.519964+0000","objects_scrubbed":92,"log_size":1304,"log_dups_size":0,"ondisk_log_size":1304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:51.501118+0000","scrub_duration":0.21152945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1397,"num_write_kb":22068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":927405,"num_omap_keys":1607,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4689","reported_seq":4741,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:25:12.307055+0000","last_change":"2023-11-18T19:25:12.112014+0000","last_active":"2023-11-18T19:25:12.307055+0000","last_peered":"2023-11-18T19:25:12.307055+0000","last_clean":"2023-11-18T19:25:12.307055+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:25:12.307055+0000","last_undegraded":"2023-11-18T19:25:12.307055+0000","last_fullsized":"2023-11-18T19:25:12.307055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":399,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111025,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6322,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4432","reported_seq":4552,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.216746+0000","last_change":"2023-11-18T19:25:00.216796+0000","last_active":"2023-11-18T19:25:00.216746+0000","last_peered":"2023-11-18T19:25:00.216746+0000","last_clean":"2023-11-18T19:25:00.216746+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:25:00.216746+0000","last_undegraded":"2023-11-18T19:25:00.216746+0000","last_fullsized":"2023-11-18T19:25:00.216746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4432","last_scrub_stamp":"2023-11-18T19:25:00.216656+0000","last_deep_scrub":"29'4432","last_deep_scrub_stamp":"2023-11-18T19:25:00.216656+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.216656+0000","objects_scrubbed":2171,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:37.844955+0000","scrub_duration":1.2639129570000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32576492,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5932,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'1679","reported_seq":1742,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.978485+0000","last_change":"2023-11-18T19:24:48.978523+0000","last_active":"2023-11-18T19:24:48.978485+0000","last_peered":"2023-11-18T19:24:48.978485+0000","last_clean":"2023-11-18T19:24:48.978485+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:48.978485+0000","last_undegraded":"2023-11-18T19:24:48.978485+0000","last_fullsized":"2023-11-18T19:24:48.978485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1679","last_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_deep_scrub":"29'1679","last_deep_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.978288+0000","objects_scrubbed":751,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:07:55.106118+0000","scrub_duration":1.0109235620000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":751,"num_object_clones":0,"num_object_copies":1502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'629","reported_seq":666,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.400778+0000","last_change":"2023-11-18T19:25:00.400826+0000","last_active":"2023-11-18T19:25:00.400778+0000","last_peered":"2023-11-18T19:25:00.400778+0000","last_clean":"2023-11-18T19:25:00.400778+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:25:00.400778+0000","last_undegraded":"2023-11-18T19:25:00.400778+0000","last_fullsized":"2023-11-18T19:25:00.400778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'629","last_scrub_stamp":"2023-11-18T19:25:00.400713+0000","last_deep_scrub":"29'629","last_deep_scrub_stamp":"2023-11-18T19:25:00.400713+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.400713+0000","objects_scrubbed":96,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:12.384151+0000","scrub_duration":0.115138529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":714,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686812,"num_omap_keys":1180,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4401","reported_seq":4425,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.047810+0000","last_change":"2023-11-18T19:06:41.610636+0000","last_active":"2023-11-18T19:24:27.047810+0000","last_peered":"2023-11-18T19:24:27.047810+0000","last_clean":"2023-11-18T19:24:27.047810+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:24:27.047810+0000","last_undegraded":"2023-11-18T19:24:27.047810+0000","last_fullsized":"2023-11-18T19:24:27.047810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48972751,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5897,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'1811","reported_seq":1874,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.250798+0000","last_change":"2023-11-18T19:24:55.250843+0000","last_active":"2023-11-18T19:24:55.250798+0000","last_peered":"2023-11-18T19:24:55.250798+0000","last_clean":"2023-11-18T19:24:55.250798+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:55.250798+0000","last_undegraded":"2023-11-18T19:24:55.250798+0000","last_fullsized":"2023-11-18T19:24:55.250798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1811","last_scrub_stamp":"2023-11-18T19:24:55.250715+0000","last_deep_scrub":"29'1811","last_deep_scrub_stamp":"2023-11-18T19:24:55.250715+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.250715+0000","objects_scrubbed":790,"log_size":1811,"log_dups_size":0,"ondisk_log_size":1811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:47:53.539256+0000","scrub_duration":0.80458674799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":790,"num_object_clones":0,"num_object_copies":1580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'395","reported_seq":432,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.625437+0000","last_change":"2023-11-18T19:24:35.625514+0000","last_active":"2023-11-18T19:24:35.625437+0000","last_peered":"2023-11-18T19:24:35.625437+0000","last_clean":"2023-11-18T19:24:35.625437+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:35.625437+0000","last_undegraded":"2023-11-18T19:24:35.625437+0000","last_fullsized":"2023-11-18T19:24:35.625437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'395","last_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_deep_scrub":"29'395","last_deep_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.625354+0000","objects_scrubbed":89,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:07.903929+0000","scrub_duration":0.13174055800000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":17267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624270,"num_omap_keys":1080,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'754","reported_seq":791,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.386128+0000","last_change":"2023-11-18T19:24:54.386184+0000","last_active":"2023-11-18T19:24:54.386128+0000","last_peered":"2023-11-18T19:24:54.386128+0000","last_clean":"2023-11-18T19:24:54.386128+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:24:54.386128+0000","last_undegraded":"2023-11-18T19:24:54.386128+0000","last_fullsized":"2023-11-18T19:24:54.386128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'754","last_scrub_stamp":"2023-11-18T19:24:54.386020+0000","last_deep_scrub":"29'754","last_deep_scrub_stamp":"2023-11-18T19:24:54.386020+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.386020+0000","objects_scrubbed":84,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:45.723280+0000","scrub_duration":0.112168427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":33823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734298,"num_omap_keys":1270,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1722","reported_seq":1786,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.703281+0000","last_change":"2023-11-18T19:24:57.703314+0000","last_active":"2023-11-18T19:24:57.703281+0000","last_peered":"2023-11-18T19:24:57.703281+0000","last_clean":"2023-11-18T19:24:57.703281+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:57.703281+0000","last_undegraded":"2023-11-18T19:24:57.703281+0000","last_fullsized":"2023-11-18T19:24:57.703281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1722","last_scrub_stamp":"2023-11-18T19:24:57.703180+0000","last_deep_scrub":"29'1722","last_deep_scrub_stamp":"2023-11-18T19:24:57.703180+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.703180+0000","objects_scrubbed":753,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:59.582754+0000","scrub_duration":0.816760708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":753,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4623","reported_seq":4747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:10.102500+0000","last_change":"2023-11-18T19:25:10.102527+0000","last_active":"2023-11-18T19:25:10.102500+0000","last_peered":"2023-11-18T19:25:10.102500+0000","last_clean":"2023-11-18T19:25:10.102500+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:25:10.102500+0000","last_undegraded":"2023-11-18T19:25:10.102500+0000","last_fullsized":"2023-11-18T19:25:10.102500+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4623","last_scrub_stamp":"2023-11-18T19:25:10.102391+0000","last_deep_scrub":"29'4623","last_deep_scrub_stamp":"2023-11-18T19:25:10.102391+0000","last_clean_scrub_stamp":"2023-11-18T19:25:10.102391+0000","objects_scrubbed":2330,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:51:13.104536+0000","scrub_duration":0.98392403900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50816520,"num_objects":2330,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6227,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'347","reported_seq":383,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.606792+0000","last_change":"2023-11-18T19:24:47.606905+0000","last_active":"2023-11-18T19:24:47.606792+0000","last_peered":"2023-11-18T19:24:47.606792+0000","last_clean":"2023-11-18T19:24:47.606792+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:24:47.606792+0000","last_undegraded":"2023-11-18T19:24:47.606792+0000","last_fullsized":"2023-11-18T19:24:47.606792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'347","last_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_deep_scrub":"29'347","last_deep_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.606700+0000","objects_scrubbed":94,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:30.134246+0000","scrub_duration":0.098167455000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":92,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":803356,"num_omap_keys":1386,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'1649","reported_seq":1711,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.232037+0000","last_change":"2023-11-18T19:24:36.232095+0000","last_active":"2023-11-18T19:24:36.232037+0000","last_peered":"2023-11-18T19:24:36.232037+0000","last_clean":"2023-11-18T19:24:36.232037+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:36.232037+0000","last_undegraded":"2023-11-18T19:24:36.232037+0000","last_fullsized":"2023-11-18T19:24:36.232037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1649","last_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_deep_scrub":"29'1649","last_deep_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.231937+0000","objects_scrubbed":750,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:22.588964+0000","scrub_duration":0.88128349299999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4639","reported_seq":4762,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.554068+0000","last_change":"2023-11-18T19:25:03.554103+0000","last_active":"2023-11-18T19:25:03.554068+0000","last_peered":"2023-11-18T19:25:03.554068+0000","last_clean":"2023-11-18T19:25:03.554068+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:25:03.554068+0000","last_undegraded":"2023-11-18T19:25:03.554068+0000","last_fullsized":"2023-11-18T19:25:03.554068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4639","last_scrub_stamp":"2023-11-18T19:25:03.553986+0000","last_deep_scrub":"29'4639","last_deep_scrub_stamp":"2023-11-18T19:25:03.553986+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.553986+0000","objects_scrubbed":2293,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:19.628587+0000","scrub_duration":1.600373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38511782,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6251,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'1674","reported_seq":1736,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.367244+0000","last_change":"2023-11-18T19:24:36.367314+0000","last_active":"2023-11-18T19:24:36.367244+0000","last_peered":"2023-11-18T19:24:36.367244+0000","last_clean":"2023-11-18T19:24:36.367244+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:36.367244+0000","last_undegraded":"2023-11-18T19:24:36.367244+0000","last_fullsized":"2023-11-18T19:24:36.367244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1674","last_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_deep_scrub":"29'1674","last_deep_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.367175+0000","objects_scrubbed":749,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:16.832308+0000","scrub_duration":0.77027508200000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":749,"num_object_clones":0,"num_object_copies":1498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'1755","reported_seq":1818,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.422452+0000","last_change":"2023-11-18T19:24:51.422509+0000","last_active":"2023-11-18T19:24:51.422452+0000","last_peered":"2023-11-18T19:24:51.422452+0000","last_clean":"2023-11-18T19:24:51.422452+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:51.422452+0000","last_undegraded":"2023-11-18T19:24:51.422452+0000","last_fullsized":"2023-11-18T19:24:51.422452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1755","last_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_deep_scrub":"29'1755","last_deep_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.422369+0000","objects_scrubbed":772,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:34:08.088915+0000","scrub_duration":0.69839206799999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":846,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'1665","reported_seq":1729,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.392072+0000","last_change":"2023-11-18T19:24:47.392170+0000","last_active":"2023-11-18T19:24:47.392072+0000","last_peered":"2023-11-18T19:24:47.392072+0000","last_clean":"2023-11-18T19:24:47.392072+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:47.392072+0000","last_undegraded":"2023-11-18T19:24:47.392072+0000","last_fullsized":"2023-11-18T19:24:47.392072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1665","last_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_deep_scrub":"29'1665","last_deep_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.391954+0000","objects_scrubbed":747,"log_size":1665,"log_dups_size":0,"ondisk_log_size":1665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:28.856279+0000","scrub_duration":1.3015815769999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'1697","reported_seq":1761,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.060639+0000","last_change":"2023-11-18T19:24:37.060679+0000","last_active":"2023-11-18T19:24:37.060639+0000","last_peered":"2023-11-18T19:24:37.060639+0000","last_clean":"2023-11-18T19:24:37.060639+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:37.060639+0000","last_undegraded":"2023-11-18T19:24:37.060639+0000","last_fullsized":"2023-11-18T19:24:37.060639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1697","last_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_deep_scrub":"29'1697","last_deep_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.060556+0000","objects_scrubbed":776,"log_size":1697,"log_dups_size":0,"ondisk_log_size":1697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:32.193085+0000","scrub_duration":0.65753342699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'1757","reported_seq":1823,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:02.472378+0000","last_change":"2023-11-18T19:25:02.472417+0000","last_active":"2023-11-18T19:25:02.472378+0000","last_peered":"2023-11-18T19:25:02.472378+0000","last_clean":"2023-11-18T19:25:02.472378+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:25:02.472378+0000","last_undegraded":"2023-11-18T19:25:02.472378+0000","last_fullsized":"2023-11-18T19:25:02.472378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1757","last_scrub_stamp":"2023-11-18T19:25:02.472285+0000","last_deep_scrub":"29'1757","last_deep_scrub_stamp":"2023-11-18T19:25:02.472285+0000","last_clean_scrub_stamp":"2023-11-18T19:25:02.472285+0000","objects_scrubbed":776,"log_size":1757,"log_dups_size":0,"ondisk_log_size":1757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:48:00.760826+0000","scrub_duration":1.028693885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'1717","reported_seq":1781,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.102506+0000","last_change":"2023-11-18T19:25:00.102551+0000","last_active":"2023-11-18T19:25:00.102506+0000","last_peered":"2023-11-18T19:25:00.102506+0000","last_clean":"2023-11-18T19:25:00.102506+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:25:00.102506+0000","last_undegraded":"2023-11-18T19:25:00.102506+0000","last_fullsized":"2023-11-18T19:25:00.102506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1717","last_scrub_stamp":"2023-11-18T19:25:00.102415+0000","last_deep_scrub":"29'1717","last_deep_scrub_stamp":"2023-11-18T19:25:00.102415+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.102415+0000","objects_scrubbed":756,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:35.093032+0000","scrub_duration":0.69076674599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":802,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'1737","reported_seq":1801,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.490923+0000","last_change":"2023-11-18T19:24:39.490959+0000","last_active":"2023-11-18T19:24:39.490923+0000","last_peered":"2023-11-18T19:24:39.490923+0000","last_clean":"2023-11-18T19:24:39.490923+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:39.490923+0000","last_undegraded":"2023-11-18T19:24:39.490923+0000","last_fullsized":"2023-11-18T19:24:39.490923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1737","last_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_deep_scrub":"29'1737","last_deep_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.490839+0000","objects_scrubbed":775,"log_size":1737,"log_dups_size":0,"ondisk_log_size":1737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:03.420048+0000","scrub_duration":0.91801021400000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'1673","reported_seq":1734,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:05.481509+0000","last_change":"2023-11-18T19:25:05.481556+0000","last_active":"2023-11-18T19:25:05.481509+0000","last_peered":"2023-11-18T19:25:05.481509+0000","last_clean":"2023-11-18T19:25:05.481509+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:25:05.481509+0000","last_undegraded":"2023-11-18T19:25:05.481509+0000","last_fullsized":"2023-11-18T19:25:05.481509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1673","last_scrub_stamp":"2023-11-18T19:25:05.481414+0000","last_deep_scrub":"29'1673","last_deep_scrub_stamp":"2023-11-18T19:25:05.481414+0000","last_clean_scrub_stamp":"2023-11-18T19:25:05.481414+0000","objects_scrubbed":716,"log_size":1673,"log_dups_size":0,"ondisk_log_size":1673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:39.914118+0000","scrub_duration":0.96291879400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'1670","reported_seq":1734,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.792839+0000","last_change":"2023-11-18T19:24:36.792888+0000","last_active":"2023-11-18T19:24:36.792839+0000","last_peered":"2023-11-18T19:24:36.792839+0000","last_clean":"2023-11-18T19:24:36.792839+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:36.792839+0000","last_undegraded":"2023-11-18T19:24:36.792839+0000","last_fullsized":"2023-11-18T19:24:36.792839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.792770+0000","objects_scrubbed":756,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:19.320316+0000","scrub_duration":0.74211921199999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'1695","reported_seq":1758,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.293584+0000","last_change":"2023-11-18T19:24:54.293629+0000","last_active":"2023-11-18T19:24:54.293584+0000","last_peered":"2023-11-18T19:24:54.293584+0000","last_clean":"2023-11-18T19:24:54.293584+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:54.293584+0000","last_undegraded":"2023-11-18T19:24:54.293584+0000","last_fullsized":"2023-11-18T19:24:54.293584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1695","last_scrub_stamp":"2023-11-18T19:24:54.293491+0000","last_deep_scrub":"29'1695","last_deep_scrub_stamp":"2023-11-18T19:24:54.293491+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.293491+0000","objects_scrubbed":762,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:27:51.707645+0000","scrub_duration":0.87214751400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":762,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1670","reported_seq":1733,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.259703+0000","last_change":"2023-11-18T19:24:39.259703+0000","last_active":"2023-11-18T19:24:39.259703+0000","last_peered":"2023-11-18T19:24:39.259703+0000","last_clean":"2023-11-18T19:24:39.259703+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:39.259703+0000","last_undegraded":"2023-11-18T19:24:39.259703+0000","last_fullsized":"2023-11-18T19:24:39.259703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.259562+0000","objects_scrubbed":757,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:51.163210+0000","scrub_duration":0.86967187400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":757,"num_object_clones":0,"num_object_copies":1514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'1773","reported_seq":1838,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:58.604255+0000","last_change":"2023-11-18T19:24:58.604299+0000","last_active":"2023-11-18T19:24:58.604255+0000","last_peered":"2023-11-18T19:24:58.604255+0000","last_clean":"2023-11-18T19:24:58.604255+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:58.604255+0000","last_undegraded":"2023-11-18T19:24:58.604255+0000","last_fullsized":"2023-11-18T19:24:58.604255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1773","last_scrub_stamp":"2023-11-18T19:24:58.604157+0000","last_deep_scrub":"29'1773","last_deep_scrub_stamp":"2023-11-18T19:24:58.604157+0000","last_clean_scrub_stamp":"2023-11-18T19:24:58.604157+0000","objects_scrubbed":780,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:40.068483+0000","scrub_duration":0.69858347499999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":780,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'1686","reported_seq":1749,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:28.333003+0000","last_change":"2023-11-18T19:24:28.333003+0000","last_active":"2023-11-18T19:24:28.333003+0000","last_peered":"2023-11-18T19:24:28.333003+0000","last_clean":"2023-11-18T19:24:28.333003+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:28.333003+0000","last_undegraded":"2023-11-18T19:24:28.333003+0000","last_fullsized":"2023-11-18T19:24:28.333003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1686","last_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_deep_scrub":"29'1686","last_deep_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_clean_scrub_stamp":"2023-11-18T19:24:28.332899+0000","objects_scrubbed":752,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:08.798032+0000","scrub_duration":0.58671065600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'999","reported_seq":1025,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:29.872447+0000","last_change":"2023-11-18T19:06:37.583127+0000","last_active":"2023-11-18T19:24:29.872447+0000","last_peered":"2023-11-18T19:24:29.872447+0000","last_clean":"2023-11-18T19:24:29.872447+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:24:29.872447+0000","last_undegraded":"2023-11-18T19:24:29.872447+0000","last_fullsized":"2023-11-18T19:24:29.872447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'1634","reported_seq":1696,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:52.440493+0000","last_change":"2023-11-18T19:24:52.440530+0000","last_active":"2023-11-18T19:24:52.440493+0000","last_peered":"2023-11-18T19:24:52.440493+0000","last_clean":"2023-11-18T19:24:52.440493+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:52.440493+0000","last_undegraded":"2023-11-18T19:24:52.440493+0000","last_fullsized":"2023-11-18T19:24:52.440493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1634","last_scrub_stamp":"2023-11-18T19:24:52.440420+0000","last_deep_scrub":"29'1634","last_deep_scrub_stamp":"2023-11-18T19:24:52.440420+0000","last_clean_scrub_stamp":"2023-11-18T19:24:52.440420+0000","objects_scrubbed":747,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:46.497947+0000","scrub_duration":0.66661862599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1748","reported_seq":1813,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.744348+0000","last_change":"2023-11-18T19:24:33.744380+0000","last_active":"2023-11-18T19:24:33.744348+0000","last_peered":"2023-11-18T19:24:33.744348+0000","last_clean":"2023-11-18T19:24:33.744348+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:33.744348+0000","last_undegraded":"2023-11-18T19:24:33.744348+0000","last_fullsized":"2023-11-18T19:24:33.744348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.744286+0000","objects_scrubbed":806,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:19.817171+0000","scrub_duration":0.70702235400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":806,"num_object_clones":0,"num_object_copies":1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'1632","reported_seq":1694,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.957901+0000","last_change":"2023-11-18T19:24:53.957946+0000","last_active":"2023-11-18T19:24:53.957901+0000","last_peered":"2023-11-18T19:24:53.957901+0000","last_clean":"2023-11-18T19:24:53.957901+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:53.957901+0000","last_undegraded":"2023-11-18T19:24:53.957901+0000","last_fullsized":"2023-11-18T19:24:53.957901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1632","last_scrub_stamp":"2023-11-18T19:24:53.957803+0000","last_deep_scrub":"29'1632","last_deep_scrub_stamp":"2023-11-18T19:24:53.957803+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.957803+0000","objects_scrubbed":727,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:47.399466+0000","scrub_duration":0.71560208599999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":727,"num_object_clones":0,"num_object_copies":1454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'1779","reported_seq":1842,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.184114+0000","last_change":"2023-11-18T19:24:59.184163+0000","last_active":"2023-11-18T19:24:59.184114+0000","last_peered":"2023-11-18T19:24:59.184114+0000","last_clean":"2023-11-18T19:24:59.184114+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:59.184114+0000","last_undegraded":"2023-11-18T19:24:59.184114+0000","last_fullsized":"2023-11-18T19:24:59.184114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1779","last_scrub_stamp":"2023-11-18T19:24:59.184039+0000","last_deep_scrub":"29'1779","last_deep_scrub_stamp":"2023-11-18T19:24:59.184039+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.184039+0000","objects_scrubbed":782,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:41.528746+0000","scrub_duration":0.67582518400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'1668","reported_seq":1731,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.545597+0000","last_change":"2023-11-18T19:24:57.545635+0000","last_active":"2023-11-18T19:24:57.545597+0000","last_peered":"2023-11-18T19:24:57.545597+0000","last_clean":"2023-11-18T19:24:57.545597+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:57.545597+0000","last_undegraded":"2023-11-18T19:24:57.545597+0000","last_fullsized":"2023-11-18T19:24:57.545597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1668","last_scrub_stamp":"2023-11-18T19:24:57.545516+0000","last_deep_scrub":"29'1668","last_deep_scrub_stamp":"2023-11-18T19:24:57.545516+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.545516+0000","objects_scrubbed":730,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:08:03.673346+0000","scrub_duration":1.09599454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'1655","reported_seq":1718,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.314040+0000","last_change":"2023-11-18T19:24:41.314085+0000","last_active":"2023-11-18T19:24:41.314040+0000","last_peered":"2023-11-18T19:24:41.314040+0000","last_clean":"2023-11-18T19:24:41.314040+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:41.314040+0000","last_undegraded":"2023-11-18T19:24:41.314040+0000","last_fullsized":"2023-11-18T19:24:41.314040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1655","last_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_deep_scrub":"29'1655","last_deep_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.313951+0000","objects_scrubbed":761,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:17.258394+0000","scrub_duration":0.75370882100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":761,"num_object_clones":0,"num_object_copies":1522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'1674","reported_seq":1735,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.192667+0000","last_change":"2023-11-18T19:24:55.192727+0000","last_active":"2023-11-18T19:24:55.192667+0000","last_peered":"2023-11-18T19:24:55.192667+0000","last_clean":"2023-11-18T19:24:55.192667+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:55.192667+0000","last_undegraded":"2023-11-18T19:24:55.192667+0000","last_fullsized":"2023-11-18T19:24:55.192667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1674","last_scrub_stamp":"2023-11-18T19:24:55.192587+0000","last_deep_scrub":"29'1674","last_deep_scrub_stamp":"2023-11-18T19:24:55.192587+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.192587+0000","objects_scrubbed":741,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:27.828033+0000","scrub_duration":0.638862241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":741,"num_object_clones":0,"num_object_copies":1482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'1710","reported_seq":1772,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.315963+0000","last_change":"2023-11-18T19:25:03.315984+0000","last_active":"2023-11-18T19:25:03.315963+0000","last_peered":"2023-11-18T19:25:03.315963+0000","last_clean":"2023-11-18T19:25:03.315963+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:25:03.315963+0000","last_undegraded":"2023-11-18T19:25:03.315963+0000","last_fullsized":"2023-11-18T19:25:03.315963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1710","last_scrub_stamp":"2023-11-18T19:25:03.315896+0000","last_deep_scrub":"29'1710","last_deep_scrub_stamp":"2023-11-18T19:25:03.315896+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.315896+0000","objects_scrubbed":750,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:45.396635+0000","scrub_duration":0.69759861199999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'1680","reported_seq":1741,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.425442+0000","last_change":"2023-11-18T19:25:04.425501+0000","last_active":"2023-11-18T19:25:04.425442+0000","last_peered":"2023-11-18T19:25:04.425442+0000","last_clean":"2023-11-18T19:25:04.425442+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:25:04.425442+0000","last_undegraded":"2023-11-18T19:25:04.425442+0000","last_fullsized":"2023-11-18T19:25:04.425442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1680","last_scrub_stamp":"2023-11-18T19:25:04.425376+0000","last_deep_scrub":"29'1680","last_deep_scrub_stamp":"2023-11-18T19:25:04.425376+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.425376+0000","objects_scrubbed":738,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:57.867038+0000","scrub_duration":0.76522294899999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":738,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'1755","reported_seq":1819,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.062243+0000","last_change":"2023-11-18T19:24:53.062289+0000","last_active":"2023-11-18T19:24:53.062243+0000","last_peered":"2023-11-18T19:24:53.062243+0000","last_clean":"2023-11-18T19:24:53.062243+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:53.062243+0000","last_undegraded":"2023-11-18T19:24:53.062243+0000","last_fullsized":"2023-11-18T19:24:53.062243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1755","last_scrub_stamp":"2023-11-18T19:24:53.062146+0000","last_deep_scrub":"29'1755","last_deep_scrub_stamp":"2023-11-18T19:24:53.062146+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.062146+0000","objects_scrubbed":779,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:16.991355+0000","scrub_duration":0.76329819099999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'1609","reported_seq":1670,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.191904+0000","last_change":"2023-11-18T19:24:41.191959+0000","last_active":"2023-11-18T19:24:41.191904+0000","last_peered":"2023-11-18T19:24:41.191904+0000","last_clean":"2023-11-18T19:24:41.191904+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:41.191904+0000","last_undegraded":"2023-11-18T19:24:41.191904+0000","last_fullsized":"2023-11-18T19:24:41.191904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1609","last_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_deep_scrub":"29'1609","last_deep_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.191821+0000","objects_scrubbed":748,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:18.742555+0000","scrub_duration":0.72283178699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":748,"num_object_clones":0,"num_object_copies":1496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'1660","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.717494+0000","last_change":"2023-11-18T19:24:34.717527+0000","last_active":"2023-11-18T19:24:34.717494+0000","last_peered":"2023-11-18T19:24:34.717494+0000","last_clean":"2023-11-18T19:24:34.717494+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:34.717494+0000","last_undegraded":"2023-11-18T19:24:34.717494+0000","last_fullsized":"2023-11-18T19:24:34.717494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1660","last_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_deep_scrub":"29'1660","last_deep_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.717426+0000","objects_scrubbed":755,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.869959+0000","scrub_duration":1.054464544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":755,"num_object_clones":0,"num_object_copies":1510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'1550","reported_seq":1610,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.576796+0000","last_change":"2023-11-18T19:24:40.576837+0000","last_active":"2023-11-18T19:24:40.576796+0000","last_peered":"2023-11-18T19:24:40.576796+0000","last_clean":"2023-11-18T19:24:40.576796+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:40.576796+0000","last_undegraded":"2023-11-18T19:24:40.576796+0000","last_fullsized":"2023-11-18T19:24:40.576796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1550","last_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_deep_scrub":"29'1550","last_deep_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.576715+0000","objects_scrubbed":702,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.709244+0000","scrub_duration":0.96416932899999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":702,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'1788","reported_seq":1851,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.428070+0000","last_change":"2023-11-18T19:24:54.428126+0000","last_active":"2023-11-18T19:24:54.428070+0000","last_peered":"2023-11-18T19:24:54.428070+0000","last_clean":"2023-11-18T19:24:54.428070+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:54.428070+0000","last_undegraded":"2023-11-18T19:24:54.428070+0000","last_fullsized":"2023-11-18T19:24:54.428070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1788","last_scrub_stamp":"2023-11-18T19:24:54.427981+0000","last_deep_scrub":"29'1788","last_deep_scrub_stamp":"2023-11-18T19:24:54.427981+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.427981+0000","objects_scrubbed":782,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:35.216202+0000","scrub_duration":0.90968989499999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'1642","reported_seq":1705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:32.764155+0000","last_change":"2023-11-18T19:24:32.764235+0000","last_active":"2023-11-18T19:24:32.764155+0000","last_peered":"2023-11-18T19:24:32.764155+0000","last_clean":"2023-11-18T19:24:32.764155+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:32.764155+0000","last_undegraded":"2023-11-18T19:24:32.764155+0000","last_fullsized":"2023-11-18T19:24:32.764155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1642","last_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_deep_scrub":"29'1642","last_deep_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_clean_scrub_stamp":"2023-11-18T19:24:32.764034+0000","objects_scrubbed":744,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:09:02.008162+0000","scrub_duration":1.1096721409999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":744,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'1732","reported_seq":1797,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.250918+0000","last_change":"2023-11-18T19:24:36.250918+0000","last_active":"2023-11-18T19:24:36.250918+0000","last_peered":"2023-11-18T19:24:36.250918+0000","last_clean":"2023-11-18T19:24:36.250918+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:36.250918+0000","last_undegraded":"2023-11-18T19:24:36.250918+0000","last_fullsized":"2023-11-18T19:24:36.250918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1732","last_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_deep_scrub":"29'1732","last_deep_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.250801+0000","objects_scrubbed":789,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:00.180010+0000","scrub_duration":0.83764093900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'1659","reported_seq":1720,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.184578+0000","last_change":"2023-11-18T19:25:03.184647+0000","last_active":"2023-11-18T19:25:03.184578+0000","last_peered":"2023-11-18T19:25:03.184578+0000","last_clean":"2023-11-18T19:25:03.184578+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:25:03.184578+0000","last_undegraded":"2023-11-18T19:25:03.184578+0000","last_fullsized":"2023-11-18T19:25:03.184578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:25:03.184485+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:25:03.184485+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.184485+0000","objects_scrubbed":718,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:45.265223+0000","scrub_duration":0.698566562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'918","reported_seq":943,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:26.853070+0000","last_change":"2023-11-18T19:06:37.583289+0000","last_active":"2023-11-18T19:24:26.853070+0000","last_peered":"2023-11-18T19:24:26.853070+0000","last_clean":"2023-11-18T19:24:26.853070+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:24:26.853070+0000","last_undegraded":"2023-11-18T19:24:26.853070+0000","last_fullsized":"2023-11-18T19:24:26.853070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:37.009313+0000","last_clean_scrub_stamp":"2023-11-18T19:06:37.009313+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1532356433,"num_objects":72339,"num_object_clones":0,"num_object_copies":289356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72339,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":196167,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2809622528,"data_stored":3820519424,"data_compressed":666760082,"data_compressed_allocated":793534464,"data_compressed_original":1804431360,"omap_allocated":0,"internal_metadata":0},"log_size":145913,"ondisk_log_size":145913,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":48368,"num_object_clones":0,"num_object_copies":96736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51796,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104733,"ondisk_log_size":104733,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":252317078,"num_objects":3097,"num_object_clones":0,"num_object_copies":6194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3097,"num_whiteouts":0,"num_read":864,"num_read_kb":1816,"num_write":23621,"num_write_kb":732017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27291673,"num_omap_keys":47151,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133529600,"data_stored":504634156,"data_compressed":78941764,"data_compressed_allocated":97574912,"data_compressed_original":468738048,"omap_allocated":0,"internal_metadata":0},"log_size":19920,"ondisk_log_size":19920,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509665,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":647720,"kb_used_data":373600,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93724120,"statfs":{"total":96636764160,"available":95973498880,"internally_reserved":0,"allocated":382566400,"data_stored":576987954,"data_compressed":102256610,"data_compressed_allocated":122839040,"data_compressed_original":317444096,"omap_allocated":1594,"internal_metadata":280689094},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":4.3849999999999998,"15min":4.827},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.372},"max":{"1min":3.629,"5min":248.00800000000001,"15min":248.00800000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":2.5150000000000001,"5min":4.8040000000000003,"15min":5.1310000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":36.765000000000001,"5min":175.095,"15min":384.19499999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":2.012,"5min":2.6539999999999999,"15min":4.1429999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.47099999999999997},"max":{"1min":17.283000000000001,"5min":53.398000000000003,"15min":199.179},"last":1.6180000000000001},{"interface":"front","average":{"1min":2.7090000000000001,"5min":4.891,"15min":5.3810000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":36.957999999999998,"5min":175.06800000000001,"15min":384.09699999999998},"last":1.1559999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.7689999999999999,"15min":3.2519999999999998},"min":{"1min":0.46800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3999999999999999,"5min":14.175000000000001,"15min":207.149},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.452,"5min":2.5569999999999999,"15min":5.5},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.47299999999999998},"max":{"1min":3.7149999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":1.2609999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":2.766,"5min":4.9169999999999998,"15min":5.7839999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":36.813000000000002,"5min":175.02600000000001,"15min":384.04700000000003},"last":1.5049999999999999},{"interface":"front","average":{"1min":2.9100000000000001,"5min":2.649,"15min":3.5129999999999999},"min":{"1min":0.497,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":40.716000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":1.3440000000000001}]},{"osd":4,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":3.0259999999999998,"15min":5.0039999999999996},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.38100000000000001},"max":{"1min":4.4569999999999999,"5min":86.346999999999994,"15min":199.393},"last":0.98999999999999999},{"interface":"front","average":{"1min":2.8450000000000002,"5min":5.6020000000000003,"15min":6.649},"min":{"1min":0.56100000000000005,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":36.926000000000002,"5min":204.786,"15min":384.161},"last":1.282}]},{"osd":5,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":3.0339999999999998,"15min":4.4459999999999997},"min":{"1min":0.54100000000000004,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":5.5970000000000004,"5min":79.472999999999999,"15min":220.36500000000001},"last":1.653},{"interface":"front","average":{"1min":3.9540000000000002,"5min":5.4160000000000004,"15min":5.7309999999999999},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":48.290999999999997,"5min":160.107,"15min":212.68100000000001},"last":1.125}]},{"osd":7,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":3.0640000000000001,"5min":5.4130000000000003,"15min":9.0169999999999995},"min":{"1min":0.59999999999999998,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":36.984999999999999,"5min":205.01400000000001,"15min":410.60000000000002},"last":1.3979999999999999},{"interface":"front","average":{"1min":2.2709999999999999,"5min":2.6760000000000002,"15min":4.069},"min":{"1min":0.52500000000000002,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":19.361999999999998,"5min":28.329999999999998,"15min":207.85300000000001},"last":1.458}]}]},{"osd":5,"up_from":15,"seq":64424509666,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":612080,"kb_used_data":328232,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93759760,"statfs":{"total":96636764160,"available":96009994240,"internally_reserved":0,"allocated":336109568,"data_stored":505605510,"data_compressed":82941676,"data_compressed_allocated":99913728,"data_compressed_original":269606912,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":2.0310000000000001,"15min":4.3639999999999999},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":56.268000000000001,"5min":56.268000000000001,"15min":248.32400000000001},"last":1.462},{"interface":"front","average":{"1min":1.077,"5min":1.3640000000000001,"15min":2.7869999999999999},"min":{"1min":0.54400000000000004,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.4369999999999998,"5min":8.7650000000000006,"15min":93.090999999999994},"last":0.753}]},{"osd":1,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.677,"15min":5.3970000000000002},"min":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.47899999999999998},"max":{"1min":10.644,"5min":14.673999999999999,"15min":335.11799999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":3.948,"5min":2.3490000000000002,"15min":4.1020000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.432},"max":{"1min":56.345999999999997,"5min":56.345999999999997,"15min":278.17700000000002},"last":1.095}]},{"osd":2,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.0899999999999999,"15min":3.6110000000000002},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":26.256,"5min":36.954999999999998,"15min":144.68700000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.774,"15min":3.738},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.52800000000000002},"max":{"1min":10.755000000000001,"5min":14.731999999999999,"15min":247.267},"last":1.5900000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.714,"15min":4.8310000000000004},"min":{"1min":0.61599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":10.880000000000001,"5min":12.032,"15min":207.93799999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.869,"15min":4.5540000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.53300000000000003},"max":{"1min":10.718999999999999,"5min":14.769,"15min":265.82600000000002},"last":1.6739999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.911,"5min":2.391,"15min":4.75},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42199999999999999},"max":{"1min":55.738999999999997,"5min":55.738999999999997,"15min":303.19200000000001},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.71,"15min":4.6909999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2960000000000003,"5min":12.207000000000001,"15min":210.78899999999999},"last":0.94599999999999995}]},{"osd":6,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":2.2709999999999999,"15min":6.6790000000000003},"min":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":10.686999999999999,"5min":41.378,"15min":308.47500000000002},"last":1.52},{"interface":"front","average":{"1min":4.0529999999999999,"5min":2.577,"15min":4.2599999999999998},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.34000000000000002},"max":{"1min":56.228999999999999,"5min":56.228999999999999,"15min":303.23599999999999},"last":1.2809999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.2610000000000001,"15min":5.2809999999999997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.41199999999999998},"max":{"1min":13.352,"5min":19.742000000000001,"15min":252.18299999999999},"last":1.417},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.0249999999999999,"15min":4.8789999999999996},"min":{"1min":0.56000000000000005,"5min":0.51300000000000001,"15min":0.437},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":309.029},"last":1.135}]}]},{"osd":4,"up_from":15,"seq":64424509666,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":573868,"kb_used_data":321956,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93797972,"statfs":{"total":96636764160,"available":96049123328,"internally_reserved":0,"allocated":329682944,"data_stored":506103922,"data_compressed":93249446,"data_compressed_allocated":112369664,"data_compressed_original":288989184,"omap_allocated":1592,"internal_metadata":257948104},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":3.1030000000000002,"15min":2.657},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":23.077999999999999,"5min":51.582999999999998,"15min":58.200000000000003},"last":1.8799999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":2.3109999999999999,"15min":2.3490000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.4510000000000001,"5min":56.402999999999999,"15min":56.402999999999999},"last":1.04}]},{"osd":1,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.9470000000000001,"5min":2.302,"15min":2.3260000000000001},"min":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":25.114999999999998,"5min":27.18,"15min":36.024999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":2.23,"5min":3.3540000000000001,"15min":2.7949999999999999},"min":{"1min":0.72399999999999998,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":22.565999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":2.2669999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":2.669,"15min":2.633},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":16.777000000000001,"5min":56.494,"15min":56.494},"last":1.403},{"interface":"front","average":{"1min":4.1509999999999998,"5min":2.9129999999999998,"15min":2.7810000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":52.454000000000001,"5min":52.454000000000001,"15min":52.454000000000001},"last":1.448}]},{"osd":3,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":3.0659999999999998,"15min":2.9329999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":3.7599999999999998,"5min":51.643000000000001,"15min":58.039999999999999},"last":2.1549999999999998},{"interface":"front","average":{"1min":1.214,"5min":2.5910000000000002,"15min":2.75},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.46500000000000002},"max":{"1min":2.734,"5min":56.530999999999999,"15min":56.530999999999999},"last":1.5600000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.9079999999999999,"5min":4.1920000000000002,"15min":3.8039999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33200000000000002},"max":{"1min":46.289999999999999,"5min":68.007000000000005,"15min":68.007000000000005},"last":1.3460000000000001},{"interface":"front","average":{"1min":2.4990000000000001,"5min":4.2190000000000003,"15min":3.9049999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":34.197000000000003,"5min":72.611000000000004,"15min":72.611000000000004},"last":2.3730000000000002}]},{"osd":6,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.5409999999999999,"5min":4.3159999999999998,"15min":4.0389999999999997},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":59.960999999999999,"5min":72.915999999999997,"15min":161.898},"last":1.696},{"interface":"front","average":{"1min":3.9079999999999999,"5min":5.9870000000000001,"15min":4.859},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":45.710000000000001,"5min":105.387,"15min":163.33600000000001},"last":1.9690000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":4.0970000000000004,"15min":4.181},"min":{"1min":0.58899999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":22.099,"5min":66.341999999999999,"15min":66.341999999999999},"last":2.4870000000000001},{"interface":"front","average":{"1min":1.915,"5min":3.484,"15min":4.1050000000000004},"min":{"1min":0.629,"5min":0.435,"15min":0.435},"max":{"1min":16.263000000000002,"5min":56.454000000000001,"15min":66.665000000000006},"last":1.8180000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509667,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":728304,"kb_used_data":422312,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93643536,"statfs":{"total":96636764160,"available":95890980864,"internally_reserved":0,"allocated":432447488,"data_stored":638154104,"data_compressed":111010512,"data_compressed_allocated":131817472,"data_compressed_original":337711104,"omap_allocated":1593,"internal_metadata":313326023},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":1.163,"15min":1.27},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":17.715,"5min":17.715,"15min":44.363},"last":1.851},{"interface":"front","average":{"1min":5.4930000000000003,"5min":2.3170000000000002,"15min":2.278},"min":{"1min":0.38800000000000001,"5min":0.28899999999999998,"15min":0.27600000000000002},"max":{"1min":75.558000000000007,"5min":75.558000000000007,"15min":75.558000000000007},"last":1.1739999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":9.0980000000000008,"5min":3.0009999999999999,"15min":3.718},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.26900000000000002},"max":{"1min":145.65000000000001,"5min":145.65000000000001,"15min":202.65000000000001},"last":1.927},{"interface":"front","average":{"1min":6.2130000000000001,"5min":2.4449999999999998,"15min":2.9020000000000001},"min":{"1min":0.44500000000000001,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":75.587000000000003,"5min":75.587000000000003,"15min":114.221},"last":0.95799999999999996}]},{"osd":2,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":2.8359999999999999,"5min":1.6699999999999999,"15min":1.706},"min":{"1min":0.504,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":28.433,"5min":28.433,"15min":43.747999999999998},"last":1.262},{"interface":"front","average":{"1min":5.7069999999999999,"5min":2.4910000000000001,"15min":2.6869999999999998},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":75.483999999999995,"5min":75.483999999999995,"15min":75.483999999999995},"last":2.2280000000000002}]},{"osd":4,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":3.0649999999999999,"15min":4.6760000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.48799999999999999},"max":{"1min":89.465000000000003,"5min":89.465000000000003,"15min":202.821},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.8320000000000001,"15min":3.2909999999999999},"min":{"1min":0.84399999999999997,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":8.0380000000000003,"5min":23.635000000000002,"15min":234.68700000000001},"last":1.7330000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":4.5199999999999996,"5min":3.4620000000000002,"15min":4.5709999999999997},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":48.381,"5min":57.360999999999997,"15min":190.827},"last":1.413},{"interface":"front","average":{"1min":17.562000000000001,"5min":6.3959999999999999,"15min":5.8079999999999998},"min":{"1min":0.66300000000000003,"5min":0.58199999999999996,"15min":0.56399999999999995},"max":{"1min":275.89699999999999,"5min":275.89699999999999,"15min":275.89699999999999},"last":2.1659999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":4.218,"5min":3.5179999999999998,"15min":3.262},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.46800000000000003},"max":{"1min":39.098999999999997,"5min":89.710999999999999,"15min":89.710999999999999},"last":1.548},{"interface":"front","average":{"1min":6.9660000000000002,"5min":3.6960000000000002,"15min":4.3449999999999998},"min":{"1min":0.75,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":89.509,"5min":89.509,"15min":202.78299999999999},"last":2.2989999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":6.1050000000000004,"5min":3.3799999999999999,"15min":4.5279999999999996},"min":{"1min":0.92100000000000004,"5min":0.745,"15min":0.61199999999999999},"max":{"1min":75.525000000000006,"5min":75.525000000000006,"15min":82.248000000000005},"last":1.776},{"interface":"front","average":{"1min":7.9080000000000004,"5min":4.9080000000000004,"15min":6.5270000000000001},"min":{"1min":0.82499999999999996,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":81.777000000000001,"5min":113.44,"15min":233.44800000000001},"last":2.4449999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":608612,"kb_used_data":342812,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93763228,"statfs":{"total":96636764160,"available":96013545472,"internally_reserved":0,"allocated":351039488,"data_stored":491214290,"data_compressed":86308112,"data_compressed_allocated":101842944,"data_compressed_original":242208768,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.4630000000000001,"15min":2.0910000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":13.442,"5min":83.817999999999998,"15min":83.817999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":4.0899999999999999,"5min":3.044,"15min":3.694},"min":{"1min":0.53500000000000003,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":37.145000000000003,"5min":83.266999999999996,"15min":248.16999999999999},"last":1.4730000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":1.9370000000000001,"15min":1.8999999999999999},"min":{"1min":0.59099999999999997,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":8.2210000000000001,"5min":19.004999999999999,"15min":30.504999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":4.085,"5min":2.7229999999999999,"15min":3.5699999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":31.68,"5min":47.768999999999998,"15min":255.315},"last":1.597}]},{"osd":3,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.3250000000000002,"5min":2.5830000000000002,"15min":2.2229999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.315},"max":{"1min":35.741,"5min":35.741,"15min":84.840999999999994},"last":1.008},{"interface":"front","average":{"1min":5.9039999999999999,"5min":3.0510000000000002,"15min":3.0939999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.36599999999999999},"max":{"1min":77.317999999999998,"5min":77.317999999999998,"15min":128.976},"last":1.4330000000000001}]},{"osd":4,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.0609999999999999,"5min":3.4580000000000002,"15min":5.109},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":37.213999999999999,"5min":47.432000000000002,"15min":255.25700000000001},"last":1.6479999999999999},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.6099999999999999,"15min":3.5790000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.48299999999999998},"max":{"1min":19.753,"5min":34.531999999999996,"15min":128.655},"last":1.171}]},{"osd":5,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":8.9760000000000009,"5min":5.0700000000000003,"15min":5.2599999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":82.197000000000003,"5min":138.905,"15min":153.417},"last":1.526},{"interface":"front","average":{"1min":7.2789999999999999,"5min":4.5439999999999996,"15min":6.0229999999999997},"min":{"1min":0.89300000000000002,"5min":0.77100000000000002,"15min":0.53300000000000003},"max":{"1min":37.183999999999997,"5min":63.884,"15min":255.34899999999999},"last":1.6879999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4740000000000002,"5min":3.145,"15min":3.7229999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.55400000000000005},"max":{"1min":48.976999999999997,"5min":82.388999999999996,"15min":138.33099999999999},"last":1.397},{"interface":"front","average":{"1min":7.8410000000000002,"5min":4.9880000000000004,"15min":5.4820000000000002},"min":{"1min":0.85299999999999998,"5min":0.85099999999999998,"15min":0.61199999999999999},"max":{"1min":90.509,"5min":127.44799999999999,"15min":187.29599999999999},"last":1.5740000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":6.2919999999999998,"5min":5.0869999999999997,"15min":6.673},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.60899999999999999},"max":{"1min":34.777000000000001,"5min":81.165999999999997,"15min":211.17500000000001},"last":1.274},{"interface":"front","average":{"1min":5.6689999999999996,"5min":4.0910000000000002,"15min":5.0110000000000001},"min":{"1min":0.80300000000000005,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":49.033999999999999,"5min":72.992999999999995,"15min":173.53999999999999},"last":1.498}]}]},{"osd":1,"up_from":15,"seq":64424509667,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":709008,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93662832,"statfs":{"total":96636764160,"available":95910739968,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106231679,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.5860000000000001,"15min":1.49},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.22500000000000001},"max":{"1min":1.613,"5min":21.655999999999999,"15min":51.420999999999999},"last":0.437},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.71,"15min":1.744},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.255},"max":{"1min":1.8129999999999999,"5min":22.587,"15min":48.802999999999997},"last":0.93100000000000005}]},{"osd":2,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.7789999999999999,"15min":2.5750000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.308},"max":{"1min":2.6539999999999999,"5min":24.036999999999999,"15min":131.321},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.111,"5min":1.9359999999999999,"15min":1.6559999999999999},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.30499999999999999},"max":{"1min":1.7649999999999999,"5min":26.029,"15min":26.029},"last":0.372}]},{"osd":3,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":2.2280000000000002,"15min":2.7050000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.26700000000000002},"max":{"1min":1.8899999999999999,"5min":43.832999999999998,"15min":197.43899999999999},"last":0.498},{"interface":"front","average":{"1min":1.45,"5min":2.4140000000000001,"15min":2.5600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.32100000000000001},"max":{"1min":6.0140000000000002,"5min":54.316000000000003,"15min":156.316},"last":0.95899999999999996}]},{"osd":4,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9790000000000001,"5min":2.4199999999999999,"15min":3.4580000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.44800000000000001},"max":{"1min":32.771999999999998,"5min":48.799999999999997,"15min":159.84299999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":2.024,"5min":2.5990000000000002,"15min":3.198},"min":{"1min":0.629,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":12.879,"5min":28.405999999999999,"15min":62.978999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":3.504,"15min":3.3660000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.3090000000000002,"5min":107.88500000000001,"15min":107.88500000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.3050000000000002,"15min":3.1309999999999998},"min":{"1min":0.65400000000000003,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":2.2200000000000002,"5min":19.553999999999998,"15min":133.685},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":2.8450000000000002,"15min":3.613},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.3180000000000001,"5min":54.220999999999997,"15min":142.84100000000001},"last":1.274},{"interface":"front","average":{"1min":1.589,"5min":2.0899999999999999,"15min":3.734},"min":{"1min":0.82899999999999996,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":5.4800000000000004,"5min":23.998999999999999,"15min":146.69900000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":2.4889999999999999,"15min":2.7320000000000002},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.56299999999999994},"max":{"1min":2.117,"5min":31.096,"15min":35.783999999999999},"last":0.629},{"interface":"front","average":{"1min":1.4470000000000001,"5min":3.1589999999999998,"15min":3.3769999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2519999999999998,"5min":34.281999999999996,"15min":57.134999999999998},"last":1.3}]}]},{"osd":0,"up_from":15,"seq":64424509668,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":495820,"kb_used_data":248132,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93876020,"statfs":{"total":96636764160,"available":96129044480,"internally_reserved":0,"allocated":254087168,"data_stored":412922730,"data_compressed":68731359,"data_compressed_allocated":83857408,"data_compressed_original":242884608,"omap_allocated":1594,"internal_metadata":253622726},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.946,"15min":1.8220000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.21099999999999999},"max":{"1min":7.2350000000000003,"5min":30.565000000000001,"15min":74.326999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.272,"5min":2.1659999999999999,"15min":1.6379999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25700000000000001},"max":{"1min":7.0759999999999996,"5min":33.957999999999998,"15min":43.518000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":4.3739999999999997,"15min":2.375},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":12.465,"5min":181.27099999999999,"15min":181.27099999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.718,"5min":2.4740000000000002,"15min":1.8959999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.24099999999999999},"max":{"1min":8.3260000000000005,"5min":41.810000000000002,"15min":46.984999999999999},"last":1.7969999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.3769999999999998,"15min":1.865},"min":{"1min":0.433,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":9.2149999999999999,"5min":31.562000000000001,"15min":36.642000000000003},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":3.8780000000000001,"15min":2.5939999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.28799999999999998},"max":{"1min":6.1239999999999997,"5min":94.373000000000005,"15min":94.373000000000005},"last":1.1439999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":3.194,"5min":4.3159999999999998,"15min":3.4660000000000002},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":24.327000000000002,"5min":135.547,"15min":135.547},"last":0.81100000000000005},{"interface":"front","average":{"1min":3.2210000000000001,"5min":4.0640000000000001,"15min":3.488},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":25.25,"5min":131.07599999999999,"15min":131.07599999999999},"last":1.0369999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":3.6099999999999999,"5min":3.3599999999999999,"15min":2.8500000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.38700000000000001},"max":{"1min":44.682000000000002,"5min":63.134999999999998,"15min":63.134999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":3.375,"5min":3.5819999999999999,"15min":2.9470000000000001},"min":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":41.917999999999999,"5min":63.185000000000002,"15min":63.185000000000002},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":2.7909999999999999,"15min":3.6389999999999998},"min":{"1min":0.60499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":9.2720000000000002,"5min":105.974,"15min":203.92699999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":2.3410000000000002,"5min":4.0039999999999996,"15min":3.8919999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.42899999999999999},"max":{"1min":14.525,"5min":160.84700000000001,"15min":203.56899999999999},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.994,"5min":4.3250000000000002,"15min":3.113},"min":{"1min":0.66600000000000004,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":8.5739999999999998,"5min":91.418000000000006,"15min":91.418000000000006},"last":0.879},{"interface":"front","average":{"1min":4.4219999999999997,"5min":4.359,"15min":3.2389999999999999},"min":{"1min":0.68799999999999994,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":56.298000000000002,"5min":68.608000000000004,"15min":68.608000000000004},"last":1.077}]}]},{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":706664,"kb_used_data":418656,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93665176,"statfs":{"total":96636764160,"available":95913140224,"internally_reserved":0,"allocated":428703744,"data_stored":578550662,"data_compressed":95037478,"data_compressed_allocated":111271936,"data_compressed_original":261312512,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":3.395,"15min":4.492},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.0329999999999995,"5min":69.191999999999993,"15min":221.768},"last":1.101},{"interface":"front","average":{"1min":3.0720000000000001,"5min":3.4830000000000001,"15min":3.4430000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":36.235999999999997,"5min":63.854999999999997,"15min":93.781000000000006},"last":1.339}]},{"osd":1,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":3.512,"15min":4.3929999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.374},"max":{"1min":6.0030000000000001,"5min":69.061999999999998,"15min":221.715},"last":0.81299999999999994},{"interface":"front","average":{"1min":3.2509999999999999,"5min":3.605,"15min":3.5329999999999999},"min":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":36.430999999999997,"5min":67.930999999999997,"15min":93.825000000000003},"last":1.046}]},{"osd":2,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":2.0339999999999998,"15min":4.4420000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":33.426000000000002,"5min":33.426000000000002,"15min":189.01400000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":2.1739999999999999,"5min":3.6739999999999999,"15min":4.657},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":21.09,"5min":69.156999999999996,"15min":221.80600000000001},"last":1.2090000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3,"5min":3.1019999999999999,"15min":4.6059999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":33.384,"5min":64.206000000000003,"15min":198.696},"last":1.157},{"interface":"front","average":{"1min":2.4180000000000001,"5min":3.7480000000000002,"15min":5.3849999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.47399999999999998},"max":{"1min":20.509,"5min":69.585999999999999,"15min":221.846},"last":1.5309999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3.2570000000000001,"5min":3.7829999999999999,"15min":5.1799999999999997},"min":{"1min":0.69799999999999995,"5min":0.434,"15min":0.434},"max":{"1min":36.402999999999999,"5min":63.634,"15min":245.36000000000001},"last":1.8959999999999999},{"interface":"front","average":{"1min":3.085,"5min":3.0510000000000002,"15min":4.8230000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.098999999999997,"5min":43.292000000000002,"15min":190.40799999999999},"last":1.7949999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":5.9470000000000001,"5min":5.1529999999999996,"15min":6.6909999999999998},"min":{"1min":0.47899999999999998,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":78.998999999999995,"5min":78.998999999999995,"15min":222.85499999999999},"last":1.921},{"interface":"front","average":{"1min":3.4449999999999998,"5min":4.5010000000000003,"15min":6.3070000000000004},"min":{"1min":0.60999999999999999,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":36.344000000000001,"5min":83.078000000000003,"15min":215.16900000000001},"last":1.4630000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3.5489999999999999,"5min":4.1929999999999996,"15min":5.1210000000000004},"min":{"1min":0.66100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":36.374000000000002,"5min":68.109999999999999,"15min":94.079999999999998},"last":1.7330000000000001},{"interface":"front","average":{"1min":3.169,"5min":3.887,"15min":5.1269999999999998},"min":{"1min":0.505,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":32.619999999999997,"5min":63.673000000000002,"15min":188.935},"last":1.6830000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080440,"data_compressed":14029799,"data_compressed_allocated":17076224,"data_compressed_original":84856832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16019456,"data_stored":58720326,"data_compressed":9168208,"data_compressed_allocated":11268096,"data_compressed_original":53972992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6418432,"data_stored":25166496,"data_compressed":3903195,"data_compressed_allocated":4784128,"data_compressed_original":23539712,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23023616,"data_stored":88080966,"data_compressed":13869465,"data_compressed_allocated":16965632,"data_compressed_original":82026496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":54527296,"data_compressed":8437806,"data_compressed_allocated":10407936,"data_compressed_original":49823744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22880256,"data_stored":80349236,"data_compressed":12523208,"data_compressed_allocated":15749120,"data_compressed_original":73228288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":79691776,"data_compressed":12654787,"data_compressed_allocated":15716352,"data_compressed_original":74809344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9154560,"data_stored":30017620,"data_compressed":4355296,"data_compressed_allocated":5607424,"data_compressed_original":26480640,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344313856,"data_stored":465924096,"data_compressed":82404917,"data_compressed_allocated":97058816,"data_compressed_original":218669056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409116672,"data_stored":549949440,"data_compressed":97141047,"data_compressed_allocated":114851840,"data_compressed_original":255684608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":314249216,"data_stored":451452928,"data_compressed":84811640,"data_compressed_allocated":101961728,"data_compressed_original":239165440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":312856576,"data_stored":424542208,"data_compressed":70385955,"data_compressed_allocated":84119552,"data_compressed_original":195805184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":361660416,"data_stored":497172480,"data_compressed":89601823,"data_compressed_allocated":107122688,"data_compressed_original":242634752,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":419241984,"data_stored":548409344,"data_compressed":90682182,"data_compressed_allocated":105664512,"data_compressed_original":234831872,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:25:14.840 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.841 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.841 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.841 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.842 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.842 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.842 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.842 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.843 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.843 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.843 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.843 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.844 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.844 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.844 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-18T19:06:35.999688+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=35, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.844 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.844 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.845 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.845 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-18T19:06:37.009313+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=37, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:14.845 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T19:25:23.309 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:25:23.318 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:25:34.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:25:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.077+0000 7f08c3b78640 1 Processor -- start 2023-11-18T19:25:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.078+0000 7f08c3b78640 1 -- start start 2023-11-18T19:25:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.079+0000 7f08c3b78640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08bc14c4e0 0x7f08bc0a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.079+0000 7f08c3b78640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0a5270 con 0x7f08bc0c4fc0 2023-11-18T19:25:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.079+0000 7f08c3b78640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0a54a0 con 0x7f08bc0c5440 2023-11-18T19:25:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.079+0000 7f08c3b78640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc06d5d0 con 0x7f08bc14c4e0 2023-11-18T19:25:35.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.079+0000 7f08c1113640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08bc0c4fc0 0x7f08bc152320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33658/0 (socket says 172.21.15.45:33658) 2023-11-18T19:25:35.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.079+0000 7f08c1113640 1 -- 172.21.15.45:0/3454334945 learned_addr learned my addr 172.21.15.45:0/3454334945 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:25:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c1914640 1 --2- 172.21.15.45:0/3454334945 >> v2:172.21.15.135:3300/0 conn(0x7f08bc14c4e0 0x7f08bc0a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920151141 0 0) 0x7f08bc0a5270 con 0x7f08bc0c4fc0 2023-11-18T19:25:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a8003520 con 0x7f08bc0c4fc0 2023-11-18T19:25:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2973998733 0 0) 0x7f08a8003520 con 0x7f08bc0c4fc0 2023-11-18T19:25:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 >> v2:172.21.15.135:3300/0 conn(0x7f08bc14c4e0 msgr2=0x7f08bc0a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 --2- 172.21.15.45:0/3454334945 >> v2:172.21.15.135:3300/0 conn(0x7f08bc14c4e0 0x7f08bc0a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 >> v1:172.21.15.135:6789/0 conn(0x7f08bc0c5440 legacy=0x7f08bc152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc06d8b0 con 0x7f08bc0c4fc0 2023-11-18T19:25:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f08b8001670 con 0x7f08bc0c4fc0 2023-11-18T19:25:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.080+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 >> v1:172.21.15.45:6789/0 conn(0x7f08bc0c4fc0 legacy=0x7f08bc152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c0912640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a8003970 0x7f08a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c0912640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c0912640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08a8005180 0x7f08a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc06d5d0 con 0x7f08a80047c0 2023-11-18T19:25:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800c020 con 0x7f08a8003970 2023-11-18T19:25:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800c1e0 con 0x7f08a8005180 2023-11-18T19:25:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c1113640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c1113640 1 -- 172.21.15.45:0/3454334945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08a8005180 msgr2=0x7f08a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c1113640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08a8005180 0x7f08a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c1113640 1 -- 172.21.15.45:0/3454334945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a8003970 msgr2=0x7f08a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:35.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c1113640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a8003970 0x7f08a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c1113640 1 -- 172.21.15.45:0/3454334945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8003520 con 0x7f08a80047c0 2023-11-18T19:25:35.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.081+0000 7f08c2115640 1 -- 172.21.15.45:0/3454334945 reap_dead start 2023-11-18T19:25:35.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.083+0000 7f08c1113640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08a8004c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08b800c190 tx=0x7f08a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24002239f98e3afe server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:35.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.083+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8005ad0 con 0x7f08a80047c0 2023-11-18T19:25:35.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.083+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b8005c30 con 0x7f08a80047c0 2023-11-18T19:25:35.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.083+0000 7f08c0912640 1 -- 172.21.15.45:0/3454334945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b802cae0 con 0x7f08a80047c0 2023-11-18T19:25:35.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.083+0000 7f08c3b78640 1 -- 172.21.15.45:0/3454334945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 msgr2=0x7f08a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:35.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.083+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08a8004c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08b800c190 tx=0x7f08a80057f0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.084+0000 7f08c3b78640 1 -- 172.21.15.45:0/3454334945 shutdown_connections 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.084+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3454334945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08a8004c40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.084+0000 7f08c3b78640 1 -- 172.21.15.45:0/3454334945 >> 172.21.15.45:0/3454334945 conn(0x7f08bc06a500 msgr2=0x7f08bc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.084+0000 7f08c3b78640 1 -- 172.21.15.45:0/3454334945 shutdown_connections 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.084+0000 7f08c3b78640 1 -- 172.21.15.45:0/3454334945 wait complete. 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.085+0000 7f08c3b78640 1 Processor -- start 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.086+0000 7f08c3b78640 1 -- start start 2023-11-18T19:25:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.086+0000 7f08c3b78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08bc1e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.086+0000 7f08c3b78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08bc06fd20 0x7f08bc145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.086+0000 7f08c3b78640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08bc070970 0x7f08bc1edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.086+0000 7f08c3b78640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc14d670 con 0x7f08a80047c0 2023-11-18T19:25:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.086+0000 7f08c3b78640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc1ed8d0 con 0x7f08bc070970 2023-11-18T19:25:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.086+0000 7f08c3b78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc071780 con 0x7f08bc06fd20 2023-11-18T19:25:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08bc1e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08bc1e9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56012/0 (socket says 172.21.15.45:56012) 2023-11-18T19:25:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 -- 172.21.15.45:0/3762837066 learned_addr learned my addr 172.21.15.45:0/3762837066 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c2115640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08bc070970 0x7f08bc1edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 -- 172.21.15.45:0/3762837066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08bc06fd20 msgr2=0x7f08bc145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08bc06fd20 0x7f08bc145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 -- 172.21.15.45:0/3762837066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08bc070970 msgr2=0x7f08bc1edd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08bc070970 0x7f08bc1edd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 -- 172.21.15.45:0/3762837066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc1ea400 con 0x7f08a80047c0 2023-11-18T19:25:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.087+0000 7f08c1914640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08bc1e9ec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e7a0 tx=0x7f08ac00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.088+0000 7f08b27fc640 1 -- 172.21.15.45:0/3762837066 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00ee50 con 0x7f08a80047c0 2023-11-18T19:25:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.088+0000 7f08b27fc640 1 -- 172.21.15.45:0/3762837066 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00c8e0 con 0x7f08a80047c0 2023-11-18T19:25:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.088+0000 7f08b27fc640 1 -- 172.21.15.45:0/3762837066 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00cc90 con 0x7f08a80047c0 2023-11-18T19:25:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.088+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc0711c0 con 0x7f08a80047c0 2023-11-18T19:25:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.088+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc1ed560 con 0x7f08a80047c0 2023-11-18T19:25:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.089+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc067940 con 0x7f08a80047c0 2023-11-18T19:25:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.090+0000 7f08b27fc640 1 -- 172.21.15.45:0/3762837066 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08ac013470 con 0x7f08a80047c0 2023-11-18T19:25:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.091+0000 7f08b27fc640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08a006ae40 0x7f08a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:35.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.091+0000 7f08b27fc640 1 -- 172.21.15.45:0/3762837066 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f08ac089860 con 0x7f08a80047c0 2023-11-18T19:25:35.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.092+0000 7f08c1113640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08a006ae40 0x7f08a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:35.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.092+0000 7f08c1113640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08a006ae40 0x7f08a006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08b8034000 tx=0x7f08b8039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:35.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.097+0000 7f08b27fc640 1 -- 172.21.15.45:0/3762837066 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08ac054650 con 0x7f08a80047c0 2023-11-18T19:25:35.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.293+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08bc06de70 con 0x7f08a006ae40 2023-11-18T19:25:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.308+0000 7f08b27fc640 1 -- 172.21.15.45:0/3762837066 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+376458 (secure 0 0 0) 0x7f08b80014f0 con 0x7f08a006ae40 2023-11-18T19:25:35.314 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:25:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:25:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08a006ae40 msgr2=0x7f08a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08a006ae40 0x7f08a006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f08b8034000 tx=0x7f08b8039040 comp rx=0 tx=0).stop 2023-11-18T19:25:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 msgr2=0x7f08bc1e9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08bc1e9ec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e7a0 tx=0x7f08ac00ec60 comp rx=0 tx=0).stop 2023-11-18T19:25:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 shutdown_connections 2023-11-18T19:25:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08bc070970 0x7f08bc1edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f08a006ae40 0x7f08a006d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08bc06fd20 0x7f08bc145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 --2- 172.21.15.45:0/3762837066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a80047c0 0x7f08bc1e9ec0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:35.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.314+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 >> 172.21.15.45:0/3762837066 conn(0x7f08bc06a500 msgr2=0x7f08bc149d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:35.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.315+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 shutdown_connections 2023-11-18T19:25:35.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:35.315+0000 7f08c3b78640 1 -- 172.21.15.45:0/3762837066 wait complete. 2023-11-18T19:25:35.334 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":595,"stamp":"2023-11-18T19:25:33.612030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1785263879,"num_objects":123806,"num_object_clones":0,"num_object_copies":392290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123806,"num_whiteouts":0,"num_read":995,"num_read_kb":1916,"num_write":271743,"num_write_kb":2424425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30352898,"num_omap_keys":52444,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274717,"ondisk_log_size":274717,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5130652,"kb_used_data":2876700,"kb_used_omap":12,"kb_used_meta":2253875,"kb_avail":749844068,"statfs":{"total":773094113280,"available":767840325632,"internally_reserved":0,"allocated":2945740800,"data_stored":4327323900,"data_compressed":745766872,"data_compressed_allocated":891199488,"data_compressed_original":2274316288,"omap_allocated":12748,"internal_metadata":2307968564},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1078371,"num_omap_keys":1867,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004867"},"pg_stats":[{"pgid":"2.1f","version":"29'488","reported_seq":527,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.102998+0000","last_change":"2023-11-18T19:24:42.102998+0000","last_active":"2023-11-18T19:24:42.102998+0000","last_peered":"2023-11-18T19:24:42.102998+0000","last_clean":"2023-11-18T19:24:42.102998+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:42.102998+0000","last_undegraded":"2023-11-18T19:24:42.102998+0000","last_fullsized":"2023-11-18T19:24:42.102998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'488","last_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_deep_scrub":"29'488","last_deep_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.102683+0000","objects_scrubbed":92,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:36:53.767588+0000","scrub_duration":0.165977034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":592,"num_write_kb":13689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1058229,"num_omap_keys":1832,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'1683","reported_seq":1747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.141937+0000","last_change":"2023-11-18T19:25:07.141982+0000","last_active":"2023-11-18T19:25:07.141937+0000","last_peered":"2023-11-18T19:25:07.141937+0000","last_clean":"2023-11-18T19:25:07.141937+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:25:07.141937+0000","last_undegraded":"2023-11-18T19:25:07.141937+0000","last_fullsized":"2023-11-18T19:25:07.141937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1683","last_scrub_stamp":"2023-11-18T19:25:07.141845+0000","last_deep_scrub":"29'1683","last_deep_scrub_stamp":"2023-11-18T19:25:07.141845+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.141845+0000","objects_scrubbed":731,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:51:10.143990+0000","scrub_duration":0.64930619099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":731,"num_object_clones":0,"num_object_copies":1462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4515","reported_seq":4635,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.295641+0000","last_change":"2023-11-18T19:24:59.295673+0000","last_active":"2023-11-18T19:24:59.295641+0000","last_peered":"2023-11-18T19:24:59.295641+0000","last_clean":"2023-11-18T19:24:59.295641+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:59.295641+0000","last_undegraded":"2023-11-18T19:24:59.295641+0000","last_fullsized":"2023-11-18T19:24:59.295641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4515","last_scrub_stamp":"2023-11-18T19:24:59.295546+0000","last_deep_scrub":"29'4515","last_deep_scrub_stamp":"2023-11-18T19:24:59.295546+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.295546+0000","objects_scrubbed":2214,"log_size":4515,"log_dups_size":0,"ondisk_log_size":4515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:31:11.433037+0000","scrub_duration":1.3914833550000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47448745,"num_objects":2214,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6085,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'399","reported_seq":437,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.562573+0000","last_change":"2023-11-18T19:24:49.562619+0000","last_active":"2023-11-18T19:24:49.562573+0000","last_peered":"2023-11-18T19:24:49.562573+0000","last_clean":"2023-11-18T19:24:49.562573+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:49.562573+0000","last_undegraded":"2023-11-18T19:24:49.562573+0000","last_fullsized":"2023-11-18T19:24:49.562573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'399","last_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_deep_scrub":"29'399","last_deep_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.562510+0000","objects_scrubbed":82,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:37.188456+0000","scrub_duration":0.114711435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":487,"num_write_kb":31117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":81,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207150,"num_omap_keys":3796,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'1691","reported_seq":1754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.183200+0000","last_change":"2023-11-18T19:25:04.183200+0000","last_active":"2023-11-18T19:25:04.183200+0000","last_peered":"2023-11-18T19:25:04.183200+0000","last_clean":"2023-11-18T19:25:04.183200+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:25:04.183200+0000","last_undegraded":"2023-11-18T19:25:04.183200+0000","last_fullsized":"2023-11-18T19:25:04.183200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1691","last_scrub_stamp":"2023-11-18T19:25:04.183067+0000","last_deep_scrub":"29'1691","last_deep_scrub_stamp":"2023-11-18T19:25:04.183067+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.183067+0000","objects_scrubbed":739,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:57.624730+0000","scrub_duration":0.67777383599999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4583","reported_seq":4706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.235913+0000","last_change":"2023-11-18T19:24:51.235992+0000","last_active":"2023-11-18T19:24:51.235913+0000","last_peered":"2023-11-18T19:24:51.235913+0000","last_clean":"2023-11-18T19:24:51.235913+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:51.235913+0000","last_undegraded":"2023-11-18T19:24:51.235913+0000","last_fullsized":"2023-11-18T19:24:51.235913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4583","last_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_deep_scrub":"29'4583","last_deep_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.235758+0000","objects_scrubbed":2273,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:46.767646+0000","scrub_duration":1.556089611,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45442855,"num_objects":2273,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6171,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'601","reported_seq":637,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.673982+0000","last_change":"2023-11-18T19:24:42.674060+0000","last_active":"2023-11-18T19:24:42.673982+0000","last_peered":"2023-11-18T19:24:42.673982+0000","last_clean":"2023-11-18T19:24:42.673982+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:42.673982+0000","last_undegraded":"2023-11-18T19:24:42.673982+0000","last_fullsized":"2023-11-18T19:24:42.673982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'601","last_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_deep_scrub":"29'601","last_deep_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.673881+0000","objects_scrubbed":99,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:23.664922+0000","scrub_duration":0.096252519999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":701,"num_write_kb":33858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":98,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":793362,"num_omap_keys":1372,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'1765","reported_seq":1829,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.986185+0000","last_change":"2023-11-18T19:24:48.986210+0000","last_active":"2023-11-18T19:24:48.986185+0000","last_peered":"2023-11-18T19:24:48.986185+0000","last_clean":"2023-11-18T19:24:48.986185+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:48.986185+0000","last_undegraded":"2023-11-18T19:24:48.986185+0000","last_fullsized":"2023-11-18T19:24:48.986185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.986121+0000","objects_scrubbed":804,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:29.451254+0000","scrub_duration":0.73796645500000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":804,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4623","reported_seq":4743,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:05.472427+0000","last_change":"2023-11-18T19:25:05.472494+0000","last_active":"2023-11-18T19:25:05.472427+0000","last_peered":"2023-11-18T19:25:05.472427+0000","last_clean":"2023-11-18T19:25:05.472427+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:25:05.472427+0000","last_undegraded":"2023-11-18T19:25:05.472427+0000","last_fullsized":"2023-11-18T19:25:05.472427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4623","last_scrub_stamp":"2023-11-18T19:25:05.472319+0000","last_deep_scrub":"29'4623","last_deep_scrub_stamp":"2023-11-18T19:25:05.472319+0000","last_clean_scrub_stamp":"2023-11-18T19:25:05.472319+0000","objects_scrubbed":2248,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:46.936644+0000","scrub_duration":1.6102027730000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48597389,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6213,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'348","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.660392+0000","last_change":"2023-11-18T19:24:49.660459+0000","last_active":"2023-11-18T19:24:49.660392+0000","last_peered":"2023-11-18T19:24:49.660392+0000","last_clean":"2023-11-18T19:24:49.660392+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:49.660392+0000","last_undegraded":"2023-11-18T19:24:49.660392+0000","last_fullsized":"2023-11-18T19:24:49.660392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'348","last_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_deep_scrub":"29'348","last_deep_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.660293+0000","objects_scrubbed":92,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:50.955578+0000","scrub_duration":0.126544825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":442,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750456,"num_omap_keys":1290,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'1765","reported_seq":1828,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:26.169606+0000","last_change":"2023-11-18T19:25:26.169646+0000","last_active":"2023-11-18T19:25:26.169606+0000","last_peered":"2023-11-18T19:25:26.169606+0000","last_clean":"2023-11-18T19:25:26.169606+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:25:26.169606+0000","last_undegraded":"2023-11-18T19:25:26.169606+0000","last_fullsized":"2023-11-18T19:25:26.169606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:25:26.169541+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:25:26.169541+0000","last_clean_scrub_stamp":"2023-11-18T19:25:26.169541+0000","objects_scrubbed":765,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:02:26.191189+0000","scrub_duration":0.77567252499999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":821,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4456","reported_seq":4577,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.785149+0000","last_change":"2023-11-18T19:24:57.785191+0000","last_active":"2023-11-18T19:24:57.785149+0000","last_peered":"2023-11-18T19:24:57.785149+0000","last_clean":"2023-11-18T19:24:57.785149+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:57.785149+0000","last_undegraded":"2023-11-18T19:24:57.785149+0000","last_fullsized":"2023-11-18T19:24:57.785149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4456","last_scrub_stamp":"2023-11-18T19:24:57.785048+0000","last_deep_scrub":"29'4456","last_deep_scrub_stamp":"2023-11-18T19:24:57.785048+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.785048+0000","objects_scrubbed":2218,"log_size":4456,"log_dups_size":0,"ondisk_log_size":4456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:27:55.199202+0000","scrub_duration":2.0432324529999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44553589,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5936,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.744018+0000","last_change":"2023-11-18T19:24:39.744091+0000","last_active":"2023-11-18T19:24:39.744018+0000","last_peered":"2023-11-18T19:24:39.744018+0000","last_clean":"2023-11-18T19:24:39.744018+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:39.744018+0000","last_undegraded":"2023-11-18T19:24:39.744018+0000","last_fullsized":"2023-11-18T19:24:39.744018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.743952+0000","objects_scrubbed":742,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:27.369898+0000","scrub_duration":0.70226359599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'519","reported_seq":558,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:10.417517+0000","last_change":"2023-11-18T19:25:10.417545+0000","last_active":"2023-11-18T19:25:10.417517+0000","last_peered":"2023-11-18T19:25:10.417517+0000","last_clean":"2023-11-18T19:25:10.417517+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:25:10.417517+0000","last_undegraded":"2023-11-18T19:25:10.417517+0000","last_fullsized":"2023-11-18T19:25:10.417517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'519","last_scrub_stamp":"2023-11-18T19:25:10.417438+0000","last_deep_scrub":"29'519","last_deep_scrub_stamp":"2023-11-18T19:25:10.417438+0000","last_clean_scrub_stamp":"2023-11-18T19:25:10.417438+0000","objects_scrubbed":103,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:34.362117+0000","scrub_duration":0.182611199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":29849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":885582,"num_omap_keys":1535,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4620","reported_seq":4744,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.884423+0000","last_change":"2023-11-18T19:24:48.884469+0000","last_active":"2023-11-18T19:24:48.884423+0000","last_peered":"2023-11-18T19:24:48.884423+0000","last_clean":"2023-11-18T19:24:48.884423+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:48.884423+0000","last_undegraded":"2023-11-18T19:24:48.884423+0000","last_fullsized":"2023-11-18T19:24:48.884423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4620","last_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_deep_scrub":"29'4620","last_deep_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.884337+0000","objects_scrubbed":2305,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:31.229044+0000","scrub_duration":1.771489595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50701125,"num_objects":2305,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6229,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'1748","reported_seq":1812,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.444406+0000","last_change":"2023-11-18T19:24:49.444480+0000","last_active":"2023-11-18T19:24:49.444406+0000","last_peered":"2023-11-18T19:24:49.444406+0000","last_clean":"2023-11-18T19:24:49.444406+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:49.444406+0000","last_undegraded":"2023-11-18T19:24:49.444406+0000","last_fullsized":"2023-11-18T19:24:49.444406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.444303+0000","objects_scrubbed":785,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:21.815747+0000","scrub_duration":0.686602881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":785,"num_object_clones":0,"num_object_copies":1570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'524","reported_seq":562,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.697932+0000","last_change":"2023-11-18T19:24:37.698022+0000","last_active":"2023-11-18T19:24:37.697932+0000","last_peered":"2023-11-18T19:24:37.697932+0000","last_clean":"2023-11-18T19:24:37.697932+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:37.697932+0000","last_undegraded":"2023-11-18T19:24:37.697932+0000","last_fullsized":"2023-11-18T19:24:37.697932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'524","last_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_deep_scrub":"29'524","last_deep_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.697763+0000","objects_scrubbed":95,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:12.850295+0000","scrub_duration":0.185472308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":30122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1242455,"num_omap_keys":2145,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4571","reported_seq":4692,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:18.059825+0000","last_change":"2023-11-18T19:25:18.059880+0000","last_active":"2023-11-18T19:25:18.059825+0000","last_peered":"2023-11-18T19:25:18.059825+0000","last_clean":"2023-11-18T19:25:18.059825+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:25:18.059825+0000","last_undegraded":"2023-11-18T19:25:18.059825+0000","last_fullsized":"2023-11-18T19:25:18.059825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4571","last_scrub_stamp":"2023-11-18T19:25:18.059746+0000","last_deep_scrub":"29'4571","last_deep_scrub_stamp":"2023-11-18T19:25:18.059746+0000","last_clean_scrub_stamp":"2023-11-18T19:25:18.059746+0000","objects_scrubbed":2244,"log_size":4571,"log_dups_size":0,"ondisk_log_size":4571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:49.662341+0000","scrub_duration":1.3131504620000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6125,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'1789","reported_seq":1855,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:45.778711+0000","last_change":"2023-11-18T19:24:45.778740+0000","last_active":"2023-11-18T19:24:45.778711+0000","last_peered":"2023-11-18T19:24:45.778711+0000","last_clean":"2023-11-18T19:24:45.778711+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:45.778711+0000","last_undegraded":"2023-11-18T19:24:45.778711+0000","last_fullsized":"2023-11-18T19:24:45.778711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1789","last_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_deep_scrub":"29'1789","last_deep_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_clean_scrub_stamp":"2023-11-18T19:24:45.778650+0000","objects_scrubbed":808,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:47.073935+0000","scrub_duration":0.792586715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":808,"num_object_clones":0,"num_object_copies":1616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'542","reported_seq":581,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.181657+0000","last_change":"2023-11-18T19:24:34.181862+0000","last_active":"2023-11-18T19:24:34.181657+0000","last_peered":"2023-11-18T19:24:34.181657+0000","last_clean":"2023-11-18T19:24:34.181657+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:24:34.181657+0000","last_undegraded":"2023-11-18T19:24:34.181657+0000","last_fullsized":"2023-11-18T19:24:34.181657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'542","last_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_deep_scrub":"29'542","last_deep_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.181507+0000","objects_scrubbed":113,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.334039+0000","scrub_duration":0.31913006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":17586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":869889,"num_omap_keys":1501,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4609","reported_seq":4732,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.297236+0000","last_change":"2023-11-18T19:25:00.297272+0000","last_active":"2023-11-18T19:25:00.297236+0000","last_peered":"2023-11-18T19:25:00.297236+0000","last_clean":"2023-11-18T19:25:00.297236+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:25:00.297236+0000","last_undegraded":"2023-11-18T19:25:00.297236+0000","last_fullsized":"2023-11-18T19:25:00.297236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4609","last_scrub_stamp":"2023-11-18T19:25:00.297156+0000","last_deep_scrub":"29'4609","last_deep_scrub_stamp":"2023-11-18T19:25:00.297156+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.297156+0000","objects_scrubbed":2293,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:49.521582+0000","scrub_duration":1.357820765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6233,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'1722","reported_seq":1786,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:27.725890+0000","last_change":"2023-11-18T19:25:27.725958+0000","last_active":"2023-11-18T19:25:27.725890+0000","last_peered":"2023-11-18T19:25:27.725890+0000","last_clean":"2023-11-18T19:25:27.725890+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:25:27.725890+0000","last_undegraded":"2023-11-18T19:25:27.725890+0000","last_fullsized":"2023-11-18T19:25:27.725890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1722","last_scrub_stamp":"2023-11-18T19:25:27.725713+0000","last_deep_scrub":"29'1722","last_deep_scrub_stamp":"2023-11-18T19:25:27.725713+0000","last_clean_scrub_stamp":"2023-11-18T19:25:27.725713+0000","objects_scrubbed":733,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:25:27.174524+0000","scrub_duration":1.3095815980000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'530","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:44.705515+0000","last_change":"2023-11-18T19:24:44.705608+0000","last_active":"2023-11-18T19:24:44.705515+0000","last_peered":"2023-11-18T19:24:44.705515+0000","last_clean":"2023-11-18T19:24:44.705515+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:44.705515+0000","last_undegraded":"2023-11-18T19:24:44.705515+0000","last_fullsized":"2023-11-18T19:24:44.705515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'530","last_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_deep_scrub":"29'530","last_deep_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:44.705369+0000","objects_scrubbed":70,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:22.256103+0000","scrub_duration":0.14586217300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":13046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522099,"num_omap_keys":901,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4549","reported_seq":4673,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.067111+0000","last_change":"2023-11-18T19:25:06.067167+0000","last_active":"2023-11-18T19:25:06.067111+0000","last_peered":"2023-11-18T19:25:06.067111+0000","last_clean":"2023-11-18T19:25:06.067111+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:25:06.067111+0000","last_undegraded":"2023-11-18T19:25:06.067111+0000","last_fullsized":"2023-11-18T19:25:06.067111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4549","last_scrub_stamp":"2023-11-18T19:25:06.066995+0000","last_deep_scrub":"29'4549","last_deep_scrub_stamp":"2023-11-18T19:25:06.066995+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.066995+0000","objects_scrubbed":2311,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:41.908526+0000","scrub_duration":1.1642892309999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53723490,"num_objects":2311,"num_object_clones":0,"num_object_copies":9244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6133,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'1771","reported_seq":1836,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.658737+0000","last_change":"2023-11-18T19:24:55.658786+0000","last_active":"2023-11-18T19:24:55.658737+0000","last_peered":"2023-11-18T19:24:55.658737+0000","last_clean":"2023-11-18T19:24:55.658737+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:55.658737+0000","last_undegraded":"2023-11-18T19:24:55.658737+0000","last_fullsized":"2023-11-18T19:24:55.658737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1771","last_scrub_stamp":"2023-11-18T19:24:55.658661+0000","last_deep_scrub":"29'1771","last_deep_scrub_stamp":"2023-11-18T19:24:55.658661+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.658661+0000","objects_scrubbed":783,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:28.294107+0000","scrub_duration":0.71135849100000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":783,"num_object_clones":0,"num_object_copies":1566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'385","reported_seq":423,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:08.441949+0000","last_change":"2023-11-18T19:25:08.442011+0000","last_active":"2023-11-18T19:25:08.441949+0000","last_peered":"2023-11-18T19:25:08.441949+0000","last_clean":"2023-11-18T19:25:08.441949+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:25:08.441949+0000","last_undegraded":"2023-11-18T19:25:08.441949+0000","last_fullsized":"2023-11-18T19:25:08.441949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'385","last_scrub_stamp":"2023-11-18T19:25:08.441876+0000","last_deep_scrub":"29'385","last_deep_scrub_stamp":"2023-11-18T19:25:08.441876+0000","last_clean_scrub_stamp":"2023-11-18T19:25:08.441876+0000","objects_scrubbed":91,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:05:20.605127+0000","scrub_duration":0.16475478399999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":469,"num_write_kb":13215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":800497,"num_omap_keys":1387,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4569","reported_seq":4692,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.291786+0000","last_change":"2023-11-18T19:24:53.291854+0000","last_active":"2023-11-18T19:24:53.291786+0000","last_peered":"2023-11-18T19:24:53.291786+0000","last_clean":"2023-11-18T19:24:53.291786+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:53.291786+0000","last_undegraded":"2023-11-18T19:24:53.291786+0000","last_fullsized":"2023-11-18T19:24:53.291786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4569","last_scrub_stamp":"2023-11-18T19:24:53.291684+0000","last_deep_scrub":"29'4569","last_deep_scrub_stamp":"2023-11-18T19:24:53.291684+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.291684+0000","objects_scrubbed":2264,"log_size":4569,"log_dups_size":0,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:35.819230+0000","scrub_duration":1.533954364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58452634,"num_objects":2264,"num_object_clones":0,"num_object_copies":9056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6141,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'1596","reported_seq":1658,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.486739+0000","last_change":"2023-11-18T19:24:31.486782+0000","last_active":"2023-11-18T19:24:31.486739+0000","last_peered":"2023-11-18T19:24:31.486739+0000","last_clean":"2023-11-18T19:24:31.486739+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:31.486739+0000","last_undegraded":"2023-11-18T19:24:31.486739+0000","last_fullsized":"2023-11-18T19:24:31.486739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1596","last_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_deep_scrub":"29'1596","last_deep_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_clean_scrub_stamp":"2023-11-18T19:24:31.486678+0000","objects_scrubbed":721,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:03.765253+0000","scrub_duration":0.68181534700000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'623","reported_seq":661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.085333+0000","last_change":"2023-11-18T19:24:37.085379+0000","last_active":"2023-11-18T19:24:37.085333+0000","last_peered":"2023-11-18T19:24:37.085333+0000","last_clean":"2023-11-18T19:24:37.085333+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:37.085333+0000","last_undegraded":"2023-11-18T19:24:37.085333+0000","last_fullsized":"2023-11-18T19:24:37.085333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'623","last_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_deep_scrub":"29'623","last_deep_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.085251+0000","objects_scrubbed":96,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:19:26.864983+0000","scrub_duration":0.19450854400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1057,"num_write_kb":20813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1016762,"num_omap_keys":1760,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4574","reported_seq":4697,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.127582+0000","last_change":"2023-11-18T19:25:06.127667+0000","last_active":"2023-11-18T19:25:06.127582+0000","last_peered":"2023-11-18T19:25:06.127582+0000","last_clean":"2023-11-18T19:25:06.127582+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:25:06.127582+0000","last_undegraded":"2023-11-18T19:25:06.127582+0000","last_fullsized":"2023-11-18T19:25:06.127582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4574","last_scrub_stamp":"2023-11-18T19:25:06.127397+0000","last_deep_scrub":"29'4574","last_deep_scrub_stamp":"2023-11-18T19:25:06.127397+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.127397+0000","objects_scrubbed":2267,"log_size":4574,"log_dups_size":0,"ondisk_log_size":4574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:40.560101+0000","scrub_duration":1.131583945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41932084,"num_objects":2267,"num_object_clones":0,"num_object_copies":9068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6154,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'1715","reported_seq":1781,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.117707+0000","last_change":"2023-11-18T19:24:50.117707+0000","last_active":"2023-11-18T19:24:50.117707+0000","last_peered":"2023-11-18T19:24:50.117707+0000","last_clean":"2023-11-18T19:24:50.117707+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:50.117707+0000","last_undegraded":"2023-11-18T19:24:50.117707+0000","last_fullsized":"2023-11-18T19:24:50.117707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1715","last_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_deep_scrub":"29'1715","last_deep_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.117602+0000","objects_scrubbed":789,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:54:42.963090+0000","scrub_duration":0.69843094500000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'394","reported_seq":433,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:15.477710+0000","last_change":"2023-11-18T19:25:15.477710+0000","last_active":"2023-11-18T19:25:15.477710+0000","last_peered":"2023-11-18T19:25:15.477710+0000","last_clean":"2023-11-18T19:25:15.477710+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:25:15.477710+0000","last_undegraded":"2023-11-18T19:25:15.477710+0000","last_fullsized":"2023-11-18T19:25:15.477710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'394","last_scrub_stamp":"2023-11-18T19:25:15.477476+0000","last_deep_scrub":"29'394","last_deep_scrub_stamp":"2023-11-18T19:25:15.477476+0000","last_clean_scrub_stamp":"2023-11-18T19:25:15.477476+0000","objects_scrubbed":88,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:57:34.445896+0000","scrub_duration":0.17434539299999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":21633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":925641,"num_omap_keys":1601,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4621","reported_seq":4744,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.977024+0000","last_change":"2023-11-18T19:25:04.977082+0000","last_active":"2023-11-18T19:25:04.977024+0000","last_peered":"2023-11-18T19:25:04.977024+0000","last_clean":"2023-11-18T19:25:04.977024+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:25:04.977024+0000","last_undegraded":"2023-11-18T19:25:04.977024+0000","last_fullsized":"2023-11-18T19:25:04.977024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4621","last_scrub_stamp":"2023-11-18T19:25:04.976895+0000","last_deep_scrub":"29'4621","last_deep_scrub_stamp":"2023-11-18T19:25:04.976895+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.976895+0000","objects_scrubbed":2287,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:08.539872+0000","scrub_duration":1.5362857939999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41011562,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6203,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'1615","reported_seq":1678,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.715645+0000","last_change":"2023-11-18T19:24:38.715645+0000","last_active":"2023-11-18T19:24:38.715645+0000","last_peered":"2023-11-18T19:24:38.715645+0000","last_clean":"2023-11-18T19:24:38.715645+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:38.715645+0000","last_undegraded":"2023-11-18T19:24:38.715645+0000","last_fullsized":"2023-11-18T19:24:38.715645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1615","last_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_deep_scrub":"29'1615","last_deep_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.715496+0000","objects_scrubbed":730,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:13.868028+0000","scrub_duration":1.1252372610000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'546","reported_seq":584,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.630412+0000","last_change":"2023-11-18T19:24:46.630412+0000","last_active":"2023-11-18T19:24:46.630412+0000","last_peered":"2023-11-18T19:24:46.630412+0000","last_clean":"2023-11-18T19:24:46.630412+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:46.630412+0000","last_undegraded":"2023-11-18T19:24:46.630412+0000","last_fullsized":"2023-11-18T19:24:46.630412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'546","last_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_deep_scrub":"29'546","last_deep_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.630325+0000","objects_scrubbed":81,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:42.162213+0000","scrub_duration":0.13360024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":17360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":748148,"num_omap_keys":1294,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4547","reported_seq":4669,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.715516+0000","last_change":"2023-11-18T19:25:07.715559+0000","last_active":"2023-11-18T19:25:07.715516+0000","last_peered":"2023-11-18T19:25:07.715516+0000","last_clean":"2023-11-18T19:25:07.715516+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:25:07.715516+0000","last_undegraded":"2023-11-18T19:25:07.715516+0000","last_fullsized":"2023-11-18T19:25:07.715516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4547","last_scrub_stamp":"2023-11-18T19:25:07.715413+0000","last_deep_scrub":"29'4547","last_deep_scrub_stamp":"2023-11-18T19:25:07.715413+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.715413+0000","objects_scrubbed":2248,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:43.556944+0000","scrub_duration":1.2605765070000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47540604,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'1732","reported_seq":1796,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.289765+0000","last_change":"2023-11-18T19:24:56.289765+0000","last_active":"2023-11-18T19:24:56.289765+0000","last_peered":"2023-11-18T19:24:56.289765+0000","last_clean":"2023-11-18T19:24:56.289765+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:56.289765+0000","last_undegraded":"2023-11-18T19:24:56.289765+0000","last_fullsized":"2023-11-18T19:24:56.289765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1732","last_scrub_stamp":"2023-11-18T19:24:56.289631+0000","last_deep_scrub":"29'1732","last_deep_scrub_stamp":"2023-11-18T19:24:56.289631+0000","last_clean_scrub_stamp":"2023-11-18T19:24:56.289631+0000","objects_scrubbed":754,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:58.169206+0000","scrub_duration":0.72373005700000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1282","reported_seq":1321,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:02.498508+0000","last_change":"2023-11-18T19:25:02.498508+0000","last_active":"2023-11-18T19:25:02.498508+0000","last_peered":"2023-11-18T19:25:02.498508+0000","last_clean":"2023-11-18T19:25:02.498508+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:25:02.498508+0000","last_undegraded":"2023-11-18T19:25:02.498508+0000","last_fullsized":"2023-11-18T19:25:02.498508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1282","last_scrub_stamp":"2023-11-18T19:25:02.498331+0000","last_deep_scrub":"29'1282","last_deep_scrub_stamp":"2023-11-18T19:25:02.498331+0000","last_clean_scrub_stamp":"2023-11-18T19:25:02.498331+0000","objects_scrubbed":99,"log_size":1282,"log_dups_size":0,"ondisk_log_size":1282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:34.100927+0000","scrub_duration":0.177219503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1036880,"num_omap_keys":1796,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4578","reported_seq":4705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.781525+0000","last_change":"2023-11-18T19:25:03.781572+0000","last_active":"2023-11-18T19:25:03.781525+0000","last_peered":"2023-11-18T19:25:03.781525+0000","last_clean":"2023-11-18T19:25:03.781525+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:25:03.781525+0000","last_undegraded":"2023-11-18T19:25:03.781525+0000","last_fullsized":"2023-11-18T19:25:03.781525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4578","last_scrub_stamp":"2023-11-18T19:25:03.781403+0000","last_deep_scrub":"29'4578","last_deep_scrub_stamp":"2023-11-18T19:25:03.781403+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.781403+0000","objects_scrubbed":2302,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:05.660977+0000","scrub_duration":1.3622234500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39429542,"num_objects":2302,"num_object_clones":0,"num_object_copies":9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6195,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'1765","reported_seq":1830,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.508287+0000","last_change":"2023-11-18T19:24:57.508330+0000","last_active":"2023-11-18T19:24:57.508287+0000","last_peered":"2023-11-18T19:24:57.508287+0000","last_clean":"2023-11-18T19:24:57.508287+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:57.508287+0000","last_undegraded":"2023-11-18T19:24:57.508287+0000","last_fullsized":"2023-11-18T19:24:57.508287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:24:57.508195+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:24:57.508195+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.508195+0000","objects_scrubbed":778,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:01.071172+0000","scrub_duration":0.98722459500000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":778,"num_object_clones":0,"num_object_copies":1556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1992","reported_seq":2867,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.414699+0000","last_change":"2023-11-18T19:24:37.978888+0000","last_active":"2023-11-18T19:24:56.414699+0000","last_peered":"2023-11-18T19:24:56.414699+0000","last_clean":"2023-11-18T19:24:56.414699+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:56.414699+0000","last_undegraded":"2023-11-18T19:24:56.414699+0000","last_fullsized":"2023-11-18T19:24:56.414699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1980","last_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_deep_scrub":"29'1980","last_deep_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.978780+0000","objects_scrubbed":103,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:11:09.998369+0000","scrub_duration":0.181000729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13240280,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":836,"num_read_kb":1816,"num_write":2094,"num_write_kb":27224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":813940,"num_omap_keys":1408,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4483","reported_seq":4604,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:11.900529+0000","last_change":"2023-11-18T19:25:11.900602+0000","last_active":"2023-11-18T19:25:11.900529+0000","last_peered":"2023-11-18T19:25:11.900529+0000","last_clean":"2023-11-18T19:25:11.900529+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:25:11.900529+0000","last_undegraded":"2023-11-18T19:25:11.900529+0000","last_fullsized":"2023-11-18T19:25:11.900529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4483","last_scrub_stamp":"2023-11-18T19:25:11.900419+0000","last_deep_scrub":"29'4483","last_deep_scrub_stamp":"2023-11-18T19:25:11.900419+0000","last_clean_scrub_stamp":"2023-11-18T19:25:11.900419+0000","objects_scrubbed":2217,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:13.457948+0000","scrub_duration":1.4797586389999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52629501,"num_objects":2217,"num_object_clones":0,"num_object_copies":8868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5979,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'1648","reported_seq":1712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.144332+0000","last_change":"2023-11-18T19:24:56.144332+0000","last_active":"2023-11-18T19:24:56.144332+0000","last_peered":"2023-11-18T19:24:56.144332+0000","last_clean":"2023-11-18T19:24:56.144332+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:56.144332+0000","last_undegraded":"2023-11-18T19:24:56.144332+0000","last_fullsized":"2023-11-18T19:24:56.144332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1648","last_scrub_stamp":"2023-11-18T19:24:56.144205+0000","last_deep_scrub":"29'1648","last_deep_scrub_stamp":"2023-11-18T19:24:56.144205+0000","last_clean_scrub_stamp":"2023-11-18T19:24:56.144205+0000","objects_scrubbed":729,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:38.671750+0000","scrub_duration":0.71927640299999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'574","reported_seq":613,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:01.538510+0000","last_change":"2023-11-18T19:25:01.538580+0000","last_active":"2023-11-18T19:25:01.538510+0000","last_peered":"2023-11-18T19:25:01.538510+0000","last_clean":"2023-11-18T19:25:01.538510+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:25:01.538510+0000","last_undegraded":"2023-11-18T19:25:01.538510+0000","last_fullsized":"2023-11-18T19:25:01.538510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'574","last_scrub_stamp":"2023-11-18T19:25:01.538406+0000","last_deep_scrub":"29'574","last_deep_scrub_stamp":"2023-11-18T19:25:01.538406+0000","last_clean_scrub_stamp":"2023-11-18T19:25:01.538406+0000","objects_scrubbed":91,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:09.053712+0000","scrub_duration":0.217749737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":29679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":793019,"num_omap_keys":1373,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4675","reported_seq":4798,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:16.721902+0000","last_change":"2023-11-18T19:25:16.721935+0000","last_active":"2023-11-18T19:25:16.721902+0000","last_peered":"2023-11-18T19:25:16.721902+0000","last_clean":"2023-11-18T19:25:16.721902+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:25:16.721902+0000","last_undegraded":"2023-11-18T19:25:16.721902+0000","last_fullsized":"2023-11-18T19:25:16.721902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4675","last_scrub_stamp":"2023-11-18T19:25:16.721820+0000","last_deep_scrub":"29'4675","last_deep_scrub_stamp":"2023-11-18T19:25:16.721820+0000","last_clean_scrub_stamp":"2023-11-18T19:25:16.721820+0000","objects_scrubbed":2286,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:06.151479+0000","scrub_duration":1.2115808480000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43888851,"num_objects":2286,"num_object_clones":0,"num_object_copies":9144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6293,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'1725","reported_seq":1790,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.794174+0000","last_change":"2023-11-18T19:24:54.794174+0000","last_active":"2023-11-18T19:24:54.794174+0000","last_peered":"2023-11-18T19:24:54.794174+0000","last_clean":"2023-11-18T19:24:54.794174+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:54.794174+0000","last_undegraded":"2023-11-18T19:24:54.794174+0000","last_fullsized":"2023-11-18T19:24:54.794174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1725","last_scrub_stamp":"2023-11-18T19:24:54.794006+0000","last_deep_scrub":"29'1725","last_deep_scrub_stamp":"2023-11-18T19:24:54.794006+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.794006+0000","objects_scrubbed":768,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:35.582227+0000","scrub_duration":0.79753717599999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":768,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'520","reported_seq":560,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.397296+0000","last_change":"2023-11-18T19:25:06.397296+0000","last_active":"2023-11-18T19:25:06.397296+0000","last_peered":"2023-11-18T19:25:06.397296+0000","last_clean":"2023-11-18T19:25:06.397296+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:25:06.397296+0000","last_undegraded":"2023-11-18T19:25:06.397296+0000","last_fullsized":"2023-11-18T19:25:06.397296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'520","last_scrub_stamp":"2023-11-18T19:25:06.397201+0000","last_deep_scrub":"29'520","last_deep_scrub_stamp":"2023-11-18T19:25:06.397201+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.397201+0000","objects_scrubbed":105,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:02:21.146299+0000","scrub_duration":0.117494062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1043588,"num_omap_keys":1792,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:30.359024+0000","last_change":"2023-11-18T19:24:30.359024+0000","last_active":"2023-11-18T19:24:30.359024+0000","last_peered":"2023-11-18T19:24:30.359024+0000","last_clean":"2023-11-18T19:24:30.359024+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:24:30.359024+0000","last_undegraded":"2023-11-18T19:24:30.359024+0000","last_fullsized":"2023-11-18T19:24:30.359024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_clean_scrub_stamp":"2023-11-18T19:24:30.358806+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:26.918519+0000","scrub_duration":0.011450409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4474","reported_seq":4596,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:29.256418+0000","last_change":"2023-11-18T19:25:29.256418+0000","last_active":"2023-11-18T19:25:29.256418+0000","last_peered":"2023-11-18T19:25:29.256418+0000","last_clean":"2023-11-18T19:25:29.256418+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:25:29.256418+0000","last_undegraded":"2023-11-18T19:25:29.256418+0000","last_fullsized":"2023-11-18T19:25:29.256418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4474","last_scrub_stamp":"2023-11-18T19:25:29.256302+0000","last_deep_scrub":"29'4474","last_deep_scrub_stamp":"2023-11-18T19:25:29.256302+0000","last_clean_scrub_stamp":"2023-11-18T19:25:29.256302+0000","objects_scrubbed":2231,"log_size":4474,"log_dups_size":0,"ondisk_log_size":4474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:40.415978+0000","scrub_duration":0.79865418099999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47903098,"num_objects":2231,"num_object_clones":0,"num_object_copies":8924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6002,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'1749","reported_seq":1813,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:24.035009+0000","last_change":"2023-11-18T19:25:24.035046+0000","last_active":"2023-11-18T19:25:24.035009+0000","last_peered":"2023-11-18T19:25:24.035009+0000","last_clean":"2023-11-18T19:25:24.035009+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:25:24.035009+0000","last_undegraded":"2023-11-18T19:25:24.035009+0000","last_fullsized":"2023-11-18T19:25:24.035009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1749","last_scrub_stamp":"2023-11-18T19:25:24.034935+0000","last_deep_scrub":"29'1749","last_deep_scrub_stamp":"2023-11-18T19:25:24.034935+0000","last_clean_scrub_stamp":"2023-11-18T19:25:24.034935+0000","objects_scrubbed":765,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:36:21.054419+0000","scrub_duration":0.68022165899999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'560","reported_seq":599,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.598604+0000","last_change":"2023-11-18T19:24:34.598604+0000","last_active":"2023-11-18T19:24:34.598604+0000","last_peered":"2023-11-18T19:24:34.598604+0000","last_clean":"2023-11-18T19:24:34.598604+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:24:34.598604+0000","last_undegraded":"2023-11-18T19:24:34.598604+0000","last_fullsized":"2023-11-18T19:24:34.598604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'560","last_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_deep_scrub":"29'560","last_deep_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.598509+0000","objects_scrubbed":106,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:12:43.193975+0000","scrub_duration":0.13571029200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":658,"num_write_kb":29852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":978255,"num_omap_keys":1693,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4629","reported_seq":4754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.189441+0000","last_change":"2023-11-18T19:25:07.189475+0000","last_active":"2023-11-18T19:25:07.189441+0000","last_peered":"2023-11-18T19:25:07.189441+0000","last_clean":"2023-11-18T19:25:07.189441+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:25:07.189441+0000","last_undegraded":"2023-11-18T19:25:07.189441+0000","last_fullsized":"2023-11-18T19:25:07.189441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4629","last_scrub_stamp":"2023-11-18T19:25:07.189345+0000","last_deep_scrub":"29'4629","last_deep_scrub_stamp":"2023-11-18T19:25:07.189345+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.189345+0000","objects_scrubbed":2278,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:44.817645+0000","scrub_duration":1.3284081409999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54570935,"num_objects":2278,"num_object_clones":0,"num_object_copies":9112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6188,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'1644","reported_seq":1705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.496598+0000","last_change":"2023-11-18T19:24:53.496662+0000","last_active":"2023-11-18T19:24:53.496598+0000","last_peered":"2023-11-18T19:24:53.496598+0000","last_clean":"2023-11-18T19:24:53.496598+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:53.496598+0000","last_undegraded":"2023-11-18T19:24:53.496598+0000","last_fullsized":"2023-11-18T19:24:53.496598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1644","last_scrub_stamp":"2023-11-18T19:24:53.496501+0000","last_deep_scrub":"29'1644","last_deep_scrub_stamp":"2023-11-18T19:24:53.496501+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.496501+0000","objects_scrubbed":717,"log_size":1644,"log_dups_size":0,"ondisk_log_size":1644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:41.122447+0000","scrub_duration":0.98882590699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'1005","reported_seq":1044,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:18.924455+0000","last_change":"2023-11-18T19:25:18.924518+0000","last_active":"2023-11-18T19:25:18.924455+0000","last_peered":"2023-11-18T19:25:18.924455+0000","last_clean":"2023-11-18T19:25:18.924455+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:25:18.924455+0000","last_undegraded":"2023-11-18T19:25:18.924455+0000","last_fullsized":"2023-11-18T19:25:18.924455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1005","last_scrub_stamp":"2023-11-18T19:25:18.924358+0000","last_deep_scrub":"29'1005","last_deep_scrub_stamp":"2023-11-18T19:25:18.924358+0000","last_clean_scrub_stamp":"2023-11-18T19:25:18.924358+0000","objects_scrubbed":113,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:03:40.989442+0000","scrub_duration":0.22984734500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":34394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1078371,"num_omap_keys":1867,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4679","reported_seq":4804,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:09.150475+0000","last_change":"2023-11-18T19:25:09.150552+0000","last_active":"2023-11-18T19:25:09.150475+0000","last_peered":"2023-11-18T19:25:09.150475+0000","last_clean":"2023-11-18T19:25:09.150475+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:25:09.150475+0000","last_undegraded":"2023-11-18T19:25:09.150475+0000","last_fullsized":"2023-11-18T19:25:09.150475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4679","last_scrub_stamp":"2023-11-18T19:25:09.150298+0000","last_deep_scrub":"29'4679","last_deep_scrub_stamp":"2023-11-18T19:25:09.150298+0000","last_clean_scrub_stamp":"2023-11-18T19:25:09.150298+0000","objects_scrubbed":2317,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:58.225327+0000","scrub_duration":1.677471261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46904542,"num_objects":2317,"num_object_clones":0,"num_object_copies":9268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2317,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6289,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'1726","reported_seq":1789,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:08.653452+0000","last_change":"2023-11-18T19:25:08.653486+0000","last_active":"2023-11-18T19:25:08.653452+0000","last_peered":"2023-11-18T19:25:08.653452+0000","last_clean":"2023-11-18T19:25:08.653452+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:25:08.653452+0000","last_undegraded":"2023-11-18T19:25:08.653452+0000","last_fullsized":"2023-11-18T19:25:08.653452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1726","last_scrub_stamp":"2023-11-18T19:25:08.653384+0000","last_deep_scrub":"29'1726","last_deep_scrub_stamp":"2023-11-18T19:25:08.653384+0000","last_clean_scrub_stamp":"2023-11-18T19:25:08.653384+0000","objects_scrubbed":756,"log_size":1726,"log_dups_size":0,"ondisk_log_size":1726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:43.086088+0000","scrub_duration":0.73062439300000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'674","reported_seq":712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.172427+0000","last_change":"2023-11-18T19:24:43.172427+0000","last_active":"2023-11-18T19:24:43.172427+0000","last_peered":"2023-11-18T19:24:43.172427+0000","last_clean":"2023-11-18T19:24:43.172427+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:43.172427+0000","last_undegraded":"2023-11-18T19:24:43.172427+0000","last_fullsized":"2023-11-18T19:24:43.172427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'674","last_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_deep_scrub":"29'674","last_deep_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.172207+0000","objects_scrubbed":87,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:29.245092+0000","scrub_duration":0.19110829500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":764,"num_write_kb":21557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":780047,"num_omap_keys":1353,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4788","reported_seq":4814,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.131001+0000","last_change":"2023-11-18T19:06:41.613917+0000","last_active":"2023-11-18T19:24:27.131001+0000","last_peered":"2023-11-18T19:24:27.131001+0000","last_clean":"2023-11-18T19:24:27.131001+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:24:27.131001+0000","last_undegraded":"2023-11-18T19:24:27.131001+0000","last_fullsized":"2023-11-18T19:24:27.131001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53454220,"num_objects":2315,"num_object_clones":0,"num_object_copies":9260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2315,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6433,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'1690","reported_seq":1754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.385083+0000","last_change":"2023-11-18T19:24:46.385114+0000","last_active":"2023-11-18T19:24:46.385083+0000","last_peered":"2023-11-18T19:24:46.385083+0000","last_clean":"2023-11-18T19:24:46.385083+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:46.385083+0000","last_undegraded":"2023-11-18T19:24:46.385083+0000","last_fullsized":"2023-11-18T19:24:46.385083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1690","last_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_deep_scrub":"29'1690","last_deep_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.385005+0000","objects_scrubbed":779,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:23.935739+0000","scrub_duration":0.68843222599999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'380","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.618846+0000","last_change":"2023-11-18T19:24:50.618882+0000","last_active":"2023-11-18T19:24:50.618846+0000","last_peered":"2023-11-18T19:24:50.618846+0000","last_clean":"2023-11-18T19:24:50.618846+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:50.618846+0000","last_undegraded":"2023-11-18T19:24:50.618846+0000","last_fullsized":"2023-11-18T19:24:50.618846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'380","last_scrub_stamp":"2023-11-18T19:24:50.618783+0000","last_deep_scrub":"29'380","last_deep_scrub_stamp":"2023-11-18T19:24:50.618783+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.618783+0000","objects_scrubbed":85,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:20:10.226608+0000","scrub_duration":0.092155729000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":464,"num_write_kb":13159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760791,"num_omap_keys":1317,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4549","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.915418+0000","last_change":"2023-11-18T19:24:50.915485+0000","last_active":"2023-11-18T19:24:50.915418+0000","last_peered":"2023-11-18T19:24:50.915418+0000","last_clean":"2023-11-18T19:24:50.915418+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:50.915418+0000","last_undegraded":"2023-11-18T19:24:50.915418+0000","last_fullsized":"2023-11-18T19:24:50.915418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4549","last_scrub_stamp":"2023-11-18T19:24:50.915309+0000","last_deep_scrub":"29'4549","last_deep_scrub_stamp":"2023-11-18T19:24:50.915309+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.915309+0000","objects_scrubbed":2272,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:26.067841+0000","scrub_duration":1.6764920270000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6093,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'1720","reported_seq":1785,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.763675+0000","last_change":"2023-11-18T19:24:40.763675+0000","last_active":"2023-11-18T19:24:40.763675+0000","last_peered":"2023-11-18T19:24:40.763675+0000","last_clean":"2023-11-18T19:24:40.763675+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:40.763675+0000","last_undegraded":"2023-11-18T19:24:40.763675+0000","last_fullsized":"2023-11-18T19:24:40.763675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1720","last_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_deep_scrub":"29'1720","last_deep_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.763553+0000","objects_scrubbed":775,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:21.551774+0000","scrub_duration":0.70050171100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'457","reported_seq":496,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.976674+0000","last_change":"2023-11-18T19:24:35.976674+0000","last_active":"2023-11-18T19:24:35.976674+0000","last_peered":"2023-11-18T19:24:35.976674+0000","last_clean":"2023-11-18T19:24:35.976674+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:35.976674+0000","last_undegraded":"2023-11-18T19:24:35.976674+0000","last_fullsized":"2023-11-18T19:24:35.976674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'457","last_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_deep_scrub":"29'457","last_deep_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.976524+0000","objects_scrubbed":106,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:11.920966+0000","scrub_duration":0.135262152,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":559,"num_write_kb":13211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":791411,"num_omap_keys":1371,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4506","reported_seq":4636,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:12.627032+0000","last_change":"2023-11-18T19:25:12.627181+0000","last_active":"2023-11-18T19:25:12.627032+0000","last_peered":"2023-11-18T19:25:12.627032+0000","last_clean":"2023-11-18T19:25:12.627032+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:25:12.627032+0000","last_undegraded":"2023-11-18T19:25:12.627032+0000","last_fullsized":"2023-11-18T19:25:12.627032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4506","last_scrub_stamp":"2023-11-18T19:25:12.626903+0000","last_deep_scrub":"29'4506","last_deep_scrub_stamp":"2023-11-18T19:25:12.626903+0000","last_clean_scrub_stamp":"2023-11-18T19:25:12.626903+0000","objects_scrubbed":2243,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:44.229499+0000","scrub_duration":1.0906887300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40895696,"num_objects":2243,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6032,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.229729+0000","last_change":"2023-11-18T19:24:35.229793+0000","last_active":"2023-11-18T19:24:35.229729+0000","last_peered":"2023-11-18T19:24:35.229729+0000","last_clean":"2023-11-18T19:24:35.229729+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:35.229729+0000","last_undegraded":"2023-11-18T19:24:35.229729+0000","last_fullsized":"2023-11-18T19:24:35.229729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.229558+0000","objects_scrubbed":760,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:59.305496+0000","scrub_duration":0.89828437900000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":760,"num_object_clones":0,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'378","reported_seq":416,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.761185+0000","last_change":"2023-11-18T19:24:40.761185+0000","last_active":"2023-11-18T19:24:40.761185+0000","last_peered":"2023-11-18T19:24:40.761185+0000","last_clean":"2023-11-18T19:24:40.761185+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:40.761185+0000","last_undegraded":"2023-11-18T19:24:40.761185+0000","last_fullsized":"2023-11-18T19:24:40.761185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'378","last_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_deep_scrub":"29'378","last_deep_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.761091+0000","objects_scrubbed":103,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.893620+0000","scrub_duration":0.17205548400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":490,"num_write_kb":9347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960166,"num_omap_keys":1656,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4642","reported_seq":4765,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:19.042344+0000","last_change":"2023-11-18T19:25:19.042391+0000","last_active":"2023-11-18T19:25:19.042344+0000","last_peered":"2023-11-18T19:25:19.042344+0000","last_clean":"2023-11-18T19:25:19.042344+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:25:19.042344+0000","last_undegraded":"2023-11-18T19:25:19.042344+0000","last_fullsized":"2023-11-18T19:25:19.042344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4642","last_scrub_stamp":"2023-11-18T19:25:19.042217+0000","last_deep_scrub":"29'4642","last_deep_scrub_stamp":"2023-11-18T19:25:19.042217+0000","last_clean_scrub_stamp":"2023-11-18T19:25:19.042217+0000","objects_scrubbed":2314,"log_size":4642,"log_dups_size":0,"ondisk_log_size":4642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:20:58.606129+0000","scrub_duration":1.583892517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39856077,"num_objects":2314,"num_object_clones":0,"num_object_copies":9256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6236,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'1678","reported_seq":1749,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:52.077506+0000","last_change":"2023-11-18T19:24:52.077506+0000","last_active":"2023-11-18T19:24:52.077506+0000","last_peered":"2023-11-18T19:24:52.077506+0000","last_clean":"2023-11-18T19:24:52.077506+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:52.077506+0000","last_undegraded":"2023-11-18T19:24:52.077506+0000","last_fullsized":"2023-11-18T19:24:52.077506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1678","last_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_deep_scrub":"29'1678","last_deep_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_clean_scrub_stamp":"2023-11-18T19:24:52.077370+0000","objects_scrubbed":752,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:34.158108+0000","scrub_duration":0.83265436500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'551","reported_seq":590,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:09.486063+0000","last_change":"2023-11-18T19:25:09.486063+0000","last_active":"2023-11-18T19:25:09.486063+0000","last_peered":"2023-11-18T19:25:09.486063+0000","last_clean":"2023-11-18T19:25:09.486063+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:25:09.486063+0000","last_undegraded":"2023-11-18T19:25:09.486063+0000","last_fullsized":"2023-11-18T19:25:09.486063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'551","last_scrub_stamp":"2023-11-18T19:25:09.485788+0000","last_deep_scrub":"29'551","last_deep_scrub_stamp":"2023-11-18T19:25:09.485788+0000","last_clean_scrub_stamp":"2023-11-18T19:25:09.485788+0000","objects_scrubbed":119,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:20:49.049700+0000","scrub_duration":0.22252060300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":667,"num_write_kb":5679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":118,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1383140,"num_omap_keys":2394,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4441","reported_seq":4561,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:12.487658+0000","last_change":"2023-11-18T19:25:12.487713+0000","last_active":"2023-11-18T19:25:12.487658+0000","last_peered":"2023-11-18T19:25:12.487658+0000","last_clean":"2023-11-18T19:25:12.487658+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:25:12.487658+0000","last_undegraded":"2023-11-18T19:25:12.487658+0000","last_fullsized":"2023-11-18T19:25:12.487658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4441","last_scrub_stamp":"2023-11-18T19:25:12.487558+0000","last_deep_scrub":"29'4441","last_deep_scrub_stamp":"2023-11-18T19:25:12.487558+0000","last_clean_scrub_stamp":"2023-11-18T19:25:12.487558+0000","objects_scrubbed":2216,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:05.929221+0000","scrub_duration":1.0898806889999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54095014,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'1598","reported_seq":1661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.624746+0000","last_change":"2023-11-18T19:24:47.624774+0000","last_active":"2023-11-18T19:24:47.624746+0000","last_peered":"2023-11-18T19:24:47.624746+0000","last_clean":"2023-11-18T19:24:47.624746+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:47.624746+0000","last_undegraded":"2023-11-18T19:24:47.624746+0000","last_fullsized":"2023-11-18T19:24:47.624746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1598","last_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_deep_scrub":"29'1598","last_deep_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.624684+0000","objects_scrubbed":728,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:24.581876+0000","scrub_duration":1.2034515859999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'473","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.898110+0000","last_change":"2023-11-18T19:24:40.898110+0000","last_active":"2023-11-18T19:24:40.898110+0000","last_peered":"2023-11-18T19:24:40.898110+0000","last_clean":"2023-11-18T19:24:40.898110+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:40.898110+0000","last_undegraded":"2023-11-18T19:24:40.898110+0000","last_fullsized":"2023-11-18T19:24:40.898110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.897977+0000","objects_scrubbed":109,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:16:56.736936+0000","scrub_duration":0.11219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":17513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":107,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983835,"num_omap_keys":1695,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4424","reported_seq":4447,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:27.121295+0000","last_change":"2023-11-18T19:06:41.598390+0000","last_active":"2023-11-18T19:24:27.121295+0000","last_peered":"2023-11-18T19:24:27.121295+0000","last_clean":"2023-11-18T19:24:27.121295+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:24:27.121295+0000","last_undegraded":"2023-11-18T19:24:27.121295+0000","last_fullsized":"2023-11-18T19:24:27.121295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":0,"log_size":4424,"log_dups_size":0,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46166125,"num_objects":2199,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5987,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'1681","reported_seq":1742,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.616613+0000","last_change":"2023-11-18T19:24:57.616644+0000","last_active":"2023-11-18T19:24:57.616613+0000","last_peered":"2023-11-18T19:24:57.616613+0000","last_clean":"2023-11-18T19:24:57.616613+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:57.616613+0000","last_undegraded":"2023-11-18T19:24:57.616613+0000","last_fullsized":"2023-11-18T19:24:57.616613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1681","last_scrub_stamp":"2023-11-18T19:24:57.616554+0000","last_deep_scrub":"29'1681","last_deep_scrub_stamp":"2023-11-18T19:24:57.616554+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.616554+0000","objects_scrubbed":735,"log_size":1681,"log_dups_size":0,"ondisk_log_size":1681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:39.080879+0000","scrub_duration":1.0186718859999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":735,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'709","reported_seq":747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.408025+0000","last_change":"2023-11-18T19:24:29.886066+0000","last_active":"2023-11-18T19:24:46.408025+0000","last_peered":"2023-11-18T19:24:46.408025+0000","last_clean":"2023-11-18T19:24:46.408025+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:46.408025+0000","last_undegraded":"2023-11-18T19:24:46.408025+0000","last_fullsized":"2023-11-18T19:24:46.408025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'708","last_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_deep_scrub":"29'708","last_deep_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_clean_scrub_stamp":"2023-11-18T19:24:29.885926+0000","objects_scrubbed":114,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:27.530776+0000","scrub_duration":0.20191796100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":819,"num_write_kb":30026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1073426,"num_omap_keys":1850,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4438","reported_seq":4560,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:17.339371+0000","last_change":"2023-11-18T19:25:17.339439+0000","last_active":"2023-11-18T19:25:17.339371+0000","last_peered":"2023-11-18T19:25:17.339371+0000","last_clean":"2023-11-18T19:25:17.339371+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:25:17.339371+0000","last_undegraded":"2023-11-18T19:25:17.339371+0000","last_fullsized":"2023-11-18T19:25:17.339371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4438","last_scrub_stamp":"2023-11-18T19:25:17.339302+0000","last_deep_scrub":"29'4438","last_deep_scrub_stamp":"2023-11-18T19:25:17.339302+0000","last_clean_scrub_stamp":"2023-11-18T19:25:17.339302+0000","objects_scrubbed":2240,"log_size":4438,"log_dups_size":0,"ondisk_log_size":4438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:44.462434+0000","scrub_duration":1.144069467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53099612,"num_objects":2240,"num_object_clones":0,"num_object_copies":8960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'1645","reported_seq":1709,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.764519+0000","last_change":"2023-11-18T19:24:42.764519+0000","last_active":"2023-11-18T19:24:42.764519+0000","last_peered":"2023-11-18T19:24:42.764519+0000","last_clean":"2023-11-18T19:24:42.764519+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:42.764519+0000","last_undegraded":"2023-11-18T19:24:42.764519+0000","last_fullsized":"2023-11-18T19:24:42.764519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1645","last_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_deep_scrub":"29'1645","last_deep_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.764426+0000","objects_scrubbed":754,"log_size":1645,"log_dups_size":0,"ondisk_log_size":1645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:47:41.052967+0000","scrub_duration":0.66715310100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'864","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.887022+0000","last_change":"2023-11-18T19:24:38.887069+0000","last_active":"2023-11-18T19:24:38.887022+0000","last_peered":"2023-11-18T19:24:38.887022+0000","last_clean":"2023-11-18T19:24:38.887022+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:38.887022+0000","last_undegraded":"2023-11-18T19:24:38.887022+0000","last_fullsized":"2023-11-18T19:24:38.887022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'864","last_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_deep_scrub":"29'864","last_deep_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.886964+0000","objects_scrubbed":105,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:30.822719+0000","scrub_duration":0.11150884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":978,"num_write_kb":22256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1222405,"num_omap_keys":2117,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4525","reported_seq":4648,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.091600+0000","last_change":"2023-11-18T19:24:59.091600+0000","last_active":"2023-11-18T19:24:59.091600+0000","last_peered":"2023-11-18T19:24:59.091600+0000","last_clean":"2023-11-18T19:24:59.091600+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:59.091600+0000","last_undegraded":"2023-11-18T19:24:59.091600+0000","last_fullsized":"2023-11-18T19:24:59.091600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4525","last_scrub_stamp":"2023-11-18T19:24:59.091460+0000","last_deep_scrub":"29'4525","last_deep_scrub_stamp":"2023-11-18T19:24:59.091460+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.091460+0000","objects_scrubbed":2280,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:31.726906+0000","scrub_duration":1.355858741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879149,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6129,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'1659","reported_seq":1721,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.452862+0000","last_change":"2023-11-18T19:24:39.452988+0000","last_active":"2023-11-18T19:24:39.452862+0000","last_peered":"2023-11-18T19:24:39.452862+0000","last_clean":"2023-11-18T19:24:39.452862+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:39.452862+0000","last_undegraded":"2023-11-18T19:24:39.452862+0000","last_fullsized":"2023-11-18T19:24:39.452862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.452680+0000","objects_scrubbed":759,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:20.443722+0000","scrub_duration":0.99957551600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":759,"num_object_clones":0,"num_object_copies":1518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'469","reported_seq":506,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:17.814985+0000","last_change":"2023-11-18T19:25:17.815067+0000","last_active":"2023-11-18T19:25:17.814985+0000","last_peered":"2023-11-18T19:25:17.814985+0000","last_clean":"2023-11-18T19:25:17.814985+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:25:17.814985+0000","last_undegraded":"2023-11-18T19:25:17.814985+0000","last_fullsized":"2023-11-18T19:25:17.814985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'469","last_scrub_stamp":"2023-11-18T19:25:17.814890+0000","last_deep_scrub":"29'469","last_deep_scrub_stamp":"2023-11-18T19:25:17.814890+0000","last_clean_scrub_stamp":"2023-11-18T19:25:17.814890+0000","objects_scrubbed":95,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:26.126121+0000","scrub_duration":0.096433412999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":562,"num_write_kb":25902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1057213,"num_omap_keys":1825,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4461","reported_seq":4580,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.396551+0000","last_change":"2023-11-18T19:24:55.396551+0000","last_active":"2023-11-18T19:24:55.396551+0000","last_peered":"2023-11-18T19:24:55.396551+0000","last_clean":"2023-11-18T19:24:55.396551+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:55.396551+0000","last_undegraded":"2023-11-18T19:24:55.396551+0000","last_fullsized":"2023-11-18T19:24:55.396551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4461","last_scrub_stamp":"2023-11-18T19:24:55.396432+0000","last_deep_scrub":"29'4461","last_deep_scrub_stamp":"2023-11-18T19:24:55.396432+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.396432+0000","objects_scrubbed":2174,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:12:03.605551+0000","scrub_duration":1.6315117909999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66632640,"num_objects":2174,"num_object_clones":0,"num_object_copies":8696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5996,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1636","reported_seq":1697,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.238531+0000","last_change":"2023-11-18T19:24:43.238571+0000","last_active":"2023-11-18T19:24:43.238531+0000","last_peered":"2023-11-18T19:24:43.238531+0000","last_clean":"2023-11-18T19:24:43.238531+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:43.238531+0000","last_undegraded":"2023-11-18T19:24:43.238531+0000","last_fullsized":"2023-11-18T19:24:43.238531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1636","last_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_deep_scrub":"29'1636","last_deep_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.238470+0000","objects_scrubbed":739,"log_size":1636,"log_dups_size":0,"ondisk_log_size":1636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.195661+0000","scrub_duration":0.60574622300000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1304","reported_seq":1340,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.520069+0000","last_change":"2023-11-18T19:24:33.520162+0000","last_active":"2023-11-18T19:24:33.520069+0000","last_peered":"2023-11-18T19:24:33.520069+0000","last_clean":"2023-11-18T19:24:33.520069+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:33.520069+0000","last_undegraded":"2023-11-18T19:24:33.520069+0000","last_fullsized":"2023-11-18T19:24:33.520069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1304","last_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_deep_scrub":"29'1304","last_deep_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.519964+0000","objects_scrubbed":92,"log_size":1304,"log_dups_size":0,"ondisk_log_size":1304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:51.501118+0000","scrub_duration":0.21152945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1397,"num_write_kb":22068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":927405,"num_omap_keys":1607,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4689","reported_seq":4822,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:13.575950+0000","last_change":"2023-11-18T19:25:13.576042+0000","last_active":"2023-11-18T19:25:13.575950+0000","last_peered":"2023-11-18T19:25:13.575950+0000","last_clean":"2023-11-18T19:25:13.575950+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:25:13.575950+0000","last_undegraded":"2023-11-18T19:25:13.575950+0000","last_fullsized":"2023-11-18T19:25:13.575950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4689","last_scrub_stamp":"2023-11-18T19:25:13.575746+0000","last_deep_scrub":"29'4689","last_deep_scrub_stamp":"2023-11-18T19:25:13.575746+0000","last_clean_scrub_stamp":"2023-11-18T19:25:13.575746+0000","objects_scrubbed":2318,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:21:02.650775+0000","scrub_duration":1.463575847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111025,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6322,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4432","reported_seq":4552,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.216746+0000","last_change":"2023-11-18T19:25:00.216796+0000","last_active":"2023-11-18T19:25:00.216746+0000","last_peered":"2023-11-18T19:25:00.216746+0000","last_clean":"2023-11-18T19:25:00.216746+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:25:00.216746+0000","last_undegraded":"2023-11-18T19:25:00.216746+0000","last_fullsized":"2023-11-18T19:25:00.216746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4432","last_scrub_stamp":"2023-11-18T19:25:00.216656+0000","last_deep_scrub":"29'4432","last_deep_scrub_stamp":"2023-11-18T19:25:00.216656+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.216656+0000","objects_scrubbed":2171,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:37.844955+0000","scrub_duration":1.2639129570000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32576492,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5932,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'1679","reported_seq":1742,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.978485+0000","last_change":"2023-11-18T19:24:48.978523+0000","last_active":"2023-11-18T19:24:48.978485+0000","last_peered":"2023-11-18T19:24:48.978485+0000","last_clean":"2023-11-18T19:24:48.978485+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:48.978485+0000","last_undegraded":"2023-11-18T19:24:48.978485+0000","last_fullsized":"2023-11-18T19:24:48.978485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1679","last_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_deep_scrub":"29'1679","last_deep_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.978288+0000","objects_scrubbed":751,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:07:55.106118+0000","scrub_duration":1.0109235620000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":751,"num_object_clones":0,"num_object_copies":1502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'629","reported_seq":666,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.400778+0000","last_change":"2023-11-18T19:25:00.400826+0000","last_active":"2023-11-18T19:25:00.400778+0000","last_peered":"2023-11-18T19:25:00.400778+0000","last_clean":"2023-11-18T19:25:00.400778+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:25:00.400778+0000","last_undegraded":"2023-11-18T19:25:00.400778+0000","last_fullsized":"2023-11-18T19:25:00.400778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'629","last_scrub_stamp":"2023-11-18T19:25:00.400713+0000","last_deep_scrub":"29'629","last_deep_scrub_stamp":"2023-11-18T19:25:00.400713+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.400713+0000","objects_scrubbed":96,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:12.384151+0000","scrub_duration":0.115138529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":714,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686812,"num_omap_keys":1180,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4401","reported_seq":4468,"reported_epoch":29,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-18T19:25:32.142579+0000","last_change":"2023-11-18T19:25:31.475530+0000","last_active":"2023-11-18T19:25:32.142579+0000","last_peered":"2023-11-18T19:25:32.142579+0000","last_clean":"2023-11-18T19:25:32.142579+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:25:32.142579+0000","last_undegraded":"2023-11-18T19:25:32.142579+0000","last_fullsized":"2023-11-18T19:25:32.142579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-18T19:06:40.555839+0000","last_clean_scrub_stamp":"2023-11-18T19:06:40.555839+0000","objects_scrubbed":974,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48972751,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5897,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'1811","reported_seq":1874,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.250798+0000","last_change":"2023-11-18T19:24:55.250843+0000","last_active":"2023-11-18T19:24:55.250798+0000","last_peered":"2023-11-18T19:24:55.250798+0000","last_clean":"2023-11-18T19:24:55.250798+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:55.250798+0000","last_undegraded":"2023-11-18T19:24:55.250798+0000","last_fullsized":"2023-11-18T19:24:55.250798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1811","last_scrub_stamp":"2023-11-18T19:24:55.250715+0000","last_deep_scrub":"29'1811","last_deep_scrub_stamp":"2023-11-18T19:24:55.250715+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.250715+0000","objects_scrubbed":790,"log_size":1811,"log_dups_size":0,"ondisk_log_size":1811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:47:53.539256+0000","scrub_duration":0.80458674799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":790,"num_object_clones":0,"num_object_copies":1580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'395","reported_seq":432,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.625437+0000","last_change":"2023-11-18T19:24:35.625514+0000","last_active":"2023-11-18T19:24:35.625437+0000","last_peered":"2023-11-18T19:24:35.625437+0000","last_clean":"2023-11-18T19:24:35.625437+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:35.625437+0000","last_undegraded":"2023-11-18T19:24:35.625437+0000","last_fullsized":"2023-11-18T19:24:35.625437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'395","last_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_deep_scrub":"29'395","last_deep_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.625354+0000","objects_scrubbed":89,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:07.903929+0000","scrub_duration":0.13174055800000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":17267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624270,"num_omap_keys":1080,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'754","reported_seq":791,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.386128+0000","last_change":"2023-11-18T19:24:54.386184+0000","last_active":"2023-11-18T19:24:54.386128+0000","last_peered":"2023-11-18T19:24:54.386128+0000","last_clean":"2023-11-18T19:24:54.386128+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:24:54.386128+0000","last_undegraded":"2023-11-18T19:24:54.386128+0000","last_fullsized":"2023-11-18T19:24:54.386128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'754","last_scrub_stamp":"2023-11-18T19:24:54.386020+0000","last_deep_scrub":"29'754","last_deep_scrub_stamp":"2023-11-18T19:24:54.386020+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.386020+0000","objects_scrubbed":84,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:45.723280+0000","scrub_duration":0.112168427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":33823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734298,"num_omap_keys":1270,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1722","reported_seq":1786,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.703281+0000","last_change":"2023-11-18T19:24:57.703314+0000","last_active":"2023-11-18T19:24:57.703281+0000","last_peered":"2023-11-18T19:24:57.703281+0000","last_clean":"2023-11-18T19:24:57.703281+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:57.703281+0000","last_undegraded":"2023-11-18T19:24:57.703281+0000","last_fullsized":"2023-11-18T19:24:57.703281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1722","last_scrub_stamp":"2023-11-18T19:24:57.703180+0000","last_deep_scrub":"29'1722","last_deep_scrub_stamp":"2023-11-18T19:24:57.703180+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.703180+0000","objects_scrubbed":753,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:59.582754+0000","scrub_duration":0.816760708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":753,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4623","reported_seq":4747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:10.102500+0000","last_change":"2023-11-18T19:25:10.102527+0000","last_active":"2023-11-18T19:25:10.102500+0000","last_peered":"2023-11-18T19:25:10.102500+0000","last_clean":"2023-11-18T19:25:10.102500+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:25:10.102500+0000","last_undegraded":"2023-11-18T19:25:10.102500+0000","last_fullsized":"2023-11-18T19:25:10.102500+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4623","last_scrub_stamp":"2023-11-18T19:25:10.102391+0000","last_deep_scrub":"29'4623","last_deep_scrub_stamp":"2023-11-18T19:25:10.102391+0000","last_clean_scrub_stamp":"2023-11-18T19:25:10.102391+0000","objects_scrubbed":2330,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:51:13.104536+0000","scrub_duration":0.98392403900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50816520,"num_objects":2330,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6227,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'347","reported_seq":383,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.606792+0000","last_change":"2023-11-18T19:24:47.606905+0000","last_active":"2023-11-18T19:24:47.606792+0000","last_peered":"2023-11-18T19:24:47.606792+0000","last_clean":"2023-11-18T19:24:47.606792+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:24:47.606792+0000","last_undegraded":"2023-11-18T19:24:47.606792+0000","last_fullsized":"2023-11-18T19:24:47.606792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'347","last_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_deep_scrub":"29'347","last_deep_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.606700+0000","objects_scrubbed":94,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:30.134246+0000","scrub_duration":0.098167455000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":92,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":803356,"num_omap_keys":1386,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'1649","reported_seq":1711,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.232037+0000","last_change":"2023-11-18T19:24:36.232095+0000","last_active":"2023-11-18T19:24:36.232037+0000","last_peered":"2023-11-18T19:24:36.232037+0000","last_clean":"2023-11-18T19:24:36.232037+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:36.232037+0000","last_undegraded":"2023-11-18T19:24:36.232037+0000","last_fullsized":"2023-11-18T19:24:36.232037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1649","last_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_deep_scrub":"29'1649","last_deep_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.231937+0000","objects_scrubbed":750,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:22.588964+0000","scrub_duration":0.88128349299999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4639","reported_seq":4762,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.554068+0000","last_change":"2023-11-18T19:25:03.554103+0000","last_active":"2023-11-18T19:25:03.554068+0000","last_peered":"2023-11-18T19:25:03.554068+0000","last_clean":"2023-11-18T19:25:03.554068+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:25:03.554068+0000","last_undegraded":"2023-11-18T19:25:03.554068+0000","last_fullsized":"2023-11-18T19:25:03.554068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4639","last_scrub_stamp":"2023-11-18T19:25:03.553986+0000","last_deep_scrub":"29'4639","last_deep_scrub_stamp":"2023-11-18T19:25:03.553986+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.553986+0000","objects_scrubbed":2293,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:19.628587+0000","scrub_duration":1.600373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38511782,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6251,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'1674","reported_seq":1737,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.367314+0000","last_change":"2023-11-18T19:24:36.367314+0000","last_active":"2023-11-18T19:24:36.367314+0000","last_peered":"2023-11-18T19:24:36.367314+0000","last_clean":"2023-11-18T19:24:36.367314+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:36.367314+0000","last_undegraded":"2023-11-18T19:24:36.367314+0000","last_fullsized":"2023-11-18T19:24:36.367314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1674","last_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_deep_scrub":"29'1674","last_deep_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.367175+0000","objects_scrubbed":749,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:16.832308+0000","scrub_duration":0.77027508200000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":749,"num_object_clones":0,"num_object_copies":1498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'1755","reported_seq":1819,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.422509+0000","last_change":"2023-11-18T19:24:51.422509+0000","last_active":"2023-11-18T19:24:51.422509+0000","last_peered":"2023-11-18T19:24:51.422509+0000","last_clean":"2023-11-18T19:24:51.422509+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:51.422509+0000","last_undegraded":"2023-11-18T19:24:51.422509+0000","last_fullsized":"2023-11-18T19:24:51.422509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1755","last_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_deep_scrub":"29'1755","last_deep_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.422369+0000","objects_scrubbed":772,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:34:08.088915+0000","scrub_duration":0.69839206799999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":846,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'1665","reported_seq":1729,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.392072+0000","last_change":"2023-11-18T19:24:47.392170+0000","last_active":"2023-11-18T19:24:47.392072+0000","last_peered":"2023-11-18T19:24:47.392072+0000","last_clean":"2023-11-18T19:24:47.392072+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:47.392072+0000","last_undegraded":"2023-11-18T19:24:47.392072+0000","last_fullsized":"2023-11-18T19:24:47.392072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1665","last_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_deep_scrub":"29'1665","last_deep_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.391954+0000","objects_scrubbed":747,"log_size":1665,"log_dups_size":0,"ondisk_log_size":1665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:28.856279+0000","scrub_duration":1.3015815769999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'1697","reported_seq":1762,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.060679+0000","last_change":"2023-11-18T19:24:37.060679+0000","last_active":"2023-11-18T19:24:37.060679+0000","last_peered":"2023-11-18T19:24:37.060679+0000","last_clean":"2023-11-18T19:24:37.060679+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:37.060679+0000","last_undegraded":"2023-11-18T19:24:37.060679+0000","last_fullsized":"2023-11-18T19:24:37.060679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1697","last_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_deep_scrub":"29'1697","last_deep_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.060556+0000","objects_scrubbed":776,"log_size":1697,"log_dups_size":0,"ondisk_log_size":1697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:32.193085+0000","scrub_duration":0.65753342699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'1757","reported_seq":1823,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:02.472378+0000","last_change":"2023-11-18T19:25:02.472417+0000","last_active":"2023-11-18T19:25:02.472378+0000","last_peered":"2023-11-18T19:25:02.472378+0000","last_clean":"2023-11-18T19:25:02.472378+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:25:02.472378+0000","last_undegraded":"2023-11-18T19:25:02.472378+0000","last_fullsized":"2023-11-18T19:25:02.472378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1757","last_scrub_stamp":"2023-11-18T19:25:02.472285+0000","last_deep_scrub":"29'1757","last_deep_scrub_stamp":"2023-11-18T19:25:02.472285+0000","last_clean_scrub_stamp":"2023-11-18T19:25:02.472285+0000","objects_scrubbed":776,"log_size":1757,"log_dups_size":0,"ondisk_log_size":1757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:48:00.760826+0000","scrub_duration":1.028693885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'1717","reported_seq":1781,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.102506+0000","last_change":"2023-11-18T19:25:00.102551+0000","last_active":"2023-11-18T19:25:00.102506+0000","last_peered":"2023-11-18T19:25:00.102506+0000","last_clean":"2023-11-18T19:25:00.102506+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:25:00.102506+0000","last_undegraded":"2023-11-18T19:25:00.102506+0000","last_fullsized":"2023-11-18T19:25:00.102506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1717","last_scrub_stamp":"2023-11-18T19:25:00.102415+0000","last_deep_scrub":"29'1717","last_deep_scrub_stamp":"2023-11-18T19:25:00.102415+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.102415+0000","objects_scrubbed":756,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:35.093032+0000","scrub_duration":0.69076674599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":802,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'1737","reported_seq":1801,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.490923+0000","last_change":"2023-11-18T19:24:39.490959+0000","last_active":"2023-11-18T19:24:39.490923+0000","last_peered":"2023-11-18T19:24:39.490923+0000","last_clean":"2023-11-18T19:24:39.490923+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:39.490923+0000","last_undegraded":"2023-11-18T19:24:39.490923+0000","last_fullsized":"2023-11-18T19:24:39.490923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1737","last_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_deep_scrub":"29'1737","last_deep_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.490839+0000","objects_scrubbed":775,"log_size":1737,"log_dups_size":0,"ondisk_log_size":1737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:03.420048+0000","scrub_duration":0.91801021400000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'1673","reported_seq":1734,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:05.481509+0000","last_change":"2023-11-18T19:25:05.481556+0000","last_active":"2023-11-18T19:25:05.481509+0000","last_peered":"2023-11-18T19:25:05.481509+0000","last_clean":"2023-11-18T19:25:05.481509+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:25:05.481509+0000","last_undegraded":"2023-11-18T19:25:05.481509+0000","last_fullsized":"2023-11-18T19:25:05.481509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1673","last_scrub_stamp":"2023-11-18T19:25:05.481414+0000","last_deep_scrub":"29'1673","last_deep_scrub_stamp":"2023-11-18T19:25:05.481414+0000","last_clean_scrub_stamp":"2023-11-18T19:25:05.481414+0000","objects_scrubbed":716,"log_size":1673,"log_dups_size":0,"ondisk_log_size":1673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:39.914118+0000","scrub_duration":0.96291879400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'1670","reported_seq":1734,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.792839+0000","last_change":"2023-11-18T19:24:36.792888+0000","last_active":"2023-11-18T19:24:36.792839+0000","last_peered":"2023-11-18T19:24:36.792839+0000","last_clean":"2023-11-18T19:24:36.792839+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:36.792839+0000","last_undegraded":"2023-11-18T19:24:36.792839+0000","last_fullsized":"2023-11-18T19:24:36.792839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.792770+0000","objects_scrubbed":756,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:19.320316+0000","scrub_duration":0.74211921199999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'1695","reported_seq":1758,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.293584+0000","last_change":"2023-11-18T19:24:54.293629+0000","last_active":"2023-11-18T19:24:54.293584+0000","last_peered":"2023-11-18T19:24:54.293584+0000","last_clean":"2023-11-18T19:24:54.293584+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:54.293584+0000","last_undegraded":"2023-11-18T19:24:54.293584+0000","last_fullsized":"2023-11-18T19:24:54.293584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1695","last_scrub_stamp":"2023-11-18T19:24:54.293491+0000","last_deep_scrub":"29'1695","last_deep_scrub_stamp":"2023-11-18T19:24:54.293491+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.293491+0000","objects_scrubbed":762,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:27:51.707645+0000","scrub_duration":0.87214751400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":762,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1670","reported_seq":1733,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.259703+0000","last_change":"2023-11-18T19:24:39.259703+0000","last_active":"2023-11-18T19:24:39.259703+0000","last_peered":"2023-11-18T19:24:39.259703+0000","last_clean":"2023-11-18T19:24:39.259703+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:39.259703+0000","last_undegraded":"2023-11-18T19:24:39.259703+0000","last_fullsized":"2023-11-18T19:24:39.259703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.259562+0000","objects_scrubbed":757,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:51.163210+0000","scrub_duration":0.86967187400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":757,"num_object_clones":0,"num_object_copies":1514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'1773","reported_seq":1838,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:58.604255+0000","last_change":"2023-11-18T19:24:58.604299+0000","last_active":"2023-11-18T19:24:58.604255+0000","last_peered":"2023-11-18T19:24:58.604255+0000","last_clean":"2023-11-18T19:24:58.604255+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:58.604255+0000","last_undegraded":"2023-11-18T19:24:58.604255+0000","last_fullsized":"2023-11-18T19:24:58.604255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1773","last_scrub_stamp":"2023-11-18T19:24:58.604157+0000","last_deep_scrub":"29'1773","last_deep_scrub_stamp":"2023-11-18T19:24:58.604157+0000","last_clean_scrub_stamp":"2023-11-18T19:24:58.604157+0000","objects_scrubbed":780,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:40.068483+0000","scrub_duration":0.69858347499999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":780,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'1686","reported_seq":1749,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:28.333003+0000","last_change":"2023-11-18T19:24:28.333003+0000","last_active":"2023-11-18T19:24:28.333003+0000","last_peered":"2023-11-18T19:24:28.333003+0000","last_clean":"2023-11-18T19:24:28.333003+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:28.333003+0000","last_undegraded":"2023-11-18T19:24:28.333003+0000","last_fullsized":"2023-11-18T19:24:28.333003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1686","last_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_deep_scrub":"29'1686","last_deep_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_clean_scrub_stamp":"2023-11-18T19:24:28.332899+0000","objects_scrubbed":752,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:08.798032+0000","scrub_duration":0.58671065600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'1778","reported_seq":1843,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:18.059366+0000","last_change":"2023-11-18T19:25:18.059415+0000","last_active":"2023-11-18T19:25:18.059366+0000","last_peered":"2023-11-18T19:25:18.059366+0000","last_clean":"2023-11-18T19:25:18.059366+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:25:18.059366+0000","last_undegraded":"2023-11-18T19:25:18.059366+0000","last_fullsized":"2023-11-18T19:25:18.059366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1778","last_scrub_stamp":"2023-11-18T19:25:18.059264+0000","last_deep_scrub":"29'1778","last_deep_scrub_stamp":"2023-11-18T19:25:18.059264+0000","last_clean_scrub_stamp":"2023-11-18T19:25:18.059264+0000","objects_scrubbed":779,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:41.845850+0000","scrub_duration":0.76468850499999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'1634","reported_seq":1696,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:52.440493+0000","last_change":"2023-11-18T19:24:52.440530+0000","last_active":"2023-11-18T19:24:52.440493+0000","last_peered":"2023-11-18T19:24:52.440493+0000","last_clean":"2023-11-18T19:24:52.440493+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:52.440493+0000","last_undegraded":"2023-11-18T19:24:52.440493+0000","last_fullsized":"2023-11-18T19:24:52.440493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1634","last_scrub_stamp":"2023-11-18T19:24:52.440420+0000","last_deep_scrub":"29'1634","last_deep_scrub_stamp":"2023-11-18T19:24:52.440420+0000","last_clean_scrub_stamp":"2023-11-18T19:24:52.440420+0000","objects_scrubbed":747,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:46.497947+0000","scrub_duration":0.66661862599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1748","reported_seq":1814,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.744380+0000","last_change":"2023-11-18T19:24:33.744380+0000","last_active":"2023-11-18T19:24:33.744380+0000","last_peered":"2023-11-18T19:24:33.744380+0000","last_clean":"2023-11-18T19:24:33.744380+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:33.744380+0000","last_undegraded":"2023-11-18T19:24:33.744380+0000","last_fullsized":"2023-11-18T19:24:33.744380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.744286+0000","objects_scrubbed":806,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:19.817171+0000","scrub_duration":0.70702235400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":806,"num_object_clones":0,"num_object_copies":1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'1632","reported_seq":1695,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.957946+0000","last_change":"2023-11-18T19:24:53.957946+0000","last_active":"2023-11-18T19:24:53.957946+0000","last_peered":"2023-11-18T19:24:53.957946+0000","last_clean":"2023-11-18T19:24:53.957946+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:53.957946+0000","last_undegraded":"2023-11-18T19:24:53.957946+0000","last_fullsized":"2023-11-18T19:24:53.957946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1632","last_scrub_stamp":"2023-11-18T19:24:53.957803+0000","last_deep_scrub":"29'1632","last_deep_scrub_stamp":"2023-11-18T19:24:53.957803+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.957803+0000","objects_scrubbed":727,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:47.399466+0000","scrub_duration":0.71560208599999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":727,"num_object_clones":0,"num_object_copies":1454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'1779","reported_seq":1843,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.184163+0000","last_change":"2023-11-18T19:24:59.184163+0000","last_active":"2023-11-18T19:24:59.184163+0000","last_peered":"2023-11-18T19:24:59.184163+0000","last_clean":"2023-11-18T19:24:59.184163+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:59.184163+0000","last_undegraded":"2023-11-18T19:24:59.184163+0000","last_fullsized":"2023-11-18T19:24:59.184163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1779","last_scrub_stamp":"2023-11-18T19:24:59.184039+0000","last_deep_scrub":"29'1779","last_deep_scrub_stamp":"2023-11-18T19:24:59.184039+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.184039+0000","objects_scrubbed":782,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:41.528746+0000","scrub_duration":0.67582518400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'1668","reported_seq":1731,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.545597+0000","last_change":"2023-11-18T19:24:57.545635+0000","last_active":"2023-11-18T19:24:57.545597+0000","last_peered":"2023-11-18T19:24:57.545597+0000","last_clean":"2023-11-18T19:24:57.545597+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:57.545597+0000","last_undegraded":"2023-11-18T19:24:57.545597+0000","last_fullsized":"2023-11-18T19:24:57.545597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1668","last_scrub_stamp":"2023-11-18T19:24:57.545516+0000","last_deep_scrub":"29'1668","last_deep_scrub_stamp":"2023-11-18T19:24:57.545516+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.545516+0000","objects_scrubbed":730,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:08:03.673346+0000","scrub_duration":1.09599454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'1655","reported_seq":1718,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.314040+0000","last_change":"2023-11-18T19:24:41.314085+0000","last_active":"2023-11-18T19:24:41.314040+0000","last_peered":"2023-11-18T19:24:41.314040+0000","last_clean":"2023-11-18T19:24:41.314040+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:41.314040+0000","last_undegraded":"2023-11-18T19:24:41.314040+0000","last_fullsized":"2023-11-18T19:24:41.314040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1655","last_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_deep_scrub":"29'1655","last_deep_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.313951+0000","objects_scrubbed":761,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:17.258394+0000","scrub_duration":0.75370882100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":761,"num_object_clones":0,"num_object_copies":1522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'1674","reported_seq":1735,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.192667+0000","last_change":"2023-11-18T19:24:55.192727+0000","last_active":"2023-11-18T19:24:55.192667+0000","last_peered":"2023-11-18T19:24:55.192667+0000","last_clean":"2023-11-18T19:24:55.192667+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:55.192667+0000","last_undegraded":"2023-11-18T19:24:55.192667+0000","last_fullsized":"2023-11-18T19:24:55.192667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1674","last_scrub_stamp":"2023-11-18T19:24:55.192587+0000","last_deep_scrub":"29'1674","last_deep_scrub_stamp":"2023-11-18T19:24:55.192587+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.192587+0000","objects_scrubbed":741,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:27.828033+0000","scrub_duration":0.638862241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":741,"num_object_clones":0,"num_object_copies":1482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'1710","reported_seq":1772,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.315963+0000","last_change":"2023-11-18T19:25:03.315984+0000","last_active":"2023-11-18T19:25:03.315963+0000","last_peered":"2023-11-18T19:25:03.315963+0000","last_clean":"2023-11-18T19:25:03.315963+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:25:03.315963+0000","last_undegraded":"2023-11-18T19:25:03.315963+0000","last_fullsized":"2023-11-18T19:25:03.315963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1710","last_scrub_stamp":"2023-11-18T19:25:03.315896+0000","last_deep_scrub":"29'1710","last_deep_scrub_stamp":"2023-11-18T19:25:03.315896+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.315896+0000","objects_scrubbed":750,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:45.396635+0000","scrub_duration":0.69759861199999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'1680","reported_seq":1741,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.425442+0000","last_change":"2023-11-18T19:25:04.425501+0000","last_active":"2023-11-18T19:25:04.425442+0000","last_peered":"2023-11-18T19:25:04.425442+0000","last_clean":"2023-11-18T19:25:04.425442+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:25:04.425442+0000","last_undegraded":"2023-11-18T19:25:04.425442+0000","last_fullsized":"2023-11-18T19:25:04.425442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1680","last_scrub_stamp":"2023-11-18T19:25:04.425376+0000","last_deep_scrub":"29'1680","last_deep_scrub_stamp":"2023-11-18T19:25:04.425376+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.425376+0000","objects_scrubbed":738,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:57.867038+0000","scrub_duration":0.76522294899999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":738,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'1755","reported_seq":1819,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.062243+0000","last_change":"2023-11-18T19:24:53.062289+0000","last_active":"2023-11-18T19:24:53.062243+0000","last_peered":"2023-11-18T19:24:53.062243+0000","last_clean":"2023-11-18T19:24:53.062243+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:53.062243+0000","last_undegraded":"2023-11-18T19:24:53.062243+0000","last_fullsized":"2023-11-18T19:24:53.062243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1755","last_scrub_stamp":"2023-11-18T19:24:53.062146+0000","last_deep_scrub":"29'1755","last_deep_scrub_stamp":"2023-11-18T19:24:53.062146+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.062146+0000","objects_scrubbed":779,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:16.991355+0000","scrub_duration":0.76329819099999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'1609","reported_seq":1670,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.191904+0000","last_change":"2023-11-18T19:24:41.191959+0000","last_active":"2023-11-18T19:24:41.191904+0000","last_peered":"2023-11-18T19:24:41.191904+0000","last_clean":"2023-11-18T19:24:41.191904+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:41.191904+0000","last_undegraded":"2023-11-18T19:24:41.191904+0000","last_fullsized":"2023-11-18T19:24:41.191904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1609","last_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_deep_scrub":"29'1609","last_deep_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.191821+0000","objects_scrubbed":748,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:18.742555+0000","scrub_duration":0.72283178699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":748,"num_object_clones":0,"num_object_copies":1496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'1660","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.717494+0000","last_change":"2023-11-18T19:24:34.717527+0000","last_active":"2023-11-18T19:24:34.717494+0000","last_peered":"2023-11-18T19:24:34.717494+0000","last_clean":"2023-11-18T19:24:34.717494+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:34.717494+0000","last_undegraded":"2023-11-18T19:24:34.717494+0000","last_fullsized":"2023-11-18T19:24:34.717494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1660","last_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_deep_scrub":"29'1660","last_deep_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.717426+0000","objects_scrubbed":755,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.869959+0000","scrub_duration":1.054464544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":755,"num_object_clones":0,"num_object_copies":1510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'1550","reported_seq":1610,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.576796+0000","last_change":"2023-11-18T19:24:40.576837+0000","last_active":"2023-11-18T19:24:40.576796+0000","last_peered":"2023-11-18T19:24:40.576796+0000","last_clean":"2023-11-18T19:24:40.576796+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:40.576796+0000","last_undegraded":"2023-11-18T19:24:40.576796+0000","last_fullsized":"2023-11-18T19:24:40.576796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1550","last_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_deep_scrub":"29'1550","last_deep_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.576715+0000","objects_scrubbed":702,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.709244+0000","scrub_duration":0.96416932899999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":702,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'1788","reported_seq":1851,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.428070+0000","last_change":"2023-11-18T19:24:54.428126+0000","last_active":"2023-11-18T19:24:54.428070+0000","last_peered":"2023-11-18T19:24:54.428070+0000","last_clean":"2023-11-18T19:24:54.428070+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:54.428070+0000","last_undegraded":"2023-11-18T19:24:54.428070+0000","last_fullsized":"2023-11-18T19:24:54.428070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1788","last_scrub_stamp":"2023-11-18T19:24:54.427981+0000","last_deep_scrub":"29'1788","last_deep_scrub_stamp":"2023-11-18T19:24:54.427981+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.427981+0000","objects_scrubbed":782,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:35.216202+0000","scrub_duration":0.90968989499999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'1642","reported_seq":1705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:32.764155+0000","last_change":"2023-11-18T19:24:32.764235+0000","last_active":"2023-11-18T19:24:32.764155+0000","last_peered":"2023-11-18T19:24:32.764155+0000","last_clean":"2023-11-18T19:24:32.764155+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:32.764155+0000","last_undegraded":"2023-11-18T19:24:32.764155+0000","last_fullsized":"2023-11-18T19:24:32.764155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1642","last_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_deep_scrub":"29'1642","last_deep_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_clean_scrub_stamp":"2023-11-18T19:24:32.764034+0000","objects_scrubbed":744,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:09:02.008162+0000","scrub_duration":1.1096721409999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":744,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'1732","reported_seq":1797,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.250918+0000","last_change":"2023-11-18T19:24:36.250918+0000","last_active":"2023-11-18T19:24:36.250918+0000","last_peered":"2023-11-18T19:24:36.250918+0000","last_clean":"2023-11-18T19:24:36.250918+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:36.250918+0000","last_undegraded":"2023-11-18T19:24:36.250918+0000","last_fullsized":"2023-11-18T19:24:36.250918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1732","last_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_deep_scrub":"29'1732","last_deep_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.250801+0000","objects_scrubbed":789,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:00.180010+0000","scrub_duration":0.83764093900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'1659","reported_seq":1721,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.184647+0000","last_change":"2023-11-18T19:25:03.184647+0000","last_active":"2023-11-18T19:25:03.184647+0000","last_peered":"2023-11-18T19:25:03.184647+0000","last_clean":"2023-11-18T19:25:03.184647+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:25:03.184647+0000","last_undegraded":"2023-11-18T19:25:03.184647+0000","last_fullsized":"2023-11-18T19:25:03.184647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:25:03.184485+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:25:03.184485+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.184485+0000","objects_scrubbed":718,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:45.265223+0000","scrub_duration":0.698566562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'1612","reported_seq":1673,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:14.456504+0000","last_change":"2023-11-18T19:25:14.456504+0000","last_active":"2023-11-18T19:25:14.456504+0000","last_peered":"2023-11-18T19:25:14.456504+0000","last_clean":"2023-11-18T19:25:14.456504+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:25:14.456504+0000","last_undegraded":"2023-11-18T19:25:14.456504+0000","last_fullsized":"2023-11-18T19:25:14.456504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1612","last_scrub_stamp":"2023-11-18T19:25:14.456375+0000","last_deep_scrub":"29'1612","last_deep_scrub_stamp":"2023-11-18T19:25:14.456375+0000","last_clean_scrub_stamp":"2023-11-18T19:25:14.456375+0000","objects_scrubbed":694,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:21.472322+0000","scrub_duration":0.68011604699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1532356433,"num_objects":72339,"num_object_clones":0,"num_object_copies":289356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72339,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":196167,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2809622528,"data_stored":3820519424,"data_compressed":666760082,"data_compressed_allocated":793534464,"data_compressed_original":1804431360,"omap_allocated":0,"internal_metadata":0},"log_size":145913,"ondisk_log_size":145913,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":48368,"num_object_clones":0,"num_object_copies":96736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51796,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108469,"ondisk_log_size":108469,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":252317078,"num_objects":3097,"num_object_clones":0,"num_object_copies":6194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3097,"num_whiteouts":0,"num_read":864,"num_read_kb":1816,"num_write":23621,"num_write_kb":732017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30352898,"num_omap_keys":52444,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133529600,"data_stored":504634156,"data_compressed":78941764,"data_compressed_allocated":97574912,"data_compressed_original":468738048,"omap_allocated":0,"internal_metadata":0},"log_size":20216,"ondisk_log_size":20216,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":647720,"kb_used_data":373600,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93724120,"statfs":{"total":96636764160,"available":95973498880,"internally_reserved":0,"allocated":382566400,"data_stored":576987954,"data_compressed":102256610,"data_compressed_allocated":122839040,"data_compressed_original":317444096,"omap_allocated":1594,"internal_metadata":280689094},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":4.3849999999999998,"15min":4.827},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.372},"max":{"1min":3.629,"5min":248.00800000000001,"15min":248.00800000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":2.5150000000000001,"5min":4.8040000000000003,"15min":5.1310000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":36.765000000000001,"5min":175.095,"15min":384.19499999999999},"last":1.2709999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":2.012,"5min":2.6539999999999999,"15min":4.1429999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.47099999999999997},"max":{"1min":17.283000000000001,"5min":53.398000000000003,"15min":199.179},"last":0.97899999999999998},{"interface":"front","average":{"1min":2.7090000000000001,"5min":4.891,"15min":5.3810000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":36.957999999999998,"5min":175.06800000000001,"15min":384.09699999999998},"last":0.70499999999999996}]},{"osd":2,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.7689999999999999,"15min":3.2519999999999998},"min":{"1min":0.46800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3999999999999999,"5min":14.175000000000001,"15min":207.149},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.452,"5min":2.5569999999999999,"15min":5.5},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.47299999999999998},"max":{"1min":3.7149999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":1.091}]},{"osd":3,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":2.766,"5min":4.9169999999999998,"15min":5.7839999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":36.813000000000002,"5min":175.02600000000001,"15min":384.04700000000003},"last":1.153},{"interface":"front","average":{"1min":2.9100000000000001,"5min":2.649,"15min":3.5129999999999999},"min":{"1min":0.497,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":40.716000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":0.92900000000000005}]},{"osd":4,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":3.0259999999999998,"15min":5.0039999999999996},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.38100000000000001},"max":{"1min":4.4569999999999999,"5min":86.346999999999994,"15min":199.393},"last":1.1919999999999999},{"interface":"front","average":{"1min":2.8450000000000002,"5min":5.6020000000000003,"15min":6.649},"min":{"1min":0.56100000000000005,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":36.926000000000002,"5min":204.786,"15min":384.161},"last":1.4059999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":3.0339999999999998,"15min":4.4459999999999997},"min":{"1min":0.54100000000000004,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":5.5970000000000004,"5min":79.472999999999999,"15min":220.36500000000001},"last":1.048},{"interface":"front","average":{"1min":3.9540000000000002,"5min":5.4160000000000004,"15min":5.7309999999999999},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":48.290999999999997,"5min":160.107,"15min":212.68100000000001},"last":1.355}]},{"osd":7,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":3.0640000000000001,"5min":5.4130000000000003,"15min":9.0169999999999995},"min":{"1min":0.59999999999999998,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":36.984999999999999,"5min":205.01400000000001,"15min":410.60000000000002},"last":1.5189999999999999},{"interface":"front","average":{"1min":2.2709999999999999,"5min":2.6760000000000002,"15min":4.069},"min":{"1min":0.52500000000000002,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":19.361999999999998,"5min":28.329999999999998,"15min":207.85300000000001},"last":1.3109999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509670,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":612080,"kb_used_data":328232,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93759760,"statfs":{"total":96636764160,"available":96009994240,"internally_reserved":0,"allocated":336109568,"data_stored":505605510,"data_compressed":82941676,"data_compressed_allocated":99913728,"data_compressed_original":269606912,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":2.0310000000000001,"15min":4.3639999999999999},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":56.268000000000001,"5min":56.268000000000001,"15min":248.32400000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.3640000000000001,"15min":2.7869999999999999},"min":{"1min":0.54400000000000004,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.4369999999999998,"5min":8.7650000000000006,"15min":93.090999999999994},"last":1.3300000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.677,"15min":5.3970000000000002},"min":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.47899999999999998},"max":{"1min":10.644,"5min":14.673999999999999,"15min":335.11799999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":3.948,"5min":2.3490000000000002,"15min":4.1020000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.432},"max":{"1min":56.345999999999997,"5min":56.345999999999997,"15min":278.17700000000002},"last":1.5740000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.0899999999999999,"15min":3.6110000000000002},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":26.256,"5min":36.954999999999998,"15min":144.68700000000001},"last":2.04},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.774,"15min":3.738},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.52800000000000002},"max":{"1min":10.755000000000001,"5min":14.731999999999999,"15min":247.267},"last":1.798}]},{"osd":3,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.714,"15min":4.8310000000000004},"min":{"1min":0.61599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":10.880000000000001,"5min":12.032,"15min":207.93799999999999},"last":2.0990000000000002},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.869,"15min":4.5540000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.53300000000000003},"max":{"1min":10.718999999999999,"5min":14.769,"15min":265.82600000000002},"last":1.5369999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.911,"5min":2.391,"15min":4.75},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42199999999999999},"max":{"1min":55.738999999999997,"5min":55.738999999999997,"15min":303.19200000000001},"last":1.758},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.71,"15min":4.6909999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2960000000000003,"5min":12.207000000000001,"15min":210.78899999999999},"last":2.2069999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":2.2709999999999999,"15min":6.6790000000000003},"min":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":10.686999999999999,"5min":41.378,"15min":308.47500000000002},"last":1.6990000000000001},{"interface":"front","average":{"1min":4.0529999999999999,"5min":2.577,"15min":4.2599999999999998},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.34000000000000002},"max":{"1min":56.228999999999999,"5min":56.228999999999999,"15min":303.23599999999999},"last":1.8660000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.2610000000000001,"15min":5.2809999999999997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.41199999999999998},"max":{"1min":13.352,"5min":19.742000000000001,"15min":252.18299999999999},"last":2.1509999999999998},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.0249999999999999,"15min":4.8789999999999996},"min":{"1min":0.56000000000000005,"5min":0.51300000000000001,"15min":0.437},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":309.029},"last":1.925}]}]},{"osd":4,"up_from":15,"seq":64424509670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582188,"kb_used_data":321956,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":93789652,"statfs":{"total":96636764160,"available":96040603648,"internally_reserved":0,"allocated":329682944,"data_stored":506103922,"data_compressed":93249446,"data_compressed_allocated":112369664,"data_compressed_original":288989184,"omap_allocated":1592,"internal_metadata":266467784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":3.1030000000000002,"15min":2.657},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":23.077999999999999,"5min":51.582999999999998,"15min":58.200000000000003},"last":1.488},{"interface":"front","average":{"1min":0.98199999999999998,"5min":2.3109999999999999,"15min":2.3490000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.4510000000000001,"5min":56.402999999999999,"15min":56.402999999999999},"last":1.5700000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.9470000000000001,"5min":2.302,"15min":2.3260000000000001},"min":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":25.114999999999998,"5min":27.18,"15min":36.024999999999999},"last":1.661},{"interface":"front","average":{"1min":2.23,"5min":3.3540000000000001,"15min":2.7949999999999999},"min":{"1min":0.72399999999999998,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":22.565999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":1.9870000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":2.669,"15min":2.633},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":16.777000000000001,"5min":56.494,"15min":56.494},"last":2.206},{"interface":"front","average":{"1min":4.1509999999999998,"5min":2.9129999999999998,"15min":2.7810000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":52.454000000000001,"5min":52.454000000000001,"15min":52.454000000000001},"last":2.5459999999999998}]},{"osd":3,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":3.0659999999999998,"15min":2.9329999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":3.7599999999999998,"5min":51.643000000000001,"15min":58.039999999999999},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.214,"5min":2.5910000000000002,"15min":2.75},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.46500000000000002},"max":{"1min":2.734,"5min":56.530999999999999,"15min":56.530999999999999},"last":2.3039999999999998}]},{"osd":5,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.9079999999999999,"5min":4.1920000000000002,"15min":3.8039999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33200000000000002},"max":{"1min":46.289999999999999,"5min":68.007000000000005,"15min":68.007000000000005},"last":2.665},{"interface":"front","average":{"1min":2.4990000000000001,"5min":4.2190000000000003,"15min":3.9049999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":34.197000000000003,"5min":72.611000000000004,"15min":72.611000000000004},"last":2.2400000000000002}]},{"osd":6,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.5409999999999999,"5min":4.3159999999999998,"15min":4.0389999999999997},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":59.960999999999999,"5min":72.915999999999997,"15min":161.898},"last":2.3999999999999999},{"interface":"front","average":{"1min":3.9079999999999999,"5min":5.9870000000000001,"15min":4.859},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":45.710000000000001,"5min":105.387,"15min":163.33600000000001},"last":2.9319999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":4.0970000000000004,"15min":4.181},"min":{"1min":0.58899999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":22.099,"5min":66.341999999999999,"15min":66.341999999999999},"last":2.3530000000000002},{"interface":"front","average":{"1min":1.915,"5min":3.484,"15min":4.1050000000000004},"min":{"1min":0.629,"5min":0.435,"15min":0.435},"max":{"1min":16.263000000000002,"5min":56.454000000000001,"15min":66.665000000000006},"last":2.468}]}]},{"osd":3,"up_from":15,"seq":64424509671,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":746352,"kb_used_data":422312,"kb_used_omap":1,"kb_used_meta":324030,"kb_avail":93625488,"statfs":{"total":96636764160,"available":95872499712,"internally_reserved":0,"allocated":432447488,"data_stored":638154104,"data_compressed":111010512,"data_compressed_allocated":131817472,"data_compressed_original":337711104,"omap_allocated":1593,"internal_metadata":331807175},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":1.163,"15min":1.27},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":17.715,"5min":17.715,"15min":44.363},"last":1.266},{"interface":"front","average":{"1min":5.4930000000000003,"5min":2.3170000000000002,"15min":2.278},"min":{"1min":0.38800000000000001,"5min":0.28899999999999998,"15min":0.27600000000000002},"max":{"1min":75.558000000000007,"5min":75.558000000000007,"15min":75.558000000000007},"last":0.73399999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":9.0980000000000008,"5min":3.0009999999999999,"15min":3.718},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.26900000000000002},"max":{"1min":145.65000000000001,"5min":145.65000000000001,"15min":202.65000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":6.2130000000000001,"5min":2.4449999999999998,"15min":2.9020000000000001},"min":{"1min":0.44500000000000001,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":75.587000000000003,"5min":75.587000000000003,"15min":114.221},"last":1.038}]},{"osd":2,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":2.8359999999999999,"5min":1.6699999999999999,"15min":1.706},"min":{"1min":0.504,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":28.433,"5min":28.433,"15min":43.747999999999998},"last":1.0069999999999999},{"interface":"front","average":{"1min":5.7069999999999999,"5min":2.4910000000000001,"15min":2.6869999999999998},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":75.483999999999995,"5min":75.483999999999995,"15min":75.483999999999995},"last":1.6419999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":3.0649999999999999,"15min":4.6760000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.48799999999999999},"max":{"1min":89.465000000000003,"5min":89.465000000000003,"15min":202.821},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.8320000000000001,"15min":3.2909999999999999},"min":{"1min":0.84399999999999997,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":8.0380000000000003,"5min":23.635000000000002,"15min":234.68700000000001},"last":1.1990000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":4.5199999999999996,"5min":3.4620000000000002,"15min":4.5709999999999997},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":48.381,"5min":57.360999999999997,"15min":190.827},"last":1.169},{"interface":"front","average":{"1min":17.562000000000001,"5min":6.3959999999999999,"15min":5.8079999999999998},"min":{"1min":0.66300000000000003,"5min":0.58199999999999996,"15min":0.56399999999999995},"max":{"1min":275.89699999999999,"5min":275.89699999999999,"15min":275.89699999999999},"last":1.4430000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":4.218,"5min":3.5179999999999998,"15min":3.262},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.46800000000000003},"max":{"1min":39.098999999999997,"5min":89.710999999999999,"15min":89.710999999999999},"last":1.7150000000000001},{"interface":"front","average":{"1min":6.9660000000000002,"5min":3.6960000000000002,"15min":4.3449999999999998},"min":{"1min":0.75,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":89.509,"5min":89.509,"15min":202.78299999999999},"last":1.607}]},{"osd":7,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":6.1050000000000004,"5min":3.3799999999999999,"15min":4.5279999999999996},"min":{"1min":0.92100000000000004,"5min":0.745,"15min":0.61199999999999999},"max":{"1min":75.525000000000006,"5min":75.525000000000006,"15min":82.248000000000005},"last":1.383},{"interface":"front","average":{"1min":7.9080000000000004,"5min":4.9080000000000004,"15min":6.5270000000000001},"min":{"1min":0.82499999999999996,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":81.777000000000001,"5min":113.44,"15min":233.44800000000001},"last":1.681}]}]},{"osd":2,"up_from":15,"seq":64424509671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":608612,"kb_used_data":342812,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93763228,"statfs":{"total":96636764160,"available":96013545472,"internally_reserved":0,"allocated":351039488,"data_stored":491214290,"data_compressed":86308112,"data_compressed_allocated":101842944,"data_compressed_original":242208768,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.4630000000000001,"15min":2.0910000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":13.442,"5min":83.817999999999998,"15min":83.817999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":4.0899999999999999,"5min":3.044,"15min":3.694},"min":{"1min":0.53500000000000003,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":37.145000000000003,"5min":83.266999999999996,"15min":248.16999999999999},"last":0.81899999999999995}]},{"osd":1,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":1.9370000000000001,"15min":1.8999999999999999},"min":{"1min":0.59099999999999997,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":8.2210000000000001,"5min":19.004999999999999,"15min":30.504999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":4.085,"5min":2.7229999999999999,"15min":3.5699999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":31.68,"5min":47.768999999999998,"15min":255.315},"last":1.8089999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.3250000000000002,"5min":2.5830000000000002,"15min":2.2229999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.315},"max":{"1min":35.741,"5min":35.741,"15min":84.840999999999994},"last":1.2090000000000001},{"interface":"front","average":{"1min":5.9039999999999999,"5min":3.0510000000000002,"15min":3.0939999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.36599999999999999},"max":{"1min":77.317999999999998,"5min":77.317999999999998,"15min":128.976},"last":0.98699999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.0609999999999999,"5min":3.4580000000000002,"15min":5.109},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":37.213999999999999,"5min":47.432000000000002,"15min":255.25700000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.6099999999999999,"15min":3.5790000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.48299999999999998},"max":{"1min":19.753,"5min":34.531999999999996,"15min":128.655},"last":0.91200000000000003}]},{"osd":5,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":8.9760000000000009,"5min":5.0700000000000003,"15min":5.2599999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":82.197000000000003,"5min":138.905,"15min":153.417},"last":1.466},{"interface":"front","average":{"1min":7.2789999999999999,"5min":4.5439999999999996,"15min":6.0229999999999997},"min":{"1min":0.89300000000000002,"5min":0.77100000000000002,"15min":0.53300000000000003},"max":{"1min":37.183999999999997,"5min":63.884,"15min":255.34899999999999},"last":1.651}]},{"osd":6,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4740000000000002,"5min":3.145,"15min":3.7229999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.55400000000000005},"max":{"1min":48.976999999999997,"5min":82.388999999999996,"15min":138.33099999999999},"last":1.127},{"interface":"front","average":{"1min":7.8410000000000002,"5min":4.9880000000000004,"15min":5.4820000000000002},"min":{"1min":0.85299999999999998,"5min":0.85099999999999998,"15min":0.61199999999999999},"max":{"1min":90.509,"5min":127.44799999999999,"15min":187.29599999999999},"last":1.333}]},{"osd":7,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":6.2919999999999998,"5min":5.0869999999999997,"15min":6.673},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.60899999999999999},"max":{"1min":34.777000000000001,"5min":81.165999999999997,"15min":211.17500000000001},"last":1.728},{"interface":"front","average":{"1min":5.6689999999999996,"5min":4.0910000000000002,"15min":5.0110000000000001},"min":{"1min":0.80300000000000005,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":49.033999999999999,"5min":72.992999999999995,"15min":173.53999999999999},"last":1.292}]}]},{"osd":1,"up_from":15,"seq":64424509671,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":727056,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":93644784,"statfs":{"total":96636764160,"available":95892258816,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106231679,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":313391557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.5860000000000001,"15min":1.49},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.22500000000000001},"max":{"1min":1.613,"5min":21.655999999999999,"15min":51.420999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.71,"15min":1.744},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.255},"max":{"1min":1.8129999999999999,"5min":22.587,"15min":48.802999999999997},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.7789999999999999,"15min":2.5750000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.308},"max":{"1min":2.6539999999999999,"5min":24.036999999999999,"15min":131.321},"last":1.421},{"interface":"front","average":{"1min":1.111,"5min":1.9359999999999999,"15min":1.6559999999999999},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.30499999999999999},"max":{"1min":1.7649999999999999,"5min":26.029,"15min":26.029},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":2.2280000000000002,"15min":2.7050000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.26700000000000002},"max":{"1min":1.8899999999999999,"5min":43.832999999999998,"15min":197.43899999999999},"last":1.401},{"interface":"front","average":{"1min":1.45,"5min":2.4140000000000001,"15min":2.5600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.32100000000000001},"max":{"1min":6.0140000000000002,"5min":54.316000000000003,"15min":156.316},"last":1.7729999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9790000000000001,"5min":2.4199999999999999,"15min":3.4580000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.44800000000000001},"max":{"1min":32.771999999999998,"5min":48.799999999999997,"15min":159.84299999999999},"last":1.681},{"interface":"front","average":{"1min":2.024,"5min":2.5990000000000002,"15min":3.198},"min":{"1min":0.629,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":12.879,"5min":28.405999999999999,"15min":62.978999999999999},"last":1.3169999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":3.504,"15min":3.3660000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.3090000000000002,"5min":107.88500000000001,"15min":107.88500000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.3050000000000002,"15min":3.1309999999999998},"min":{"1min":0.65400000000000003,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":2.2200000000000002,"5min":19.553999999999998,"15min":133.685},"last":1.7869999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":2.8450000000000002,"15min":3.613},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.3180000000000001,"5min":54.220999999999997,"15min":142.84100000000001},"last":1.661},{"interface":"front","average":{"1min":1.589,"5min":2.0899999999999999,"15min":3.734},"min":{"1min":0.82899999999999996,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":5.4800000000000004,"5min":23.998999999999999,"15min":146.69900000000001},"last":1.552}]},{"osd":7,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":2.4889999999999999,"15min":2.7320000000000002},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.56299999999999994},"max":{"1min":2.117,"5min":31.096,"15min":35.783999999999999},"last":1.53},{"interface":"front","average":{"1min":1.4470000000000001,"5min":3.1589999999999998,"15min":3.3769999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2519999999999998,"5min":34.281999999999996,"15min":57.134999999999998},"last":1.7270000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509672,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":499980,"kb_used_data":248132,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93871860,"statfs":{"total":96636764160,"available":96124784640,"internally_reserved":0,"allocated":254087168,"data_stored":412922730,"data_compressed":68731359,"data_compressed_allocated":83857408,"data_compressed_original":242884608,"omap_allocated":1594,"internal_metadata":257882566},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.946,"15min":1.8220000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.21099999999999999},"max":{"1min":7.2350000000000003,"5min":30.565000000000001,"15min":74.326999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.272,"5min":2.1659999999999999,"15min":1.6379999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25700000000000001},"max":{"1min":7.0759999999999996,"5min":33.957999999999998,"15min":43.518000000000001},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":4.3739999999999997,"15min":2.375},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":12.465,"5min":181.27099999999999,"15min":181.27099999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.718,"5min":2.4740000000000002,"15min":1.8959999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.24099999999999999},"max":{"1min":8.3260000000000005,"5min":41.810000000000002,"15min":46.984999999999999},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.3769999999999998,"15min":1.865},"min":{"1min":0.433,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":9.2149999999999999,"5min":31.562000000000001,"15min":36.642000000000003},"last":1.214},{"interface":"front","average":{"1min":1.6619999999999999,"5min":3.8780000000000001,"15min":2.5939999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.28799999999999998},"max":{"1min":6.1239999999999997,"5min":94.373000000000005,"15min":94.373000000000005},"last":0.94799999999999995}]},{"osd":4,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":3.194,"5min":4.3159999999999998,"15min":3.4660000000000002},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":24.327000000000002,"5min":135.547,"15min":135.547},"last":1.2669999999999999},{"interface":"front","average":{"1min":3.2210000000000001,"5min":4.0640000000000001,"15min":3.488},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":25.25,"5min":131.07599999999999,"15min":131.07599999999999},"last":1.361}]},{"osd":5,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":3.6099999999999999,"5min":3.3599999999999999,"15min":2.8500000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.38700000000000001},"max":{"1min":44.682000000000002,"5min":63.134999999999998,"15min":63.134999999999998},"last":1.298},{"interface":"front","average":{"1min":3.375,"5min":3.5819999999999999,"15min":2.9470000000000001},"min":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":41.917999999999999,"5min":63.185000000000002,"15min":63.185000000000002},"last":1.1539999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":2.7909999999999999,"15min":3.6389999999999998},"min":{"1min":0.60499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":9.2720000000000002,"5min":105.974,"15min":203.92699999999999},"last":1.095},{"interface":"front","average":{"1min":2.3410000000000002,"5min":4.0039999999999996,"15min":3.8919999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.42899999999999999},"max":{"1min":14.525,"5min":160.84700000000001,"15min":203.56899999999999},"last":1.3959999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.994,"5min":4.3250000000000002,"15min":3.113},"min":{"1min":0.66600000000000004,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":8.5739999999999998,"5min":91.418000000000006,"15min":91.418000000000006},"last":1.462},{"interface":"front","average":{"1min":4.4219999999999997,"5min":4.359,"15min":3.2389999999999999},"min":{"1min":0.68799999999999994,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":56.298000000000002,"5min":68.608000000000004,"15min":68.608000000000004},"last":1.444}]}]},{"osd":7,"up_from":13,"seq":55834575078,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":706664,"kb_used_data":418656,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93665176,"statfs":{"total":96636764160,"available":95913140224,"internally_reserved":0,"allocated":428703744,"data_stored":578550662,"data_compressed":95037478,"data_compressed_allocated":111271936,"data_compressed_original":261312512,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":3.395,"15min":4.492},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.0329999999999995,"5min":69.191999999999993,"15min":221.768},"last":1.006},{"interface":"front","average":{"1min":3.0720000000000001,"5min":3.4830000000000001,"15min":3.4430000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":36.235999999999997,"5min":63.854999999999997,"15min":93.781000000000006},"last":1.347}]},{"osd":1,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":3.512,"15min":4.3929999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.374},"max":{"1min":6.0030000000000001,"5min":69.061999999999998,"15min":221.715},"last":1.228},{"interface":"front","average":{"1min":3.2509999999999999,"5min":3.605,"15min":3.5329999999999999},"min":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":36.430999999999997,"5min":67.930999999999997,"15min":93.825000000000003},"last":1.8240000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":2.0339999999999998,"15min":4.4420000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":33.426000000000002,"5min":33.426000000000002,"15min":189.01400000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":2.1739999999999999,"5min":3.6739999999999999,"15min":4.657},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":21.09,"5min":69.156999999999996,"15min":221.80600000000001},"last":1.2889999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3,"5min":3.1019999999999999,"15min":4.6059999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":33.384,"5min":64.206000000000003,"15min":198.696},"last":1.5600000000000001},{"interface":"front","average":{"1min":2.4180000000000001,"5min":3.7480000000000002,"15min":5.3849999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.47399999999999998},"max":{"1min":20.509,"5min":69.585999999999999,"15min":221.846},"last":1.427}]},{"osd":4,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3.2570000000000001,"5min":3.7829999999999999,"15min":5.1799999999999997},"min":{"1min":0.69799999999999995,"5min":0.434,"15min":0.434},"max":{"1min":36.402999999999999,"5min":63.634,"15min":245.36000000000001},"last":2.0459999999999998},{"interface":"front","average":{"1min":3.085,"5min":3.0510000000000002,"15min":4.8230000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.098999999999997,"5min":43.292000000000002,"15min":190.40799999999999},"last":1.7749999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":5.9470000000000001,"5min":5.1529999999999996,"15min":6.6909999999999998},"min":{"1min":0.47899999999999998,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":78.998999999999995,"5min":78.998999999999995,"15min":222.85499999999999},"last":1.605},{"interface":"front","average":{"1min":3.4449999999999998,"5min":4.5010000000000003,"15min":6.3070000000000004},"min":{"1min":0.60999999999999999,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":36.344000000000001,"5min":83.078000000000003,"15min":215.16900000000001},"last":2.1480000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3.5489999999999999,"5min":4.1929999999999996,"15min":5.1210000000000004},"min":{"1min":0.66100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":36.374000000000002,"5min":68.109999999999999,"15min":94.079999999999998},"last":2.2370000000000001},{"interface":"front","average":{"1min":3.169,"5min":3.887,"15min":5.1269999999999998},"min":{"1min":0.505,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":32.619999999999997,"5min":63.673000000000002,"15min":188.935},"last":1.8839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080440,"data_compressed":14029799,"data_compressed_allocated":17076224,"data_compressed_original":84856832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16019456,"data_stored":58720326,"data_compressed":9168208,"data_compressed_allocated":11268096,"data_compressed_original":53972992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6418432,"data_stored":25166496,"data_compressed":3903195,"data_compressed_allocated":4784128,"data_compressed_original":23539712,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23023616,"data_stored":88080966,"data_compressed":13869465,"data_compressed_allocated":16965632,"data_compressed_original":82026496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":54527296,"data_compressed":8437806,"data_compressed_allocated":10407936,"data_compressed_original":49823744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22880256,"data_stored":80349236,"data_compressed":12523208,"data_compressed_allocated":15749120,"data_compressed_original":73228288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":79691776,"data_compressed":12654787,"data_compressed_allocated":15716352,"data_compressed_original":74809344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9154560,"data_stored":30017620,"data_compressed":4355296,"data_compressed_allocated":5607424,"data_compressed_original":26480640,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344313856,"data_stored":465924096,"data_compressed":82404917,"data_compressed_allocated":97058816,"data_compressed_original":218669056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409116672,"data_stored":549949440,"data_compressed":97141047,"data_compressed_allocated":114851840,"data_compressed_original":255684608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":314249216,"data_stored":451452928,"data_compressed":84811640,"data_compressed_allocated":101961728,"data_compressed_original":239165440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":312856576,"data_stored":424542208,"data_compressed":70385955,"data_compressed_allocated":84119552,"data_compressed_original":195805184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":361660416,"data_stored":497172480,"data_compressed":89601823,"data_compressed_allocated":107122688,"data_compressed_original":242634752,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":419241984,"data_stored":548409344,"data_compressed":90682182,"data_compressed_allocated":105664512,"data_compressed_original":234831872,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:25:35.341 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:35.341 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:35.342 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-18T19:06:40.555839+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=6, tm_sec=40, tm_wday=5, tm_yday=322, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=18, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=5, tm_yday=322, tm_isdst=0) 2023-11-18T19:25:35.342 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-18T19:25:54.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:25:54.403 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:25:55.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-18T19:25:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.567+0000 7fba48644640 1 Processor -- start 2023-11-18T19:25:55.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.567+0000 7fba48644640 1 -- start start 2023-11-18T19:25:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.568+0000 7fba48644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba40155310 0x7fba400a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.568+0000 7fba48644640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba400a90b0 0x7fba4015bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.568+0000 7fba48644640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba400a9560 con 0x7fba4014eb20 2023-11-18T19:25:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.568+0000 7fba48644640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba400aab40 con 0x7fba400a90b0 2023-11-18T19:25:55.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.568+0000 7fba48644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba40155790 con 0x7fba40155310 2023-11-18T19:25:55.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba46be1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba400a90b0 0x7fba4015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:55.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba46be1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba400a90b0 0x7fba4015bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53358/0 (socket says 172.21.15.45:53358) 2023-11-18T19:25:55.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba46be1640 1 -- 172.21.15.45:0/3694691984 learned_addr learned my addr 172.21.15.45:0/3694691984 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba45bdf640 1 --2- 172.21.15.45:0/3694691984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba40155310 0x7fba400a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba46be1640 1 -- 172.21.15.45:0/3694691984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba40155310 msgr2=0x7fba400a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba46be1640 1 --2- 172.21.15.45:0/3694691984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba40155310 0x7fba400a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba46be1640 1 -- 172.21.15.45:0/3694691984 >> v1:172.21.15.135:6789/0 conn(0x7fba4014eb20 legacy=0x7fba400c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba46be1640 1 -- 172.21.15.45:0/3694691984 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400c21f0 con 0x7fba400a90b0 2023-11-18T19:25:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.569+0000 7fba45bdf640 1 --2- 172.21.15.45:0/3694691984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba40155310 0x7fba400a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.570+0000 7fba46be1640 1 --2- 172.21.15.45:0/3694691984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba400a90b0 0x7fba4015bc10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fba38009e50 tx=0x7fba3802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e7d56a193c5777 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.571+0000 7fba453de640 1 -- 172.21.15.45:0/3694691984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3802c9f0 con 0x7fba400a90b0 2023-11-18T19:25:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.571+0000 7fba453de640 1 -- 172.21.15.45:0/3694691984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3802cb50 con 0x7fba400a90b0 2023-11-18T19:25:55.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.571+0000 7fba453de640 1 -- 172.21.15.45:0/3694691984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380343f0 con 0x7fba400a90b0 2023-11-18T19:25:55.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.571+0000 7fba48644640 1 -- 172.21.15.45:0/3694691984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba400a90b0 msgr2=0x7fba4015bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:55.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.571+0000 7fba48644640 1 --2- 172.21.15.45:0/3694691984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba400a90b0 0x7fba4015bc10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fba38009e50 tx=0x7fba3802be50 comp rx=0 tx=0).stop 2023-11-18T19:25:55.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.572+0000 7fba48644640 1 -- 172.21.15.45:0/3694691984 shutdown_connections 2023-11-18T19:25:55.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.572+0000 7fba48644640 1 --2- 172.21.15.45:0/3694691984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba400a90b0 0x7fba4015bc10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.572+0000 7fba48644640 1 --2- 172.21.15.45:0/3694691984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba40155310 0x7fba400a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.572+0000 7fba48644640 1 -- 172.21.15.45:0/3694691984 >> 172.21.15.45:0/3694691984 conn(0x7fba4006a500 msgr2=0x7fba4006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:55.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.572+0000 7fba48644640 1 -- 172.21.15.45:0/3694691984 shutdown_connections 2023-11-18T19:25:55.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.572+0000 7fba48644640 1 -- 172.21.15.45:0/3694691984 wait complete. 2023-11-18T19:25:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.573+0000 7fba48644640 1 Processor -- start 2023-11-18T19:25:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.574+0000 7fba48644640 1 -- start start 2023-11-18T19:25:55.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.574+0000 7fba48644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba400a90b0 0x7fba400c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.574+0000 7fba48644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba4014eb20 0x7fba40145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.574+0000 7fba48644640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba40155310 0x7fba40145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.574+0000 7fba48644640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40152930 con 0x7fba4014eb20 2023-11-18T19:25:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.574+0000 7fba48644640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40146280 con 0x7fba40155310 2023-11-18T19:25:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.574+0000 7fba48644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba401540c0 con 0x7fba400a90b0 2023-11-18T19:25:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.575+0000 7fba45bdf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba4014eb20 0x7fba40145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:55.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.575+0000 7fba45bdf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba4014eb20 0x7fba40145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53374/0 (socket says 172.21.15.45:53374) 2023-11-18T19:25:55.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.575+0000 7fba45bdf640 1 -- 172.21.15.45:0/2312612582 learned_addr learned my addr 172.21.15.45:0/2312612582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:55.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.575+0000 7fba46be1640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba40155310 0x7fba40145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.575+0000 7fba463e0640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba400a90b0 0x7fba400c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.575+0000 7fba45bdf640 1 -- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba400a90b0 msgr2=0x7fba400c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:55.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.575+0000 7fba45bdf640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba400a90b0 0x7fba400c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba45bdf640 1 -- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba40155310 msgr2=0x7fba40145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:55.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba45bdf640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba40155310 0x7fba40145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba45bdf640 1 -- 172.21.15.45:0/2312612582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38009b30 con 0x7fba4014eb20 2023-11-18T19:25:55.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba46be1640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba40155310 0x7fba40145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:25:55.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba463e0640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba400a90b0 0x7fba400c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:55.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba45bdf640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba4014eb20 0x7fba40145800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c7f0 tx=0x7fba3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:55.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba36ffd640 1 -- 172.21.15.45:0/2312612582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30007820 con 0x7fba4014eb20 2023-11-18T19:25:55.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba36ffd640 1 -- 172.21.15.45:0/2312612582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30007980 con 0x7fba4014eb20 2023-11-18T19:25:55.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba36ffd640 1 -- 172.21.15.45:0/2312612582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30007d30 con 0x7fba4014eb20 2023-11-18T19:25:55.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba40152650 con 0x7fba4014eb20 2023-11-18T19:25:55.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.576+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba401538c0 con 0x7fba4014eb20 2023-11-18T19:25:55.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.577+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba40067940 con 0x7fba4014eb20 2023-11-18T19:25:55.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.578+0000 7fba36ffd640 1 -- 172.21.15.45:0/2312612582 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba300113f0 con 0x7fba4014eb20 2023-11-18T19:25:55.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.579+0000 7fba36ffd640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba2406ae40 0x7fba2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:55.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.580+0000 7fba36ffd640 1 -- 172.21.15.45:0/2312612582 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fba30089ca0 con 0x7fba4014eb20 2023-11-18T19:25:55.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.580+0000 7fba463e0640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba2406ae40 0x7fba2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:55.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.581+0000 7fba463e0640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba2406ae40 0x7fba2406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba3c000f60 tx=0x7fba3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.584+0000 7fba36ffd640 1 -- 172.21.15.45:0/2312612582 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba300549f0 con 0x7fba4014eb20 2023-11-18T19:25:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.779+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 --> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba40151c80 con 0x7fba2406ae40 2023-11-18T19:25:55.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.790+0000 7fba36ffd640 1 -- 172.21.15.45:0/2312612582 <== mgr.4103 v2:172.21.15.45:6832/2457944943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+376625 (secure 0 0 0) 0x7fba3c0013e0 con 0x7fba2406ae40 2023-11-18T19:25:55.797 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:25:55.799 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-18T19:25:55.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.796+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba2406ae40 msgr2=0x7fba2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:55.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba2406ae40 0x7fba2406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba3c000f60 tx=0x7fba3c009040 comp rx=0 tx=0).stop 2023-11-18T19:25:55.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba4014eb20 msgr2=0x7fba40145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba4014eb20 0x7fba40145800 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c7f0 tx=0x7fba3000ccb0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 shutdown_connections 2023-11-18T19:25:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba40155310 0x7fba40145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba4014eb20 0x7fba40145800 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7fba2406ae40 0x7fba2406d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 --2- 172.21.15.45:0/2312612582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba400a90b0 0x7fba400c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 >> 172.21.15.45:0/2312612582 conn(0x7fba4006a500 msgr2=0x7fba400beef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:55.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 shutdown_connections 2023-11-18T19:25:55.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:55.797+0000 7fba48644640 1 -- 172.21.15.45:0/2312612582 wait complete. 2023-11-18T19:25:55.819 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":606,"stamp":"2023-11-18T19:25:55.622877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1785263879,"num_objects":123806,"num_object_clones":0,"num_object_copies":392290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123806,"num_whiteouts":0,"num_read":995,"num_read_kb":1916,"num_write":271743,"num_write_kb":2424425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30352898,"num_omap_keys":52444,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274717,"ondisk_log_size":274717,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5130652,"kb_used_data":2876700,"kb_used_omap":12,"kb_used_meta":2253875,"kb_avail":749844068,"statfs":{"total":773094113280,"available":767840325632,"internally_reserved":0,"allocated":2945740800,"data_stored":4327323900,"data_compressed":745766872,"data_compressed_allocated":891199488,"data_compressed_original":2274316288,"omap_allocated":12748,"internal_metadata":2307968564},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005913"},"pg_stats":[{"pgid":"2.1f","version":"29'488","reported_seq":527,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.102998+0000","last_change":"2023-11-18T19:24:42.102998+0000","last_active":"2023-11-18T19:24:42.102998+0000","last_peered":"2023-11-18T19:24:42.102998+0000","last_clean":"2023-11-18T19:24:42.102998+0000","last_became_active":"2023-11-18T19:06:37.049098+0000","last_became_peered":"2023-11-18T19:06:37.049098+0000","last_unstale":"2023-11-18T19:24:42.102998+0000","last_undegraded":"2023-11-18T19:24:42.102998+0000","last_fullsized":"2023-11-18T19:24:42.102998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'488","last_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_deep_scrub":"29'488","last_deep_scrub_stamp":"2023-11-18T19:24:42.102683+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.102683+0000","objects_scrubbed":92,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:36:53.767588+0000","scrub_duration":0.165977034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":592,"num_write_kb":13689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":90,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1058229,"num_omap_keys":1832,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'1683","reported_seq":1747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.141937+0000","last_change":"2023-11-18T19:25:07.141982+0000","last_active":"2023-11-18T19:25:07.141937+0000","last_peered":"2023-11-18T19:25:07.141937+0000","last_clean":"2023-11-18T19:25:07.141937+0000","last_became_active":"2023-11-18T19:06:37.570670+0000","last_became_peered":"2023-11-18T19:06:37.570670+0000","last_unstale":"2023-11-18T19:25:07.141937+0000","last_undegraded":"2023-11-18T19:25:07.141937+0000","last_fullsized":"2023-11-18T19:25:07.141937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1683","last_scrub_stamp":"2023-11-18T19:25:07.141845+0000","last_deep_scrub":"29'1683","last_deep_scrub_stamp":"2023-11-18T19:25:07.141845+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.141845+0000","objects_scrubbed":731,"log_size":1683,"log_dups_size":0,"ondisk_log_size":1683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:51:10.143990+0000","scrub_duration":0.64930619099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":731,"num_object_clones":0,"num_object_copies":1462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'4515","reported_seq":4635,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.295641+0000","last_change":"2023-11-18T19:24:59.295673+0000","last_active":"2023-11-18T19:24:59.295641+0000","last_peered":"2023-11-18T19:24:59.295641+0000","last_clean":"2023-11-18T19:24:59.295641+0000","last_became_active":"2023-11-18T19:06:41.623926+0000","last_became_peered":"2023-11-18T19:06:41.623926+0000","last_unstale":"2023-11-18T19:24:59.295641+0000","last_undegraded":"2023-11-18T19:24:59.295641+0000","last_fullsized":"2023-11-18T19:24:59.295641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4515","last_scrub_stamp":"2023-11-18T19:24:59.295546+0000","last_deep_scrub":"29'4515","last_deep_scrub_stamp":"2023-11-18T19:24:59.295546+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.295546+0000","objects_scrubbed":2214,"log_size":4515,"log_dups_size":0,"ondisk_log_size":4515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:31:11.433037+0000","scrub_duration":1.3914833550000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47448745,"num_objects":2214,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6085,"num_write_kb":53547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'399","reported_seq":437,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.562573+0000","last_change":"2023-11-18T19:24:49.562619+0000","last_active":"2023-11-18T19:24:49.562573+0000","last_peered":"2023-11-18T19:24:49.562573+0000","last_clean":"2023-11-18T19:24:49.562573+0000","last_became_active":"2023-11-18T19:06:37.055095+0000","last_became_peered":"2023-11-18T19:06:37.055095+0000","last_unstale":"2023-11-18T19:24:49.562573+0000","last_undegraded":"2023-11-18T19:24:49.562573+0000","last_fullsized":"2023-11-18T19:24:49.562573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'399","last_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_deep_scrub":"29'399","last_deep_scrub_stamp":"2023-11-18T19:24:49.562510+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.562510+0000","objects_scrubbed":82,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:37.188456+0000","scrub_duration":0.114711435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":487,"num_write_kb":31117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":81,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207150,"num_omap_keys":3796,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'1691","reported_seq":1754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.183200+0000","last_change":"2023-11-18T19:25:04.183200+0000","last_active":"2023-11-18T19:25:04.183200+0000","last_peered":"2023-11-18T19:25:04.183200+0000","last_clean":"2023-11-18T19:25:04.183200+0000","last_became_active":"2023-11-18T19:06:37.576822+0000","last_became_peered":"2023-11-18T19:06:37.576822+0000","last_unstale":"2023-11-18T19:25:04.183200+0000","last_undegraded":"2023-11-18T19:25:04.183200+0000","last_fullsized":"2023-11-18T19:25:04.183200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1691","last_scrub_stamp":"2023-11-18T19:25:04.183067+0000","last_deep_scrub":"29'1691","last_deep_scrub_stamp":"2023-11-18T19:25:04.183067+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.183067+0000","objects_scrubbed":739,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:57.624730+0000","scrub_duration":0.67777383599999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'4583","reported_seq":4706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.235913+0000","last_change":"2023-11-18T19:24:51.235992+0000","last_active":"2023-11-18T19:24:51.235913+0000","last_peered":"2023-11-18T19:24:51.235913+0000","last_clean":"2023-11-18T19:24:51.235913+0000","last_became_active":"2023-11-18T19:06:41.609635+0000","last_became_peered":"2023-11-18T19:06:41.609635+0000","last_unstale":"2023-11-18T19:24:51.235913+0000","last_undegraded":"2023-11-18T19:24:51.235913+0000","last_fullsized":"2023-11-18T19:24:51.235913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4583","last_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_deep_scrub":"29'4583","last_deep_scrub_stamp":"2023-11-18T19:24:51.235758+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.235758+0000","objects_scrubbed":2273,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:46.767646+0000","scrub_duration":1.556089611,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45442855,"num_objects":2273,"num_object_clones":0,"num_object_copies":9092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6171,"num_write_kb":50876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'601","reported_seq":637,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.673982+0000","last_change":"2023-11-18T19:24:42.674060+0000","last_active":"2023-11-18T19:24:42.673982+0000","last_peered":"2023-11-18T19:24:42.673982+0000","last_clean":"2023-11-18T19:24:42.673982+0000","last_became_active":"2023-11-18T19:06:37.054135+0000","last_became_peered":"2023-11-18T19:06:37.054135+0000","last_unstale":"2023-11-18T19:24:42.673982+0000","last_undegraded":"2023-11-18T19:24:42.673982+0000","last_fullsized":"2023-11-18T19:24:42.673982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'601","last_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_deep_scrub":"29'601","last_deep_scrub_stamp":"2023-11-18T19:24:42.673881+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.673881+0000","objects_scrubbed":99,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:23.664922+0000","scrub_duration":0.096252519999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":701,"num_write_kb":33858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":98,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":793362,"num_omap_keys":1372,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'1765","reported_seq":1829,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.986185+0000","last_change":"2023-11-18T19:24:48.986210+0000","last_active":"2023-11-18T19:24:48.986185+0000","last_peered":"2023-11-18T19:24:48.986185+0000","last_clean":"2023-11-18T19:24:48.986185+0000","last_became_active":"2023-11-18T19:06:37.570620+0000","last_became_peered":"2023-11-18T19:06:37.570620+0000","last_unstale":"2023-11-18T19:24:48.986185+0000","last_undegraded":"2023-11-18T19:24:48.986185+0000","last_fullsized":"2023-11-18T19:24:48.986185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:24:48.986121+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.986121+0000","objects_scrubbed":804,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:29.451254+0000","scrub_duration":0.73796645500000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":804,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'4623","reported_seq":4743,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:05.472427+0000","last_change":"2023-11-18T19:25:05.472494+0000","last_active":"2023-11-18T19:25:05.472427+0000","last_peered":"2023-11-18T19:25:05.472427+0000","last_clean":"2023-11-18T19:25:05.472427+0000","last_became_active":"2023-11-18T19:06:41.603633+0000","last_became_peered":"2023-11-18T19:06:41.603633+0000","last_unstale":"2023-11-18T19:25:05.472427+0000","last_undegraded":"2023-11-18T19:25:05.472427+0000","last_fullsized":"2023-11-18T19:25:05.472427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4623","last_scrub_stamp":"2023-11-18T19:25:05.472319+0000","last_deep_scrub":"29'4623","last_deep_scrub_stamp":"2023-11-18T19:25:05.472319+0000","last_clean_scrub_stamp":"2023-11-18T19:25:05.472319+0000","objects_scrubbed":2248,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:46.936644+0000","scrub_duration":1.6102027730000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48597389,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6213,"num_write_kb":53949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'348","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.660392+0000","last_change":"2023-11-18T19:24:49.660459+0000","last_active":"2023-11-18T19:24:49.660392+0000","last_peered":"2023-11-18T19:24:49.660392+0000","last_clean":"2023-11-18T19:24:49.660392+0000","last_became_active":"2023-11-18T19:06:37.059805+0000","last_became_peered":"2023-11-18T19:06:37.059805+0000","last_unstale":"2023-11-18T19:24:49.660392+0000","last_undegraded":"2023-11-18T19:24:49.660392+0000","last_fullsized":"2023-11-18T19:24:49.660392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'348","last_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_deep_scrub":"29'348","last_deep_scrub_stamp":"2023-11-18T19:24:49.660293+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.660293+0000","objects_scrubbed":92,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:50.955578+0000","scrub_duration":0.126544825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":442,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750456,"num_omap_keys":1290,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'1765","reported_seq":1828,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:26.169606+0000","last_change":"2023-11-18T19:25:26.169646+0000","last_active":"2023-11-18T19:25:26.169606+0000","last_peered":"2023-11-18T19:25:26.169606+0000","last_clean":"2023-11-18T19:25:26.169606+0000","last_became_active":"2023-11-18T19:06:37.579665+0000","last_became_peered":"2023-11-18T19:06:37.579665+0000","last_unstale":"2023-11-18T19:25:26.169606+0000","last_undegraded":"2023-11-18T19:25:26.169606+0000","last_fullsized":"2023-11-18T19:25:26.169606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:25:26.169541+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:25:26.169541+0000","last_clean_scrub_stamp":"2023-11-18T19:25:26.169541+0000","objects_scrubbed":765,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:02:26.191189+0000","scrub_duration":0.77567252499999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":821,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'4456","reported_seq":4577,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.785149+0000","last_change":"2023-11-18T19:24:57.785191+0000","last_active":"2023-11-18T19:24:57.785149+0000","last_peered":"2023-11-18T19:24:57.785149+0000","last_clean":"2023-11-18T19:24:57.785149+0000","last_became_active":"2023-11-18T19:06:41.614996+0000","last_became_peered":"2023-11-18T19:06:41.614996+0000","last_unstale":"2023-11-18T19:24:57.785149+0000","last_undegraded":"2023-11-18T19:24:57.785149+0000","last_fullsized":"2023-11-18T19:24:57.785149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4456","last_scrub_stamp":"2023-11-18T19:24:57.785048+0000","last_deep_scrub":"29'4456","last_deep_scrub_stamp":"2023-11-18T19:24:57.785048+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.785048+0000","objects_scrubbed":2218,"log_size":4456,"log_dups_size":0,"ondisk_log_size":4456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:27:55.199202+0000","scrub_duration":2.0432324529999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44553589,"num_objects":2218,"num_object_clones":0,"num_object_copies":8872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2218,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5936,"num_write_kb":45908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.744018+0000","last_change":"2023-11-18T19:24:39.744091+0000","last_active":"2023-11-18T19:24:39.744018+0000","last_peered":"2023-11-18T19:24:39.744018+0000","last_clean":"2023-11-18T19:24:39.744018+0000","last_became_active":"2023-11-18T19:06:37.580795+0000","last_became_peered":"2023-11-18T19:06:37.580795+0000","last_unstale":"2023-11-18T19:24:39.744018+0000","last_undegraded":"2023-11-18T19:24:39.744018+0000","last_fullsized":"2023-11-18T19:24:39.744018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.743952+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.743952+0000","objects_scrubbed":742,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:27.369898+0000","scrub_duration":0.70226359599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":742,"num_object_clones":0,"num_object_copies":1484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'519","reported_seq":558,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:10.417517+0000","last_change":"2023-11-18T19:25:10.417545+0000","last_active":"2023-11-18T19:25:10.417517+0000","last_peered":"2023-11-18T19:25:10.417517+0000","last_clean":"2023-11-18T19:25:10.417517+0000","last_became_active":"2023-11-18T19:06:37.048034+0000","last_became_peered":"2023-11-18T19:06:37.048034+0000","last_unstale":"2023-11-18T19:25:10.417517+0000","last_undegraded":"2023-11-18T19:25:10.417517+0000","last_fullsized":"2023-11-18T19:25:10.417517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'519","last_scrub_stamp":"2023-11-18T19:25:10.417438+0000","last_deep_scrub":"29'519","last_deep_scrub_stamp":"2023-11-18T19:25:10.417438+0000","last_clean_scrub_stamp":"2023-11-18T19:25:10.417438+0000","objects_scrubbed":103,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:48:34.362117+0000","scrub_duration":0.182611199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":29849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":885582,"num_omap_keys":1535,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'4620","reported_seq":4744,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.884423+0000","last_change":"2023-11-18T19:24:48.884469+0000","last_active":"2023-11-18T19:24:48.884423+0000","last_peered":"2023-11-18T19:24:48.884423+0000","last_clean":"2023-11-18T19:24:48.884423+0000","last_became_active":"2023-11-18T19:06:41.614370+0000","last_became_peered":"2023-11-18T19:06:41.614370+0000","last_unstale":"2023-11-18T19:24:48.884423+0000","last_undegraded":"2023-11-18T19:24:48.884423+0000","last_fullsized":"2023-11-18T19:24:48.884423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4620","last_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_deep_scrub":"29'4620","last_deep_scrub_stamp":"2023-11-18T19:24:48.884337+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.884337+0000","objects_scrubbed":2305,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:31.229044+0000","scrub_duration":1.771489595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50701125,"num_objects":2305,"num_object_clones":0,"num_object_copies":9220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6229,"num_write_kb":54754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'1748","reported_seq":1812,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:49.444406+0000","last_change":"2023-11-18T19:24:49.444480+0000","last_active":"2023-11-18T19:24:49.444406+0000","last_peered":"2023-11-18T19:24:49.444406+0000","last_clean":"2023-11-18T19:24:49.444406+0000","last_became_active":"2023-11-18T19:06:37.578031+0000","last_became_peered":"2023-11-18T19:06:37.578031+0000","last_unstale":"2023-11-18T19:24:49.444406+0000","last_undegraded":"2023-11-18T19:24:49.444406+0000","last_fullsized":"2023-11-18T19:24:49.444406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:49.444303+0000","last_clean_scrub_stamp":"2023-11-18T19:24:49.444303+0000","objects_scrubbed":785,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:12:21.815747+0000","scrub_duration":0.686602881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":785,"num_object_clones":0,"num_object_copies":1570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'524","reported_seq":562,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.697932+0000","last_change":"2023-11-18T19:24:37.698022+0000","last_active":"2023-11-18T19:24:37.697932+0000","last_peered":"2023-11-18T19:24:37.697932+0000","last_clean":"2023-11-18T19:24:37.697932+0000","last_became_active":"2023-11-18T19:06:37.051993+0000","last_became_peered":"2023-11-18T19:06:37.051993+0000","last_unstale":"2023-11-18T19:24:37.697932+0000","last_undegraded":"2023-11-18T19:24:37.697932+0000","last_fullsized":"2023-11-18T19:24:37.697932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'524","last_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_deep_scrub":"29'524","last_deep_scrub_stamp":"2023-11-18T19:24:37.697763+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.697763+0000","objects_scrubbed":95,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:12.850295+0000","scrub_duration":0.185472308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":30122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1242455,"num_omap_keys":2145,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'4571","reported_seq":4692,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:18.059825+0000","last_change":"2023-11-18T19:25:18.059880+0000","last_active":"2023-11-18T19:25:18.059825+0000","last_peered":"2023-11-18T19:25:18.059825+0000","last_clean":"2023-11-18T19:25:18.059825+0000","last_became_active":"2023-11-18T19:06:41.608732+0000","last_became_peered":"2023-11-18T19:06:41.608732+0000","last_unstale":"2023-11-18T19:25:18.059825+0000","last_undegraded":"2023-11-18T19:25:18.059825+0000","last_fullsized":"2023-11-18T19:25:18.059825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4571","last_scrub_stamp":"2023-11-18T19:25:18.059746+0000","last_deep_scrub":"29'4571","last_deep_scrub_stamp":"2023-11-18T19:25:18.059746+0000","last_clean_scrub_stamp":"2023-11-18T19:25:18.059746+0000","objects_scrubbed":2244,"log_size":4571,"log_dups_size":0,"ondisk_log_size":4571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:49.662341+0000","scrub_duration":1.3131504620000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51156678,"num_objects":2244,"num_object_clones":0,"num_object_copies":8976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6125,"num_write_kb":55507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'1789","reported_seq":1855,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:45.778711+0000","last_change":"2023-11-18T19:24:45.778740+0000","last_active":"2023-11-18T19:24:45.778711+0000","last_peered":"2023-11-18T19:24:45.778711+0000","last_clean":"2023-11-18T19:24:45.778711+0000","last_became_active":"2023-11-18T19:06:37.572325+0000","last_became_peered":"2023-11-18T19:06:37.572325+0000","last_unstale":"2023-11-18T19:24:45.778711+0000","last_undegraded":"2023-11-18T19:24:45.778711+0000","last_fullsized":"2023-11-18T19:24:45.778711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1789","last_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_deep_scrub":"29'1789","last_deep_scrub_stamp":"2023-11-18T19:24:45.778650+0000","last_clean_scrub_stamp":"2023-11-18T19:24:45.778650+0000","objects_scrubbed":808,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:55:47.073935+0000","scrub_duration":0.792586715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":808,"num_object_clones":0,"num_object_copies":1616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'542","reported_seq":581,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.181657+0000","last_change":"2023-11-18T19:24:34.181862+0000","last_active":"2023-11-18T19:24:34.181657+0000","last_peered":"2023-11-18T19:24:34.181657+0000","last_clean":"2023-11-18T19:24:34.181657+0000","last_became_active":"2023-11-18T19:06:37.059883+0000","last_became_peered":"2023-11-18T19:06:37.059883+0000","last_unstale":"2023-11-18T19:24:34.181657+0000","last_undegraded":"2023-11-18T19:24:34.181657+0000","last_fullsized":"2023-11-18T19:24:34.181657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'542","last_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_deep_scrub":"29'542","last_deep_scrub_stamp":"2023-11-18T19:24:34.181507+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.181507+0000","objects_scrubbed":113,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.334039+0000","scrub_duration":0.31913006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":17586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":869889,"num_omap_keys":1501,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'4609","reported_seq":4732,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.297236+0000","last_change":"2023-11-18T19:25:00.297272+0000","last_active":"2023-11-18T19:25:00.297236+0000","last_peered":"2023-11-18T19:25:00.297236+0000","last_clean":"2023-11-18T19:25:00.297236+0000","last_became_active":"2023-11-18T19:06:41.621507+0000","last_became_peered":"2023-11-18T19:06:41.621507+0000","last_unstale":"2023-11-18T19:25:00.297236+0000","last_undegraded":"2023-11-18T19:25:00.297236+0000","last_fullsized":"2023-11-18T19:25:00.297236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4609","last_scrub_stamp":"2023-11-18T19:25:00.297156+0000","last_deep_scrub":"29'4609","last_deep_scrub_stamp":"2023-11-18T19:25:00.297156+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.297156+0000","objects_scrubbed":2293,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:42:49.521582+0000","scrub_duration":1.357820765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59459210,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6233,"num_write_kb":63943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'1722","reported_seq":1786,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:27.725890+0000","last_change":"2023-11-18T19:25:27.725958+0000","last_active":"2023-11-18T19:25:27.725890+0000","last_peered":"2023-11-18T19:25:27.725890+0000","last_clean":"2023-11-18T19:25:27.725890+0000","last_became_active":"2023-11-18T19:06:37.580661+0000","last_became_peered":"2023-11-18T19:06:37.580661+0000","last_unstale":"2023-11-18T19:25:27.725890+0000","last_undegraded":"2023-11-18T19:25:27.725890+0000","last_fullsized":"2023-11-18T19:25:27.725890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1722","last_scrub_stamp":"2023-11-18T19:25:27.725713+0000","last_deep_scrub":"29'1722","last_deep_scrub_stamp":"2023-11-18T19:25:27.725713+0000","last_clean_scrub_stamp":"2023-11-18T19:25:27.725713+0000","objects_scrubbed":733,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:25:27.174524+0000","scrub_duration":1.3095815980000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":733,"num_object_clones":0,"num_object_copies":1466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'530","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:44.705515+0000","last_change":"2023-11-18T19:24:44.705608+0000","last_active":"2023-11-18T19:24:44.705515+0000","last_peered":"2023-11-18T19:24:44.705515+0000","last_clean":"2023-11-18T19:24:44.705515+0000","last_became_active":"2023-11-18T19:06:37.058729+0000","last_became_peered":"2023-11-18T19:06:37.058729+0000","last_unstale":"2023-11-18T19:24:44.705515+0000","last_undegraded":"2023-11-18T19:24:44.705515+0000","last_fullsized":"2023-11-18T19:24:44.705515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'530","last_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_deep_scrub":"29'530","last_deep_scrub_stamp":"2023-11-18T19:24:44.705369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:44.705369+0000","objects_scrubbed":70,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:22.256103+0000","scrub_duration":0.14586217300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":13046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":69,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522099,"num_omap_keys":901,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'4549","reported_seq":4673,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.067111+0000","last_change":"2023-11-18T19:25:06.067167+0000","last_active":"2023-11-18T19:25:06.067111+0000","last_peered":"2023-11-18T19:25:06.067111+0000","last_clean":"2023-11-18T19:25:06.067111+0000","last_became_active":"2023-11-18T19:06:41.609656+0000","last_became_peered":"2023-11-18T19:06:41.609656+0000","last_unstale":"2023-11-18T19:25:06.067111+0000","last_undegraded":"2023-11-18T19:25:06.067111+0000","last_fullsized":"2023-11-18T19:25:06.067111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4549","last_scrub_stamp":"2023-11-18T19:25:06.066995+0000","last_deep_scrub":"29'4549","last_deep_scrub_stamp":"2023-11-18T19:25:06.066995+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.066995+0000","objects_scrubbed":2311,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:41.908526+0000","scrub_duration":1.1642892309999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53723490,"num_objects":2311,"num_object_clones":0,"num_object_copies":9244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6133,"num_write_kb":58503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'1771","reported_seq":1836,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.658737+0000","last_change":"2023-11-18T19:24:55.658786+0000","last_active":"2023-11-18T19:24:55.658737+0000","last_peered":"2023-11-18T19:24:55.658737+0000","last_clean":"2023-11-18T19:24:55.658737+0000","last_became_active":"2023-11-18T19:06:37.572461+0000","last_became_peered":"2023-11-18T19:06:37.572461+0000","last_unstale":"2023-11-18T19:24:55.658737+0000","last_undegraded":"2023-11-18T19:24:55.658737+0000","last_fullsized":"2023-11-18T19:24:55.658737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1771","last_scrub_stamp":"2023-11-18T19:24:55.658661+0000","last_deep_scrub":"29'1771","last_deep_scrub_stamp":"2023-11-18T19:24:55.658661+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.658661+0000","objects_scrubbed":783,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:28.294107+0000","scrub_duration":0.71135849100000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":783,"num_object_clones":0,"num_object_copies":1566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'385","reported_seq":423,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:08.441949+0000","last_change":"2023-11-18T19:25:08.442011+0000","last_active":"2023-11-18T19:25:08.441949+0000","last_peered":"2023-11-18T19:25:08.441949+0000","last_clean":"2023-11-18T19:25:08.441949+0000","last_became_active":"2023-11-18T19:06:37.053160+0000","last_became_peered":"2023-11-18T19:06:37.053160+0000","last_unstale":"2023-11-18T19:25:08.441949+0000","last_undegraded":"2023-11-18T19:25:08.441949+0000","last_fullsized":"2023-11-18T19:25:08.441949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'385","last_scrub_stamp":"2023-11-18T19:25:08.441876+0000","last_deep_scrub":"29'385","last_deep_scrub_stamp":"2023-11-18T19:25:08.441876+0000","last_clean_scrub_stamp":"2023-11-18T19:25:08.441876+0000","objects_scrubbed":91,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T07:05:20.605127+0000","scrub_duration":0.16475478399999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":469,"num_write_kb":13215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":89,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":800497,"num_omap_keys":1387,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'4569","reported_seq":4692,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.291786+0000","last_change":"2023-11-18T19:24:53.291854+0000","last_active":"2023-11-18T19:24:53.291786+0000","last_peered":"2023-11-18T19:24:53.291786+0000","last_clean":"2023-11-18T19:24:53.291786+0000","last_became_active":"2023-11-18T19:06:41.595590+0000","last_became_peered":"2023-11-18T19:06:41.595590+0000","last_unstale":"2023-11-18T19:24:53.291786+0000","last_undegraded":"2023-11-18T19:24:53.291786+0000","last_fullsized":"2023-11-18T19:24:53.291786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4569","last_scrub_stamp":"2023-11-18T19:24:53.291684+0000","last_deep_scrub":"29'4569","last_deep_scrub_stamp":"2023-11-18T19:24:53.291684+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.291684+0000","objects_scrubbed":2264,"log_size":4569,"log_dups_size":0,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:35.819230+0000","scrub_duration":1.533954364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58452634,"num_objects":2264,"num_object_clones":0,"num_object_copies":9056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6141,"num_write_kb":62183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'1596","reported_seq":1658,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:31.486739+0000","last_change":"2023-11-18T19:24:31.486782+0000","last_active":"2023-11-18T19:24:31.486739+0000","last_peered":"2023-11-18T19:24:31.486739+0000","last_clean":"2023-11-18T19:24:31.486739+0000","last_became_active":"2023-11-18T19:06:37.567043+0000","last_became_peered":"2023-11-18T19:06:37.567043+0000","last_unstale":"2023-11-18T19:24:31.486739+0000","last_undegraded":"2023-11-18T19:24:31.486739+0000","last_fullsized":"2023-11-18T19:24:31.486739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1596","last_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_deep_scrub":"29'1596","last_deep_scrub_stamp":"2023-11-18T19:24:31.486678+0000","last_clean_scrub_stamp":"2023-11-18T19:24:31.486678+0000","objects_scrubbed":721,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:03.765253+0000","scrub_duration":0.68181534700000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":721,"num_object_clones":0,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'623","reported_seq":661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.085333+0000","last_change":"2023-11-18T19:24:37.085379+0000","last_active":"2023-11-18T19:24:37.085333+0000","last_peered":"2023-11-18T19:24:37.085333+0000","last_clean":"2023-11-18T19:24:37.085333+0000","last_became_active":"2023-11-18T19:06:37.061378+0000","last_became_peered":"2023-11-18T19:06:37.061378+0000","last_unstale":"2023-11-18T19:24:37.085333+0000","last_undegraded":"2023-11-18T19:24:37.085333+0000","last_fullsized":"2023-11-18T19:24:37.085333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'623","last_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_deep_scrub":"29'623","last_deep_scrub_stamp":"2023-11-18T19:24:37.085251+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.085251+0000","objects_scrubbed":96,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:19:26.864983+0000","scrub_duration":0.19450854400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1057,"num_write_kb":20813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1016762,"num_omap_keys":1760,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'4574","reported_seq":4697,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.127582+0000","last_change":"2023-11-18T19:25:06.127667+0000","last_active":"2023-11-18T19:25:06.127582+0000","last_peered":"2023-11-18T19:25:06.127582+0000","last_clean":"2023-11-18T19:25:06.127582+0000","last_became_active":"2023-11-18T19:06:41.604129+0000","last_became_peered":"2023-11-18T19:06:41.604129+0000","last_unstale":"2023-11-18T19:25:06.127582+0000","last_undegraded":"2023-11-18T19:25:06.127582+0000","last_fullsized":"2023-11-18T19:25:06.127582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4574","last_scrub_stamp":"2023-11-18T19:25:06.127397+0000","last_deep_scrub":"29'4574","last_deep_scrub_stamp":"2023-11-18T19:25:06.127397+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.127397+0000","objects_scrubbed":2267,"log_size":4574,"log_dups_size":0,"ondisk_log_size":4574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:40.560101+0000","scrub_duration":1.131583945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41932084,"num_objects":2267,"num_object_clones":0,"num_object_copies":9068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6154,"num_write_kb":45729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'1715","reported_seq":1781,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.117707+0000","last_change":"2023-11-18T19:24:50.117707+0000","last_active":"2023-11-18T19:24:50.117707+0000","last_peered":"2023-11-18T19:24:50.117707+0000","last_clean":"2023-11-18T19:24:50.117707+0000","last_became_active":"2023-11-18T19:06:37.567190+0000","last_became_peered":"2023-11-18T19:06:37.567190+0000","last_unstale":"2023-11-18T19:24:50.117707+0000","last_undegraded":"2023-11-18T19:24:50.117707+0000","last_fullsized":"2023-11-18T19:24:50.117707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1715","last_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_deep_scrub":"29'1715","last_deep_scrub_stamp":"2023-11-18T19:24:50.117602+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.117602+0000","objects_scrubbed":789,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:54:42.963090+0000","scrub_duration":0.69843094500000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'394","reported_seq":433,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:15.477710+0000","last_change":"2023-11-18T19:25:15.477710+0000","last_active":"2023-11-18T19:25:15.477710+0000","last_peered":"2023-11-18T19:25:15.477710+0000","last_clean":"2023-11-18T19:25:15.477710+0000","last_became_active":"2023-11-18T19:06:37.051879+0000","last_became_peered":"2023-11-18T19:06:37.051879+0000","last_unstale":"2023-11-18T19:25:15.477710+0000","last_undegraded":"2023-11-18T19:25:15.477710+0000","last_fullsized":"2023-11-18T19:25:15.477710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'394","last_scrub_stamp":"2023-11-18T19:25:15.477476+0000","last_deep_scrub":"29'394","last_deep_scrub_stamp":"2023-11-18T19:25:15.477476+0000","last_clean_scrub_stamp":"2023-11-18T19:25:15.477476+0000","objects_scrubbed":88,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:57:34.445896+0000","scrub_duration":0.17434539299999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":21633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":925641,"num_omap_keys":1601,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'4621","reported_seq":4745,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.977082+0000","last_change":"2023-11-18T19:25:04.977082+0000","last_active":"2023-11-18T19:25:04.977082+0000","last_peered":"2023-11-18T19:25:04.977082+0000","last_clean":"2023-11-18T19:25:04.977082+0000","last_became_active":"2023-11-18T19:06:41.611049+0000","last_became_peered":"2023-11-18T19:06:41.611049+0000","last_unstale":"2023-11-18T19:25:04.977082+0000","last_undegraded":"2023-11-18T19:25:04.977082+0000","last_fullsized":"2023-11-18T19:25:04.977082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4621","last_scrub_stamp":"2023-11-18T19:25:04.976895+0000","last_deep_scrub":"29'4621","last_deep_scrub_stamp":"2023-11-18T19:25:04.976895+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.976895+0000","objects_scrubbed":2287,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:08.539872+0000","scrub_duration":1.5362857939999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41011562,"num_objects":2287,"num_object_clones":0,"num_object_copies":9148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6203,"num_write_kb":46522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'1615","reported_seq":1678,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.715645+0000","last_change":"2023-11-18T19:24:38.715645+0000","last_active":"2023-11-18T19:24:38.715645+0000","last_peered":"2023-11-18T19:24:38.715645+0000","last_clean":"2023-11-18T19:24:38.715645+0000","last_became_active":"2023-11-18T19:06:37.559620+0000","last_became_peered":"2023-11-18T19:06:37.559620+0000","last_unstale":"2023-11-18T19:24:38.715645+0000","last_undegraded":"2023-11-18T19:24:38.715645+0000","last_fullsized":"2023-11-18T19:24:38.715645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1615","last_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_deep_scrub":"29'1615","last_deep_scrub_stamp":"2023-11-18T19:24:38.715496+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.715496+0000","objects_scrubbed":730,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:13.868028+0000","scrub_duration":1.1252372610000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'546","reported_seq":584,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.630412+0000","last_change":"2023-11-18T19:24:46.630412+0000","last_active":"2023-11-18T19:24:46.630412+0000","last_peered":"2023-11-18T19:24:46.630412+0000","last_clean":"2023-11-18T19:24:46.630412+0000","last_became_active":"2023-11-18T19:06:37.050691+0000","last_became_peered":"2023-11-18T19:06:37.050691+0000","last_unstale":"2023-11-18T19:24:46.630412+0000","last_undegraded":"2023-11-18T19:24:46.630412+0000","last_fullsized":"2023-11-18T19:24:46.630412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'546","last_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_deep_scrub":"29'546","last_deep_scrub_stamp":"2023-11-18T19:24:46.630325+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.630325+0000","objects_scrubbed":81,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:54:42.162213+0000","scrub_duration":0.13360024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":17360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":78,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":748148,"num_omap_keys":1294,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'4547","reported_seq":4669,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.715516+0000","last_change":"2023-11-18T19:25:07.715559+0000","last_active":"2023-11-18T19:25:07.715516+0000","last_peered":"2023-11-18T19:25:07.715516+0000","last_clean":"2023-11-18T19:25:07.715516+0000","last_became_active":"2023-11-18T19:06:41.618553+0000","last_became_peered":"2023-11-18T19:06:41.618553+0000","last_unstale":"2023-11-18T19:25:07.715516+0000","last_undegraded":"2023-11-18T19:25:07.715516+0000","last_fullsized":"2023-11-18T19:25:07.715516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4547","last_scrub_stamp":"2023-11-18T19:25:07.715413+0000","last_deep_scrub":"29'4547","last_deep_scrub_stamp":"2023-11-18T19:25:07.715413+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.715413+0000","objects_scrubbed":2248,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:23:43.556944+0000","scrub_duration":1.2605765070000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47540604,"num_objects":2248,"num_object_clones":0,"num_object_copies":8992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":53354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'1732","reported_seq":1796,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.289765+0000","last_change":"2023-11-18T19:24:56.289765+0000","last_active":"2023-11-18T19:24:56.289765+0000","last_peered":"2023-11-18T19:24:56.289765+0000","last_clean":"2023-11-18T19:24:56.289765+0000","last_became_active":"2023-11-18T19:06:37.569276+0000","last_became_peered":"2023-11-18T19:06:37.569276+0000","last_unstale":"2023-11-18T19:24:56.289765+0000","last_undegraded":"2023-11-18T19:24:56.289765+0000","last_fullsized":"2023-11-18T19:24:56.289765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1732","last_scrub_stamp":"2023-11-18T19:24:56.289631+0000","last_deep_scrub":"29'1732","last_deep_scrub_stamp":"2023-11-18T19:24:56.289631+0000","last_clean_scrub_stamp":"2023-11-18T19:24:56.289631+0000","objects_scrubbed":754,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:58.169206+0000","scrub_duration":0.72373005700000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'1282","reported_seq":1321,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:02.498508+0000","last_change":"2023-11-18T19:25:02.498508+0000","last_active":"2023-11-18T19:25:02.498508+0000","last_peered":"2023-11-18T19:25:02.498508+0000","last_clean":"2023-11-18T19:25:02.498508+0000","last_became_active":"2023-11-18T19:06:37.046387+0000","last_became_peered":"2023-11-18T19:06:37.046387+0000","last_unstale":"2023-11-18T19:25:02.498508+0000","last_undegraded":"2023-11-18T19:25:02.498508+0000","last_fullsized":"2023-11-18T19:25:02.498508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1282","last_scrub_stamp":"2023-11-18T19:25:02.498331+0000","last_deep_scrub":"29'1282","last_deep_scrub_stamp":"2023-11-18T19:25:02.498331+0000","last_clean_scrub_stamp":"2023-11-18T19:25:02.498331+0000","objects_scrubbed":99,"log_size":1282,"log_dups_size":0,"ondisk_log_size":1282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:34.100927+0000","scrub_duration":0.177219503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1036880,"num_omap_keys":1796,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'4578","reported_seq":4706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.781572+0000","last_change":"2023-11-18T19:25:03.781572+0000","last_active":"2023-11-18T19:25:03.781572+0000","last_peered":"2023-11-18T19:25:03.781572+0000","last_clean":"2023-11-18T19:25:03.781572+0000","last_became_active":"2023-11-18T19:06:41.615004+0000","last_became_peered":"2023-11-18T19:06:41.615004+0000","last_unstale":"2023-11-18T19:25:03.781572+0000","last_undegraded":"2023-11-18T19:25:03.781572+0000","last_fullsized":"2023-11-18T19:25:03.781572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4578","last_scrub_stamp":"2023-11-18T19:25:03.781403+0000","last_deep_scrub":"29'4578","last_deep_scrub_stamp":"2023-11-18T19:25:03.781403+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.781403+0000","objects_scrubbed":2302,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:10:05.660977+0000","scrub_duration":1.3622234500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39429542,"num_objects":2302,"num_object_clones":0,"num_object_copies":9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6195,"num_write_kb":48737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'1765","reported_seq":1830,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.508287+0000","last_change":"2023-11-18T19:24:57.508330+0000","last_active":"2023-11-18T19:24:57.508287+0000","last_peered":"2023-11-18T19:24:57.508287+0000","last_clean":"2023-11-18T19:24:57.508287+0000","last_became_active":"2023-11-18T19:06:37.578693+0000","last_became_peered":"2023-11-18T19:06:37.578693+0000","last_unstale":"2023-11-18T19:24:57.508287+0000","last_undegraded":"2023-11-18T19:24:57.508287+0000","last_fullsized":"2023-11-18T19:24:57.508287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1765","last_scrub_stamp":"2023-11-18T19:24:57.508195+0000","last_deep_scrub":"29'1765","last_deep_scrub_stamp":"2023-11-18T19:24:57.508195+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.508195+0000","objects_scrubbed":778,"log_size":1765,"log_dups_size":0,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:03:01.071172+0000","scrub_duration":0.98722459500000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":778,"num_object_clones":0,"num_object_copies":1556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1992","reported_seq":2867,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.414699+0000","last_change":"2023-11-18T19:24:37.978888+0000","last_active":"2023-11-18T19:24:56.414699+0000","last_peered":"2023-11-18T19:24:56.414699+0000","last_clean":"2023-11-18T19:24:56.414699+0000","last_became_active":"2023-11-18T19:06:37.057068+0000","last_became_peered":"2023-11-18T19:06:37.057068+0000","last_unstale":"2023-11-18T19:24:56.414699+0000","last_undegraded":"2023-11-18T19:24:56.414699+0000","last_fullsized":"2023-11-18T19:24:56.414699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1980","last_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_deep_scrub":"29'1980","last_deep_scrub_stamp":"2023-11-18T19:24:37.978780+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.978780+0000","objects_scrubbed":103,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:11:09.998369+0000","scrub_duration":0.181000729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13240280,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":836,"num_read_kb":1816,"num_write":2094,"num_write_kb":27224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":813940,"num_omap_keys":1408,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'4483","reported_seq":4604,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:11.900529+0000","last_change":"2023-11-18T19:25:11.900602+0000","last_active":"2023-11-18T19:25:11.900529+0000","last_peered":"2023-11-18T19:25:11.900529+0000","last_clean":"2023-11-18T19:25:11.900529+0000","last_became_active":"2023-11-18T19:06:41.605182+0000","last_became_peered":"2023-11-18T19:06:41.605182+0000","last_unstale":"2023-11-18T19:25:11.900529+0000","last_undegraded":"2023-11-18T19:25:11.900529+0000","last_fullsized":"2023-11-18T19:25:11.900529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4483","last_scrub_stamp":"2023-11-18T19:25:11.900419+0000","last_deep_scrub":"29'4483","last_deep_scrub_stamp":"2023-11-18T19:25:11.900419+0000","last_clean_scrub_stamp":"2023-11-18T19:25:11.900419+0000","objects_scrubbed":2217,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:44:13.457948+0000","scrub_duration":1.4797586389999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52629501,"num_objects":2217,"num_object_clones":0,"num_object_copies":8868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5979,"num_write_kb":58220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'1648","reported_seq":1712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:56.144332+0000","last_change":"2023-11-18T19:24:56.144332+0000","last_active":"2023-11-18T19:24:56.144332+0000","last_peered":"2023-11-18T19:24:56.144332+0000","last_clean":"2023-11-18T19:24:56.144332+0000","last_became_active":"2023-11-18T19:06:37.554537+0000","last_became_peered":"2023-11-18T19:06:37.554537+0000","last_unstale":"2023-11-18T19:24:56.144332+0000","last_undegraded":"2023-11-18T19:24:56.144332+0000","last_fullsized":"2023-11-18T19:24:56.144332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1648","last_scrub_stamp":"2023-11-18T19:24:56.144205+0000","last_deep_scrub":"29'1648","last_deep_scrub_stamp":"2023-11-18T19:24:56.144205+0000","last_clean_scrub_stamp":"2023-11-18T19:24:56.144205+0000","objects_scrubbed":729,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:38.671750+0000","scrub_duration":0.71927640299999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":729,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'574","reported_seq":613,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:01.538510+0000","last_change":"2023-11-18T19:25:01.538580+0000","last_active":"2023-11-18T19:25:01.538510+0000","last_peered":"2023-11-18T19:25:01.538510+0000","last_clean":"2023-11-18T19:25:01.538510+0000","last_became_active":"2023-11-18T19:06:37.056730+0000","last_became_peered":"2023-11-18T19:06:37.056730+0000","last_unstale":"2023-11-18T19:25:01.538510+0000","last_undegraded":"2023-11-18T19:25:01.538510+0000","last_fullsized":"2023-11-18T19:25:01.538510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'574","last_scrub_stamp":"2023-11-18T19:25:01.538406+0000","last_deep_scrub":"29'574","last_deep_scrub_stamp":"2023-11-18T19:25:01.538406+0000","last_clean_scrub_stamp":"2023-11-18T19:25:01.538406+0000","objects_scrubbed":91,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:09.053712+0000","scrub_duration":0.217749737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":29679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":793019,"num_omap_keys":1373,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'4675","reported_seq":4798,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:16.721902+0000","last_change":"2023-11-18T19:25:16.721935+0000","last_active":"2023-11-18T19:25:16.721902+0000","last_peered":"2023-11-18T19:25:16.721902+0000","last_clean":"2023-11-18T19:25:16.721902+0000","last_became_active":"2023-11-18T19:06:41.612944+0000","last_became_peered":"2023-11-18T19:06:41.612944+0000","last_unstale":"2023-11-18T19:25:16.721902+0000","last_undegraded":"2023-11-18T19:25:16.721902+0000","last_fullsized":"2023-11-18T19:25:16.721902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4675","last_scrub_stamp":"2023-11-18T19:25:16.721820+0000","last_deep_scrub":"29'4675","last_deep_scrub_stamp":"2023-11-18T19:25:16.721820+0000","last_clean_scrub_stamp":"2023-11-18T19:25:16.721820+0000","objects_scrubbed":2286,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:03:06.151479+0000","scrub_duration":1.2115808480000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43888851,"num_objects":2286,"num_object_clones":0,"num_object_copies":9144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6293,"num_write_kb":49652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'1725","reported_seq":1790,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.794174+0000","last_change":"2023-11-18T19:24:54.794174+0000","last_active":"2023-11-18T19:24:54.794174+0000","last_peered":"2023-11-18T19:24:54.794174+0000","last_clean":"2023-11-18T19:24:54.794174+0000","last_became_active":"2023-11-18T19:06:37.560270+0000","last_became_peered":"2023-11-18T19:06:37.560270+0000","last_unstale":"2023-11-18T19:24:54.794174+0000","last_undegraded":"2023-11-18T19:24:54.794174+0000","last_fullsized":"2023-11-18T19:24:54.794174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1725","last_scrub_stamp":"2023-11-18T19:24:54.794006+0000","last_deep_scrub":"29'1725","last_deep_scrub_stamp":"2023-11-18T19:24:54.794006+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.794006+0000","objects_scrubbed":768,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:35.582227+0000","scrub_duration":0.79753717599999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":768,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'520","reported_seq":560,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:06.397296+0000","last_change":"2023-11-18T19:25:06.397296+0000","last_active":"2023-11-18T19:25:06.397296+0000","last_peered":"2023-11-18T19:25:06.397296+0000","last_clean":"2023-11-18T19:25:06.397296+0000","last_became_active":"2023-11-18T19:06:37.037896+0000","last_became_peered":"2023-11-18T19:06:37.037896+0000","last_unstale":"2023-11-18T19:25:06.397296+0000","last_undegraded":"2023-11-18T19:25:06.397296+0000","last_fullsized":"2023-11-18T19:25:06.397296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'520","last_scrub_stamp":"2023-11-18T19:25:06.397201+0000","last_deep_scrub":"29'520","last_deep_scrub_stamp":"2023-11-18T19:25:06.397201+0000","last_clean_scrub_stamp":"2023-11-18T19:25:06.397201+0000","objects_scrubbed":105,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:02:21.146299+0000","scrub_duration":0.117494062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":103,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1043588,"num_omap_keys":1792,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:30.359024+0000","last_change":"2023-11-18T19:24:30.359024+0000","last_active":"2023-11-18T19:24:30.359024+0000","last_peered":"2023-11-18T19:24:30.359024+0000","last_clean":"2023-11-18T19:24:30.359024+0000","last_became_active":"2023-11-18T19:06:32.607919+0000","last_became_peered":"2023-11-18T19:06:32.607919+0000","last_unstale":"2023-11-18T19:24:30.359024+0000","last_undegraded":"2023-11-18T19:24:30.359024+0000","last_fullsized":"2023-11-18T19:24:30.359024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-11-18T19:24:30.358806+0000","last_clean_scrub_stamp":"2023-11-18T19:24:30.358806+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:00:26.918519+0000","scrub_duration":0.011450409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'4474","reported_seq":4596,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:29.256418+0000","last_change":"2023-11-18T19:25:29.256418+0000","last_active":"2023-11-18T19:25:29.256418+0000","last_peered":"2023-11-18T19:25:29.256418+0000","last_clean":"2023-11-18T19:25:29.256418+0000","last_became_active":"2023-11-18T19:06:41.593180+0000","last_became_peered":"2023-11-18T19:06:41.593180+0000","last_unstale":"2023-11-18T19:25:29.256418+0000","last_undegraded":"2023-11-18T19:25:29.256418+0000","last_fullsized":"2023-11-18T19:25:29.256418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4474","last_scrub_stamp":"2023-11-18T19:25:29.256302+0000","last_deep_scrub":"29'4474","last_deep_scrub_stamp":"2023-11-18T19:25:29.256302+0000","last_clean_scrub_stamp":"2023-11-18T19:25:29.256302+0000","objects_scrubbed":2231,"log_size":4474,"log_dups_size":0,"ondisk_log_size":4474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:57:40.415978+0000","scrub_duration":0.79865418099999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47903098,"num_objects":2231,"num_object_clones":0,"num_object_copies":8924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6002,"num_write_kb":53246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'1749","reported_seq":1813,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:24.035009+0000","last_change":"2023-11-18T19:25:24.035046+0000","last_active":"2023-11-18T19:25:24.035009+0000","last_peered":"2023-11-18T19:25:24.035009+0000","last_clean":"2023-11-18T19:25:24.035009+0000","last_became_active":"2023-11-18T19:06:37.582092+0000","last_became_peered":"2023-11-18T19:06:37.582092+0000","last_unstale":"2023-11-18T19:25:24.035009+0000","last_undegraded":"2023-11-18T19:25:24.035009+0000","last_fullsized":"2023-11-18T19:25:24.035009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1749","last_scrub_stamp":"2023-11-18T19:25:24.034935+0000","last_deep_scrub":"29'1749","last_deep_scrub_stamp":"2023-11-18T19:25:24.034935+0000","last_clean_scrub_stamp":"2023-11-18T19:25:24.034935+0000","objects_scrubbed":765,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:36:21.054419+0000","scrub_duration":0.68022165899999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":765,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'560","reported_seq":599,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.598604+0000","last_change":"2023-11-18T19:24:34.598604+0000","last_active":"2023-11-18T19:24:34.598604+0000","last_peered":"2023-11-18T19:24:34.598604+0000","last_clean":"2023-11-18T19:24:34.598604+0000","last_became_active":"2023-11-18T19:06:37.054811+0000","last_became_peered":"2023-11-18T19:06:37.054811+0000","last_unstale":"2023-11-18T19:24:34.598604+0000","last_undegraded":"2023-11-18T19:24:34.598604+0000","last_fullsized":"2023-11-18T19:24:34.598604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'560","last_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_deep_scrub":"29'560","last_deep_scrub_stamp":"2023-11-18T19:24:34.598509+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.598509+0000","objects_scrubbed":106,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:12:43.193975+0000","scrub_duration":0.13571029200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":658,"num_write_kb":29852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":978255,"num_omap_keys":1693,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'4629","reported_seq":4754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:07.189441+0000","last_change":"2023-11-18T19:25:07.189475+0000","last_active":"2023-11-18T19:25:07.189441+0000","last_peered":"2023-11-18T19:25:07.189441+0000","last_clean":"2023-11-18T19:25:07.189441+0000","last_became_active":"2023-11-18T19:06:41.601739+0000","last_became_peered":"2023-11-18T19:06:41.601739+0000","last_unstale":"2023-11-18T19:25:07.189441+0000","last_undegraded":"2023-11-18T19:25:07.189441+0000","last_fullsized":"2023-11-18T19:25:07.189441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4629","last_scrub_stamp":"2023-11-18T19:25:07.189345+0000","last_deep_scrub":"29'4629","last_deep_scrub_stamp":"2023-11-18T19:25:07.189345+0000","last_clean_scrub_stamp":"2023-11-18T19:25:07.189345+0000","objects_scrubbed":2278,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:44.817645+0000","scrub_duration":1.3284081409999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54570935,"num_objects":2278,"num_object_clones":0,"num_object_copies":9112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6188,"num_write_kb":56933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'1644","reported_seq":1705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.496598+0000","last_change":"2023-11-18T19:24:53.496662+0000","last_active":"2023-11-18T19:24:53.496598+0000","last_peered":"2023-11-18T19:24:53.496598+0000","last_clean":"2023-11-18T19:24:53.496598+0000","last_became_active":"2023-11-18T19:06:37.572582+0000","last_became_peered":"2023-11-18T19:06:37.572582+0000","last_unstale":"2023-11-18T19:24:53.496598+0000","last_undegraded":"2023-11-18T19:24:53.496598+0000","last_fullsized":"2023-11-18T19:24:53.496598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1644","last_scrub_stamp":"2023-11-18T19:24:53.496501+0000","last_deep_scrub":"29'1644","last_deep_scrub_stamp":"2023-11-18T19:24:53.496501+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.496501+0000","objects_scrubbed":717,"log_size":1644,"log_dups_size":0,"ondisk_log_size":1644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:04:41.122447+0000","scrub_duration":0.98882590699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":775,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'1005","reported_seq":1044,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:18.924455+0000","last_change":"2023-11-18T19:25:18.924518+0000","last_active":"2023-11-18T19:25:18.924455+0000","last_peered":"2023-11-18T19:25:18.924455+0000","last_clean":"2023-11-18T19:25:18.924455+0000","last_became_active":"2023-11-18T19:06:37.053690+0000","last_became_peered":"2023-11-18T19:06:37.053690+0000","last_unstale":"2023-11-18T19:25:18.924455+0000","last_undegraded":"2023-11-18T19:25:18.924455+0000","last_fullsized":"2023-11-18T19:25:18.924455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1005","last_scrub_stamp":"2023-11-18T19:25:18.924358+0000","last_deep_scrub":"29'1005","last_deep_scrub_stamp":"2023-11-18T19:25:18.924358+0000","last_clean_scrub_stamp":"2023-11-18T19:25:18.924358+0000","objects_scrubbed":113,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:03:40.989442+0000","scrub_duration":0.22984734500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":34394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1078371,"num_omap_keys":1867,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'4679","reported_seq":4804,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:09.150475+0000","last_change":"2023-11-18T19:25:09.150552+0000","last_active":"2023-11-18T19:25:09.150475+0000","last_peered":"2023-11-18T19:25:09.150475+0000","last_clean":"2023-11-18T19:25:09.150475+0000","last_became_active":"2023-11-18T19:06:41.604391+0000","last_became_peered":"2023-11-18T19:06:41.604391+0000","last_unstale":"2023-11-18T19:25:09.150475+0000","last_undegraded":"2023-11-18T19:25:09.150475+0000","last_fullsized":"2023-11-18T19:25:09.150475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4679","last_scrub_stamp":"2023-11-18T19:25:09.150298+0000","last_deep_scrub":"29'4679","last_deep_scrub_stamp":"2023-11-18T19:25:09.150298+0000","last_clean_scrub_stamp":"2023-11-18T19:25:09.150298+0000","objects_scrubbed":2317,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:20:58.225327+0000","scrub_duration":1.677471261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46904542,"num_objects":2317,"num_object_clones":0,"num_object_copies":9268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2317,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6289,"num_write_kb":52891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'1726","reported_seq":1789,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:08.653452+0000","last_change":"2023-11-18T19:25:08.653486+0000","last_active":"2023-11-18T19:25:08.653452+0000","last_peered":"2023-11-18T19:25:08.653452+0000","last_clean":"2023-11-18T19:25:08.653452+0000","last_became_active":"2023-11-18T19:06:37.575936+0000","last_became_peered":"2023-11-18T19:06:37.575936+0000","last_unstale":"2023-11-18T19:25:08.653452+0000","last_undegraded":"2023-11-18T19:25:08.653452+0000","last_fullsized":"2023-11-18T19:25:08.653452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1726","last_scrub_stamp":"2023-11-18T19:25:08.653384+0000","last_deep_scrub":"29'1726","last_deep_scrub_stamp":"2023-11-18T19:25:08.653384+0000","last_clean_scrub_stamp":"2023-11-18T19:25:08.653384+0000","objects_scrubbed":756,"log_size":1726,"log_dups_size":0,"ondisk_log_size":1726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:43.086088+0000","scrub_duration":0.73062439300000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'674","reported_seq":712,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.172427+0000","last_change":"2023-11-18T19:24:43.172427+0000","last_active":"2023-11-18T19:24:43.172427+0000","last_peered":"2023-11-18T19:24:43.172427+0000","last_clean":"2023-11-18T19:24:43.172427+0000","last_became_active":"2023-11-18T19:06:37.059252+0000","last_became_peered":"2023-11-18T19:06:37.059252+0000","last_unstale":"2023-11-18T19:24:43.172427+0000","last_undegraded":"2023-11-18T19:24:43.172427+0000","last_fullsized":"2023-11-18T19:24:43.172427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'674","last_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_deep_scrub":"29'674","last_deep_scrub_stamp":"2023-11-18T19:24:43.172207+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.172207+0000","objects_scrubbed":87,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:29.245092+0000","scrub_duration":0.19110829500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":764,"num_write_kb":21557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":780047,"num_omap_keys":1353,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'4788","reported_seq":4914,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:36.973309+0000","last_change":"2023-11-18T19:25:36.973374+0000","last_active":"2023-11-18T19:25:36.973309+0000","last_peered":"2023-11-18T19:25:36.973309+0000","last_clean":"2023-11-18T19:25:36.973309+0000","last_became_active":"2023-11-18T19:06:41.612685+0000","last_became_peered":"2023-11-18T19:06:41.612685+0000","last_unstale":"2023-11-18T19:25:36.973309+0000","last_undegraded":"2023-11-18T19:25:36.973309+0000","last_fullsized":"2023-11-18T19:25:36.973309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4788","last_scrub_stamp":"2023-11-18T19:25:36.973135+0000","last_deep_scrub":"29'4788","last_deep_scrub_stamp":"2023-11-18T19:25:36.973135+0000","last_clean_scrub_stamp":"2023-11-18T19:25:36.973135+0000","objects_scrubbed":2315,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:12:42.168233+0000","scrub_duration":1.5187974400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53454220,"num_objects":2315,"num_object_clones":0,"num_object_copies":9260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2315,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6433,"num_write_kb":59617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'1690","reported_seq":1754,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.385083+0000","last_change":"2023-11-18T19:24:46.385114+0000","last_active":"2023-11-18T19:24:46.385083+0000","last_peered":"2023-11-18T19:24:46.385083+0000","last_clean":"2023-11-18T19:24:46.385083+0000","last_became_active":"2023-11-18T19:06:37.569818+0000","last_became_peered":"2023-11-18T19:06:37.569818+0000","last_unstale":"2023-11-18T19:24:46.385083+0000","last_undegraded":"2023-11-18T19:24:46.385083+0000","last_fullsized":"2023-11-18T19:24:46.385083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1690","last_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_deep_scrub":"29'1690","last_deep_scrub_stamp":"2023-11-18T19:24:46.385005+0000","last_clean_scrub_stamp":"2023-11-18T19:24:46.385005+0000","objects_scrubbed":779,"log_size":1690,"log_dups_size":0,"ondisk_log_size":1690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:23.935739+0000","scrub_duration":0.68843222599999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'380","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.618846+0000","last_change":"2023-11-18T19:24:50.618882+0000","last_active":"2023-11-18T19:24:50.618846+0000","last_peered":"2023-11-18T19:24:50.618846+0000","last_clean":"2023-11-18T19:24:50.618846+0000","last_became_active":"2023-11-18T19:06:37.061300+0000","last_became_peered":"2023-11-18T19:06:37.061300+0000","last_unstale":"2023-11-18T19:24:50.618846+0000","last_undegraded":"2023-11-18T19:24:50.618846+0000","last_fullsized":"2023-11-18T19:24:50.618846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'380","last_scrub_stamp":"2023-11-18T19:24:50.618783+0000","last_deep_scrub":"29'380","last_deep_scrub_stamp":"2023-11-18T19:24:50.618783+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.618783+0000","objects_scrubbed":85,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:20:10.226608+0000","scrub_duration":0.092155729000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":464,"num_write_kb":13159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760791,"num_omap_keys":1317,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'4549","reported_seq":4674,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:50.915418+0000","last_change":"2023-11-18T19:24:50.915485+0000","last_active":"2023-11-18T19:24:50.915418+0000","last_peered":"2023-11-18T19:24:50.915418+0000","last_clean":"2023-11-18T19:24:50.915418+0000","last_became_active":"2023-11-18T19:06:41.604035+0000","last_became_peered":"2023-11-18T19:06:41.604035+0000","last_unstale":"2023-11-18T19:24:50.915418+0000","last_undegraded":"2023-11-18T19:24:50.915418+0000","last_fullsized":"2023-11-18T19:24:50.915418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4549","last_scrub_stamp":"2023-11-18T19:24:50.915309+0000","last_deep_scrub":"29'4549","last_deep_scrub_stamp":"2023-11-18T19:24:50.915309+0000","last_clean_scrub_stamp":"2023-11-18T19:24:50.915309+0000","objects_scrubbed":2272,"log_size":4549,"log_dups_size":0,"ondisk_log_size":4549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:26.067841+0000","scrub_duration":1.6764920270000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38942896,"num_objects":2272,"num_object_clones":0,"num_object_copies":9088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2272,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6093,"num_write_kb":44455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'1720","reported_seq":1785,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.763675+0000","last_change":"2023-11-18T19:24:40.763675+0000","last_active":"2023-11-18T19:24:40.763675+0000","last_peered":"2023-11-18T19:24:40.763675+0000","last_clean":"2023-11-18T19:24:40.763675+0000","last_became_active":"2023-11-18T19:06:37.571470+0000","last_became_peered":"2023-11-18T19:06:37.571470+0000","last_unstale":"2023-11-18T19:24:40.763675+0000","last_undegraded":"2023-11-18T19:24:40.763675+0000","last_fullsized":"2023-11-18T19:24:40.763675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1720","last_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_deep_scrub":"29'1720","last_deep_scrub_stamp":"2023-11-18T19:24:40.763553+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.763553+0000","objects_scrubbed":775,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:21.551774+0000","scrub_duration":0.70050171100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'457","reported_seq":496,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.976674+0000","last_change":"2023-11-18T19:24:35.976674+0000","last_active":"2023-11-18T19:24:35.976674+0000","last_peered":"2023-11-18T19:24:35.976674+0000","last_clean":"2023-11-18T19:24:35.976674+0000","last_became_active":"2023-11-18T19:06:37.054335+0000","last_became_peered":"2023-11-18T19:06:37.054335+0000","last_unstale":"2023-11-18T19:24:35.976674+0000","last_undegraded":"2023-11-18T19:24:35.976674+0000","last_fullsized":"2023-11-18T19:24:35.976674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'457","last_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_deep_scrub":"29'457","last_deep_scrub_stamp":"2023-11-18T19:24:35.976524+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.976524+0000","objects_scrubbed":106,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:11.920966+0000","scrub_duration":0.135262152,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":559,"num_write_kb":13211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":791411,"num_omap_keys":1371,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'4506","reported_seq":4636,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:12.627032+0000","last_change":"2023-11-18T19:25:12.627181+0000","last_active":"2023-11-18T19:25:12.627032+0000","last_peered":"2023-11-18T19:25:12.627032+0000","last_clean":"2023-11-18T19:25:12.627032+0000","last_became_active":"2023-11-18T19:07:25.181319+0000","last_became_peered":"2023-11-18T19:07:25.181319+0000","last_unstale":"2023-11-18T19:25:12.627032+0000","last_undegraded":"2023-11-18T19:25:12.627032+0000","last_fullsized":"2023-11-18T19:25:12.627032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4506","last_scrub_stamp":"2023-11-18T19:25:12.626903+0000","last_deep_scrub":"29'4506","last_deep_scrub_stamp":"2023-11-18T19:25:12.626903+0000","last_clean_scrub_stamp":"2023-11-18T19:25:12.626903+0000","objects_scrubbed":2243,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:53:44.229499+0000","scrub_duration":1.0906887300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40895696,"num_objects":2243,"num_object_clones":0,"num_object_copies":8972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6032,"num_write_kb":44369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'1659","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.229729+0000","last_change":"2023-11-18T19:24:35.229793+0000","last_active":"2023-11-18T19:24:35.229729+0000","last_peered":"2023-11-18T19:24:35.229729+0000","last_clean":"2023-11-18T19:24:35.229729+0000","last_became_active":"2023-11-18T19:06:37.566634+0000","last_became_peered":"2023-11-18T19:06:37.566634+0000","last_unstale":"2023-11-18T19:24:35.229729+0000","last_undegraded":"2023-11-18T19:24:35.229729+0000","last_fullsized":"2023-11-18T19:24:35.229729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:35.229558+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.229558+0000","objects_scrubbed":760,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T04:49:59.305496+0000","scrub_duration":0.89828437900000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":760,"num_object_clones":0,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'378","reported_seq":416,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.761185+0000","last_change":"2023-11-18T19:24:40.761185+0000","last_active":"2023-11-18T19:24:40.761185+0000","last_peered":"2023-11-18T19:24:40.761185+0000","last_clean":"2023-11-18T19:24:40.761185+0000","last_became_active":"2023-11-18T19:06:37.058769+0000","last_became_peered":"2023-11-18T19:06:37.058769+0000","last_unstale":"2023-11-18T19:24:40.761185+0000","last_undegraded":"2023-11-18T19:24:40.761185+0000","last_fullsized":"2023-11-18T19:24:40.761185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'378","last_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_deep_scrub":"29'378","last_deep_scrub_stamp":"2023-11-18T19:24:40.761091+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.761091+0000","objects_scrubbed":103,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.893620+0000","scrub_duration":0.17205548400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":490,"num_write_kb":9347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":102,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":960166,"num_omap_keys":1656,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'4642","reported_seq":4765,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:19.042344+0000","last_change":"2023-11-18T19:25:19.042391+0000","last_active":"2023-11-18T19:25:19.042344+0000","last_peered":"2023-11-18T19:25:19.042344+0000","last_clean":"2023-11-18T19:25:19.042344+0000","last_became_active":"2023-11-18T19:06:41.609778+0000","last_became_peered":"2023-11-18T19:06:41.609778+0000","last_unstale":"2023-11-18T19:25:19.042344+0000","last_undegraded":"2023-11-18T19:25:19.042344+0000","last_fullsized":"2023-11-18T19:25:19.042344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4642","last_scrub_stamp":"2023-11-18T19:25:19.042217+0000","last_deep_scrub":"29'4642","last_deep_scrub_stamp":"2023-11-18T19:25:19.042217+0000","last_clean_scrub_stamp":"2023-11-18T19:25:19.042217+0000","objects_scrubbed":2314,"log_size":4642,"log_dups_size":0,"ondisk_log_size":4642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:20:58.606129+0000","scrub_duration":1.583892517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39856077,"num_objects":2314,"num_object_clones":0,"num_object_copies":9256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6236,"num_write_kb":46931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'1678","reported_seq":1749,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:52.077506+0000","last_change":"2023-11-18T19:24:52.077506+0000","last_active":"2023-11-18T19:24:52.077506+0000","last_peered":"2023-11-18T19:24:52.077506+0000","last_clean":"2023-11-18T19:24:52.077506+0000","last_became_active":"2023-11-18T19:07:25.178644+0000","last_became_peered":"2023-11-18T19:07:25.178644+0000","last_unstale":"2023-11-18T19:24:52.077506+0000","last_undegraded":"2023-11-18T19:24:52.077506+0000","last_fullsized":"2023-11-18T19:24:52.077506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1678","last_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_deep_scrub":"29'1678","last_deep_scrub_stamp":"2023-11-18T19:24:52.077370+0000","last_clean_scrub_stamp":"2023-11-18T19:24:52.077370+0000","objects_scrubbed":752,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:34.158108+0000","scrub_duration":0.83265436500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'551","reported_seq":590,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:09.486063+0000","last_change":"2023-11-18T19:25:09.486063+0000","last_active":"2023-11-18T19:25:09.486063+0000","last_peered":"2023-11-18T19:25:09.486063+0000","last_clean":"2023-11-18T19:25:09.486063+0000","last_became_active":"2023-11-18T19:06:37.052741+0000","last_became_peered":"2023-11-18T19:06:37.052741+0000","last_unstale":"2023-11-18T19:25:09.486063+0000","last_undegraded":"2023-11-18T19:25:09.486063+0000","last_fullsized":"2023-11-18T19:25:09.486063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'551","last_scrub_stamp":"2023-11-18T19:25:09.485788+0000","last_deep_scrub":"29'551","last_deep_scrub_stamp":"2023-11-18T19:25:09.485788+0000","last_clean_scrub_stamp":"2023-11-18T19:25:09.485788+0000","objects_scrubbed":119,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:20:49.049700+0000","scrub_duration":0.22252060300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":667,"num_write_kb":5679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":118,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1383140,"num_omap_keys":2394,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'4441","reported_seq":4561,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:12.487658+0000","last_change":"2023-11-18T19:25:12.487713+0000","last_active":"2023-11-18T19:25:12.487658+0000","last_peered":"2023-11-18T19:25:12.487658+0000","last_clean":"2023-11-18T19:25:12.487658+0000","last_became_active":"2023-11-18T19:06:41.614433+0000","last_became_peered":"2023-11-18T19:06:41.614433+0000","last_unstale":"2023-11-18T19:25:12.487658+0000","last_undegraded":"2023-11-18T19:25:12.487658+0000","last_fullsized":"2023-11-18T19:25:12.487658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4441","last_scrub_stamp":"2023-11-18T19:25:12.487558+0000","last_deep_scrub":"29'4441","last_deep_scrub_stamp":"2023-11-18T19:25:12.487558+0000","last_clean_scrub_stamp":"2023-11-18T19:25:12.487558+0000","objects_scrubbed":2216,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:14:05.929221+0000","scrub_duration":1.0898806889999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54095014,"num_objects":2216,"num_object_clones":0,"num_object_copies":8864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":57308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'1598","reported_seq":1661,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.624746+0000","last_change":"2023-11-18T19:24:47.624774+0000","last_active":"2023-11-18T19:24:47.624746+0000","last_peered":"2023-11-18T19:24:47.624746+0000","last_clean":"2023-11-18T19:24:47.624746+0000","last_became_active":"2023-11-18T19:06:37.555288+0000","last_became_peered":"2023-11-18T19:06:37.555288+0000","last_unstale":"2023-11-18T19:24:47.624746+0000","last_undegraded":"2023-11-18T19:24:47.624746+0000","last_fullsized":"2023-11-18T19:24:47.624746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1598","last_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_deep_scrub":"29'1598","last_deep_scrub_stamp":"2023-11-18T19:24:47.624684+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.624684+0000","objects_scrubbed":728,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:24.581876+0000","scrub_duration":1.2034515859999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":728,"num_object_clones":0,"num_object_copies":1456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'473","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.898110+0000","last_change":"2023-11-18T19:24:40.898110+0000","last_active":"2023-11-18T19:24:40.898110+0000","last_peered":"2023-11-18T19:24:40.898110+0000","last_clean":"2023-11-18T19:24:40.898110+0000","last_became_active":"2023-11-18T19:06:37.061381+0000","last_became_peered":"2023-11-18T19:06:37.061381+0000","last_unstale":"2023-11-18T19:24:40.898110+0000","last_undegraded":"2023-11-18T19:24:40.898110+0000","last_fullsized":"2023-11-18T19:24:40.898110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-11-18T19:24:40.897977+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.897977+0000","objects_scrubbed":109,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:16:56.736936+0000","scrub_duration":0.11219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":17513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":107,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983835,"num_omap_keys":1695,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'4424","reported_seq":4542,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:35.154988+0000","last_change":"2023-11-18T19:25:35.155049+0000","last_active":"2023-11-18T19:25:35.154988+0000","last_peered":"2023-11-18T19:25:35.154988+0000","last_clean":"2023-11-18T19:25:35.154988+0000","last_became_active":"2023-11-18T19:06:41.597935+0000","last_became_peered":"2023-11-18T19:06:41.597935+0000","last_unstale":"2023-11-18T19:25:35.154988+0000","last_undegraded":"2023-11-18T19:25:35.154988+0000","last_fullsized":"2023-11-18T19:25:35.154988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4424","last_scrub_stamp":"2023-11-18T19:25:35.154870+0000","last_deep_scrub":"29'4424","last_deep_scrub_stamp":"2023-11-18T19:25:35.154870+0000","last_clean_scrub_stamp":"2023-11-18T19:25:35.154870+0000","objects_scrubbed":2199,"log_size":4424,"log_dups_size":0,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:32:28.186736+0000","scrub_duration":1.690780883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46166125,"num_objects":2199,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5987,"num_write_kb":51129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'1681","reported_seq":1742,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.616613+0000","last_change":"2023-11-18T19:24:57.616644+0000","last_active":"2023-11-18T19:24:57.616613+0000","last_peered":"2023-11-18T19:24:57.616613+0000","last_clean":"2023-11-18T19:24:57.616613+0000","last_became_active":"2023-11-18T19:06:37.566481+0000","last_became_peered":"2023-11-18T19:06:37.566481+0000","last_unstale":"2023-11-18T19:24:57.616613+0000","last_undegraded":"2023-11-18T19:24:57.616613+0000","last_fullsized":"2023-11-18T19:24:57.616613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1681","last_scrub_stamp":"2023-11-18T19:24:57.616554+0000","last_deep_scrub":"29'1681","last_deep_scrub_stamp":"2023-11-18T19:24:57.616554+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.616554+0000","objects_scrubbed":735,"log_size":1681,"log_dups_size":0,"ondisk_log_size":1681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:39.080879+0000","scrub_duration":1.0186718859999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":735,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'709","reported_seq":747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:46.408025+0000","last_change":"2023-11-18T19:24:29.886066+0000","last_active":"2023-11-18T19:24:46.408025+0000","last_peered":"2023-11-18T19:24:46.408025+0000","last_clean":"2023-11-18T19:24:46.408025+0000","last_became_active":"2023-11-18T19:06:37.049362+0000","last_became_peered":"2023-11-18T19:06:37.049362+0000","last_unstale":"2023-11-18T19:24:46.408025+0000","last_undegraded":"2023-11-18T19:24:46.408025+0000","last_fullsized":"2023-11-18T19:24:46.408025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'708","last_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_deep_scrub":"29'708","last_deep_scrub_stamp":"2023-11-18T19:24:29.885926+0000","last_clean_scrub_stamp":"2023-11-18T19:24:29.885926+0000","objects_scrubbed":114,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:49:27.530776+0000","scrub_duration":0.20191796100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":819,"num_write_kb":30026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1073426,"num_omap_keys":1850,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'4438","reported_seq":4560,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:17.339371+0000","last_change":"2023-11-18T19:25:17.339439+0000","last_active":"2023-11-18T19:25:17.339371+0000","last_peered":"2023-11-18T19:25:17.339371+0000","last_clean":"2023-11-18T19:25:17.339371+0000","last_became_active":"2023-11-18T19:06:41.600949+0000","last_became_peered":"2023-11-18T19:06:41.600949+0000","last_unstale":"2023-11-18T19:25:17.339371+0000","last_undegraded":"2023-11-18T19:25:17.339371+0000","last_fullsized":"2023-11-18T19:25:17.339371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4438","last_scrub_stamp":"2023-11-18T19:25:17.339302+0000","last_deep_scrub":"29'4438","last_deep_scrub_stamp":"2023-11-18T19:25:17.339302+0000","last_clean_scrub_stamp":"2023-11-18T19:25:17.339302+0000","objects_scrubbed":2240,"log_size":4438,"log_dups_size":0,"ondisk_log_size":4438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:22:44.462434+0000","scrub_duration":1.144069467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53099612,"num_objects":2240,"num_object_clones":0,"num_object_copies":8960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":56300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'1645","reported_seq":1709,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:42.764519+0000","last_change":"2023-11-18T19:24:42.764519+0000","last_active":"2023-11-18T19:24:42.764519+0000","last_peered":"2023-11-18T19:24:42.764519+0000","last_clean":"2023-11-18T19:24:42.764519+0000","last_became_active":"2023-11-18T19:06:37.573605+0000","last_became_peered":"2023-11-18T19:06:37.573605+0000","last_unstale":"2023-11-18T19:24:42.764519+0000","last_undegraded":"2023-11-18T19:24:42.764519+0000","last_fullsized":"2023-11-18T19:24:42.764519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1645","last_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_deep_scrub":"29'1645","last_deep_scrub_stamp":"2023-11-18T19:24:42.764426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:42.764426+0000","objects_scrubbed":754,"log_size":1645,"log_dups_size":0,"ondisk_log_size":1645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:47:41.052967+0000","scrub_duration":0.66715310100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'864","reported_seq":902,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:38.887069+0000","last_change":"2023-11-18T19:24:38.887069+0000","last_active":"2023-11-18T19:24:38.887069+0000","last_peered":"2023-11-18T19:24:38.887069+0000","last_clean":"2023-11-18T19:24:38.887069+0000","last_became_active":"2023-11-18T19:06:37.052908+0000","last_became_peered":"2023-11-18T19:06:37.052908+0000","last_unstale":"2023-11-18T19:24:38.887069+0000","last_undegraded":"2023-11-18T19:24:38.887069+0000","last_fullsized":"2023-11-18T19:24:38.887069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'864","last_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_deep_scrub":"29'864","last_deep_scrub_stamp":"2023-11-18T19:24:38.886964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:38.886964+0000","objects_scrubbed":105,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:12:30.822719+0000","scrub_duration":0.11150884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":978,"num_write_kb":22256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":104,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1222405,"num_omap_keys":2117,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'4525","reported_seq":4648,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.091600+0000","last_change":"2023-11-18T19:24:59.091600+0000","last_active":"2023-11-18T19:24:59.091600+0000","last_peered":"2023-11-18T19:24:59.091600+0000","last_clean":"2023-11-18T19:24:59.091600+0000","last_became_active":"2023-11-18T19:06:41.611216+0000","last_became_peered":"2023-11-18T19:06:41.611216+0000","last_unstale":"2023-11-18T19:24:59.091600+0000","last_undegraded":"2023-11-18T19:24:59.091600+0000","last_fullsized":"2023-11-18T19:24:59.091600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4525","last_scrub_stamp":"2023-11-18T19:24:59.091460+0000","last_deep_scrub":"29'4525","last_deep_scrub_stamp":"2023-11-18T19:24:59.091460+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.091460+0000","objects_scrubbed":2280,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:31.726906+0000","scrub_duration":1.355858741,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879149,"num_objects":2280,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6129,"num_write_kb":43117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'1659","reported_seq":1721,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.452862+0000","last_change":"2023-11-18T19:24:39.452988+0000","last_active":"2023-11-18T19:24:39.452862+0000","last_peered":"2023-11-18T19:24:39.452862+0000","last_clean":"2023-11-18T19:24:39.452862+0000","last_became_active":"2023-11-18T19:06:37.580018+0000","last_became_peered":"2023-11-18T19:06:37.580018+0000","last_unstale":"2023-11-18T19:24:39.452862+0000","last_undegraded":"2023-11-18T19:24:39.452862+0000","last_fullsized":"2023-11-18T19:24:39.452862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:24:39.452680+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.452680+0000","objects_scrubbed":759,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:28:20.443722+0000","scrub_duration":0.99957551600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":759,"num_object_clones":0,"num_object_copies":1518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'469","reported_seq":506,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:17.814985+0000","last_change":"2023-11-18T19:25:17.815067+0000","last_active":"2023-11-18T19:25:17.814985+0000","last_peered":"2023-11-18T19:25:17.814985+0000","last_clean":"2023-11-18T19:25:17.814985+0000","last_became_active":"2023-11-18T19:06:37.054215+0000","last_became_peered":"2023-11-18T19:06:37.054215+0000","last_unstale":"2023-11-18T19:25:17.814985+0000","last_undegraded":"2023-11-18T19:25:17.814985+0000","last_fullsized":"2023-11-18T19:25:17.814985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'469","last_scrub_stamp":"2023-11-18T19:25:17.814890+0000","last_deep_scrub":"29'469","last_deep_scrub_stamp":"2023-11-18T19:25:17.814890+0000","last_clean_scrub_stamp":"2023-11-18T19:25:17.814890+0000","objects_scrubbed":95,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:44:26.126121+0000","scrub_duration":0.096433412999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":562,"num_write_kb":25902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":94,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1057213,"num_omap_keys":1825,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'4461","reported_seq":4580,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.396551+0000","last_change":"2023-11-18T19:24:55.396551+0000","last_active":"2023-11-18T19:24:55.396551+0000","last_peered":"2023-11-18T19:24:55.396551+0000","last_clean":"2023-11-18T19:24:55.396551+0000","last_became_active":"2023-11-18T19:06:41.619930+0000","last_became_peered":"2023-11-18T19:06:41.619930+0000","last_unstale":"2023-11-18T19:24:55.396551+0000","last_undegraded":"2023-11-18T19:24:55.396551+0000","last_fullsized":"2023-11-18T19:24:55.396551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4461","last_scrub_stamp":"2023-11-18T19:24:55.396432+0000","last_deep_scrub":"29'4461","last_deep_scrub_stamp":"2023-11-18T19:24:55.396432+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.396432+0000","objects_scrubbed":2174,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:12:03.605551+0000","scrub_duration":1.6315117909999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66632640,"num_objects":2174,"num_object_clones":0,"num_object_copies":8696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5996,"num_write_kb":69942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1636","reported_seq":1697,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:43.238531+0000","last_change":"2023-11-18T19:24:43.238571+0000","last_active":"2023-11-18T19:24:43.238531+0000","last_peered":"2023-11-18T19:24:43.238531+0000","last_clean":"2023-11-18T19:24:43.238531+0000","last_became_active":"2023-11-18T19:06:37.585724+0000","last_became_peered":"2023-11-18T19:06:37.585724+0000","last_unstale":"2023-11-18T19:24:43.238531+0000","last_undegraded":"2023-11-18T19:24:43.238531+0000","last_fullsized":"2023-11-18T19:24:43.238531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1636","last_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_deep_scrub":"29'1636","last_deep_scrub_stamp":"2023-11-18T19:24:43.238470+0000","last_clean_scrub_stamp":"2023-11-18T19:24:43.238470+0000","objects_scrubbed":739,"log_size":1636,"log_dups_size":0,"ondisk_log_size":1636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:56:20.195661+0000","scrub_duration":0.60574622300000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":739,"num_object_clones":0,"num_object_copies":1478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'1304","reported_seq":1340,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.520069+0000","last_change":"2023-11-18T19:24:33.520162+0000","last_active":"2023-11-18T19:24:33.520069+0000","last_peered":"2023-11-18T19:24:33.520069+0000","last_clean":"2023-11-18T19:24:33.520069+0000","last_became_active":"2023-11-18T19:06:37.053649+0000","last_became_peered":"2023-11-18T19:06:37.053649+0000","last_unstale":"2023-11-18T19:24:33.520069+0000","last_undegraded":"2023-11-18T19:24:33.520069+0000","last_fullsized":"2023-11-18T19:24:33.520069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1304","last_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_deep_scrub":"29'1304","last_deep_scrub_stamp":"2023-11-18T19:24:33.519964+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.519964+0000","objects_scrubbed":92,"log_size":1304,"log_dups_size":0,"ondisk_log_size":1304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:14:51.501118+0000","scrub_duration":0.21152945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1397,"num_write_kb":22068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":88,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":927405,"num_omap_keys":1607,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'4689","reported_seq":4822,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:13.575950+0000","last_change":"2023-11-18T19:25:13.576042+0000","last_active":"2023-11-18T19:25:13.575950+0000","last_peered":"2023-11-18T19:25:13.575950+0000","last_clean":"2023-11-18T19:25:13.575950+0000","last_became_active":"2023-11-18T19:07:25.178595+0000","last_became_peered":"2023-11-18T19:07:25.178595+0000","last_unstale":"2023-11-18T19:25:13.575950+0000","last_undegraded":"2023-11-18T19:25:13.575950+0000","last_fullsized":"2023-11-18T19:25:13.575950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4689","last_scrub_stamp":"2023-11-18T19:25:13.575746+0000","last_deep_scrub":"29'4689","last_deep_scrub_stamp":"2023-11-18T19:25:13.575746+0000","last_clean_scrub_stamp":"2023-11-18T19:25:13.575746+0000","objects_scrubbed":2318,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:21:02.650775+0000","scrub_duration":1.463575847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55111025,"num_objects":2318,"num_object_clones":0,"num_object_copies":9272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6322,"num_write_kb":61083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'4432","reported_seq":4552,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.216746+0000","last_change":"2023-11-18T19:25:00.216796+0000","last_active":"2023-11-18T19:25:00.216746+0000","last_peered":"2023-11-18T19:25:00.216746+0000","last_clean":"2023-11-18T19:25:00.216746+0000","last_became_active":"2023-11-18T19:06:41.604052+0000","last_became_peered":"2023-11-18T19:06:41.604052+0000","last_unstale":"2023-11-18T19:25:00.216746+0000","last_undegraded":"2023-11-18T19:25:00.216746+0000","last_fullsized":"2023-11-18T19:25:00.216746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4432","last_scrub_stamp":"2023-11-18T19:25:00.216656+0000","last_deep_scrub":"29'4432","last_deep_scrub_stamp":"2023-11-18T19:25:00.216656+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.216656+0000","objects_scrubbed":2171,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:27:37.844955+0000","scrub_duration":1.2639129570000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32576492,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5932,"num_write_kb":38798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'1679","reported_seq":1742,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:48.978485+0000","last_change":"2023-11-18T19:24:48.978523+0000","last_active":"2023-11-18T19:24:48.978485+0000","last_peered":"2023-11-18T19:24:48.978485+0000","last_clean":"2023-11-18T19:24:48.978485+0000","last_became_active":"2023-11-18T19:06:37.564144+0000","last_became_peered":"2023-11-18T19:06:37.564144+0000","last_unstale":"2023-11-18T19:24:48.978485+0000","last_undegraded":"2023-11-18T19:24:48.978485+0000","last_fullsized":"2023-11-18T19:24:48.978485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1679","last_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_deep_scrub":"29'1679","last_deep_scrub_stamp":"2023-11-18T19:24:48.978288+0000","last_clean_scrub_stamp":"2023-11-18T19:24:48.978288+0000","objects_scrubbed":751,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:07:55.106118+0000","scrub_duration":1.0109235620000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":751,"num_object_clones":0,"num_object_copies":1502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'629","reported_seq":666,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.400778+0000","last_change":"2023-11-18T19:25:00.400826+0000","last_active":"2023-11-18T19:25:00.400778+0000","last_peered":"2023-11-18T19:25:00.400778+0000","last_clean":"2023-11-18T19:25:00.400778+0000","last_became_active":"2023-11-18T19:06:37.049354+0000","last_became_peered":"2023-11-18T19:06:37.049354+0000","last_unstale":"2023-11-18T19:25:00.400778+0000","last_undegraded":"2023-11-18T19:25:00.400778+0000","last_fullsized":"2023-11-18T19:25:00.400778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'629","last_scrub_stamp":"2023-11-18T19:25:00.400713+0000","last_deep_scrub":"29'629","last_deep_scrub_stamp":"2023-11-18T19:25:00.400713+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.400713+0000","objects_scrubbed":96,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:57:12.384151+0000","scrub_duration":0.115138529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":714,"num_write_kb":37768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686812,"num_omap_keys":1180,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4401","reported_seq":4520,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:32.906662+0000","last_change":"2023-11-18T19:25:32.906708+0000","last_active":"2023-11-18T19:25:32.906662+0000","last_peered":"2023-11-18T19:25:32.906662+0000","last_clean":"2023-11-18T19:25:32.906662+0000","last_became_active":"2023-11-18T19:06:41.609769+0000","last_became_peered":"2023-11-18T19:06:41.609769+0000","last_unstale":"2023-11-18T19:25:32.906662+0000","last_undegraded":"2023-11-18T19:25:32.906662+0000","last_fullsized":"2023-11-18T19:25:32.906662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4401","last_scrub_stamp":"2023-11-18T19:25:32.906554+0000","last_deep_scrub":"29'4401","last_deep_scrub_stamp":"2023-11-18T19:25:32.906554+0000","last_clean_scrub_stamp":"2023-11-18T19:25:32.906554+0000","objects_scrubbed":2171,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:55:11.189342+0000","scrub_duration":1.430790145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48972751,"num_objects":2171,"num_object_clones":0,"num_object_copies":8684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5897,"num_write_kb":53292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'1811","reported_seq":1874,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.250798+0000","last_change":"2023-11-18T19:24:55.250843+0000","last_active":"2023-11-18T19:24:55.250798+0000","last_peered":"2023-11-18T19:24:55.250798+0000","last_clean":"2023-11-18T19:24:55.250798+0000","last_became_active":"2023-11-18T19:06:37.567722+0000","last_became_peered":"2023-11-18T19:06:37.567722+0000","last_unstale":"2023-11-18T19:24:55.250798+0000","last_undegraded":"2023-11-18T19:24:55.250798+0000","last_fullsized":"2023-11-18T19:24:55.250798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1811","last_scrub_stamp":"2023-11-18T19:24:55.250715+0000","last_deep_scrub":"29'1811","last_deep_scrub_stamp":"2023-11-18T19:24:55.250715+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.250715+0000","objects_scrubbed":790,"log_size":1811,"log_dups_size":0,"ondisk_log_size":1811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:47:53.539256+0000","scrub_duration":0.80458674799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":790,"num_object_clones":0,"num_object_copies":1580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'395","reported_seq":432,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:35.625437+0000","last_change":"2023-11-18T19:24:35.625514+0000","last_active":"2023-11-18T19:24:35.625437+0000","last_peered":"2023-11-18T19:24:35.625437+0000","last_clean":"2023-11-18T19:24:35.625437+0000","last_became_active":"2023-11-18T19:06:37.056508+0000","last_became_peered":"2023-11-18T19:06:37.056508+0000","last_unstale":"2023-11-18T19:24:35.625437+0000","last_undegraded":"2023-11-18T19:24:35.625437+0000","last_fullsized":"2023-11-18T19:24:35.625437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'395","last_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_deep_scrub":"29'395","last_deep_scrub_stamp":"2023-11-18T19:24:35.625354+0000","last_clean_scrub_stamp":"2023-11-18T19:24:35.625354+0000","objects_scrubbed":89,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:45:07.903929+0000","scrub_duration":0.13174055800000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":17267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":86,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624270,"num_omap_keys":1080,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'754","reported_seq":791,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.386128+0000","last_change":"2023-11-18T19:24:54.386184+0000","last_active":"2023-11-18T19:24:54.386128+0000","last_peered":"2023-11-18T19:24:54.386128+0000","last_clean":"2023-11-18T19:24:54.386128+0000","last_became_active":"2023-11-18T19:06:37.061844+0000","last_became_peered":"2023-11-18T19:06:37.061844+0000","last_unstale":"2023-11-18T19:24:54.386128+0000","last_undegraded":"2023-11-18T19:24:54.386128+0000","last_fullsized":"2023-11-18T19:24:54.386128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'754","last_scrub_stamp":"2023-11-18T19:24:54.386020+0000","last_deep_scrub":"29'754","last_deep_scrub_stamp":"2023-11-18T19:24:54.386020+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.386020+0000","objects_scrubbed":84,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:38:45.723280+0000","scrub_duration":0.112168427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":33823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":83,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734298,"num_omap_keys":1270,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'1722","reported_seq":1786,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.703281+0000","last_change":"2023-11-18T19:24:57.703314+0000","last_active":"2023-11-18T19:24:57.703281+0000","last_peered":"2023-11-18T19:24:57.703281+0000","last_clean":"2023-11-18T19:24:57.703281+0000","last_became_active":"2023-11-18T19:06:37.582408+0000","last_became_peered":"2023-11-18T19:06:37.582408+0000","last_unstale":"2023-11-18T19:24:57.703281+0000","last_undegraded":"2023-11-18T19:24:57.703281+0000","last_fullsized":"2023-11-18T19:24:57.703281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1722","last_scrub_stamp":"2023-11-18T19:24:57.703180+0000","last_deep_scrub":"29'1722","last_deep_scrub_stamp":"2023-11-18T19:24:57.703180+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.703180+0000","objects_scrubbed":753,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:09:59.582754+0000","scrub_duration":0.816760708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":753,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'4623","reported_seq":4747,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:10.102500+0000","last_change":"2023-11-18T19:25:10.102527+0000","last_active":"2023-11-18T19:25:10.102500+0000","last_peered":"2023-11-18T19:25:10.102500+0000","last_clean":"2023-11-18T19:25:10.102500+0000","last_became_active":"2023-11-18T19:06:41.617948+0000","last_became_peered":"2023-11-18T19:06:41.617948+0000","last_unstale":"2023-11-18T19:25:10.102500+0000","last_undegraded":"2023-11-18T19:25:10.102500+0000","last_fullsized":"2023-11-18T19:25:10.102500+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4623","last_scrub_stamp":"2023-11-18T19:25:10.102391+0000","last_deep_scrub":"29'4623","last_deep_scrub_stamp":"2023-11-18T19:25:10.102391+0000","last_clean_scrub_stamp":"2023-11-18T19:25:10.102391+0000","objects_scrubbed":2330,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:51:13.104536+0000","scrub_duration":0.98392403900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50816520,"num_objects":2330,"num_object_clones":0,"num_object_copies":9320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6227,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'347","reported_seq":383,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.606792+0000","last_change":"2023-11-18T19:24:47.606905+0000","last_active":"2023-11-18T19:24:47.606792+0000","last_peered":"2023-11-18T19:24:47.606792+0000","last_clean":"2023-11-18T19:24:47.606792+0000","last_became_active":"2023-11-18T19:06:37.053552+0000","last_became_peered":"2023-11-18T19:06:37.053552+0000","last_unstale":"2023-11-18T19:24:47.606792+0000","last_undegraded":"2023-11-18T19:24:47.606792+0000","last_fullsized":"2023-11-18T19:24:47.606792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'347","last_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_deep_scrub":"29'347","last_deep_scrub_stamp":"2023-11-18T19:24:47.606700+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.606700+0000","objects_scrubbed":94,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:30.134246+0000","scrub_duration":0.098167455000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":17351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":92,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":803356,"num_omap_keys":1386,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'1649","reported_seq":1711,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.232037+0000","last_change":"2023-11-18T19:24:36.232095+0000","last_active":"2023-11-18T19:24:36.232037+0000","last_peered":"2023-11-18T19:24:36.232037+0000","last_clean":"2023-11-18T19:24:36.232037+0000","last_became_active":"2023-11-18T19:06:37.574471+0000","last_became_peered":"2023-11-18T19:06:37.574471+0000","last_unstale":"2023-11-18T19:24:36.232037+0000","last_undegraded":"2023-11-18T19:24:36.232037+0000","last_fullsized":"2023-11-18T19:24:36.232037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1649","last_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_deep_scrub":"29'1649","last_deep_scrub_stamp":"2023-11-18T19:24:36.231937+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.231937+0000","objects_scrubbed":750,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T02:00:22.588964+0000","scrub_duration":0.88128349299999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4639","reported_seq":4762,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.554068+0000","last_change":"2023-11-18T19:25:03.554103+0000","last_active":"2023-11-18T19:25:03.554068+0000","last_peered":"2023-11-18T19:25:03.554068+0000","last_clean":"2023-11-18T19:25:03.554068+0000","last_became_active":"2023-11-18T19:06:41.616971+0000","last_became_peered":"2023-11-18T19:06:41.616971+0000","last_unstale":"2023-11-18T19:25:03.554068+0000","last_undegraded":"2023-11-18T19:25:03.554068+0000","last_fullsized":"2023-11-18T19:25:03.554068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4639","last_scrub_stamp":"2023-11-18T19:25:03.553986+0000","last_deep_scrub":"29'4639","last_deep_scrub_stamp":"2023-11-18T19:25:03.553986+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.553986+0000","objects_scrubbed":2293,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:10:19.628587+0000","scrub_duration":1.600373467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38511782,"num_objects":2293,"num_object_clones":0,"num_object_copies":9172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6251,"num_write_kb":44615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'1674","reported_seq":1737,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.367314+0000","last_change":"2023-11-18T19:24:36.367314+0000","last_active":"2023-11-18T19:24:36.367314+0000","last_peered":"2023-11-18T19:24:36.367314+0000","last_clean":"2023-11-18T19:24:36.367314+0000","last_became_active":"2023-11-18T19:06:37.557691+0000","last_became_peered":"2023-11-18T19:06:37.557691+0000","last_unstale":"2023-11-18T19:24:36.367314+0000","last_undegraded":"2023-11-18T19:24:36.367314+0000","last_fullsized":"2023-11-18T19:24:36.367314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1674","last_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_deep_scrub":"29'1674","last_deep_scrub_stamp":"2023-11-18T19:24:36.367175+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.367175+0000","objects_scrubbed":749,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:16.832308+0000","scrub_duration":0.77027508200000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":749,"num_object_clones":0,"num_object_copies":1498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'1755","reported_seq":1819,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:51.422509+0000","last_change":"2023-11-18T19:24:51.422509+0000","last_active":"2023-11-18T19:24:51.422509+0000","last_peered":"2023-11-18T19:24:51.422509+0000","last_clean":"2023-11-18T19:24:51.422509+0000","last_became_active":"2023-11-18T19:06:37.579175+0000","last_became_peered":"2023-11-18T19:06:37.579175+0000","last_unstale":"2023-11-18T19:24:51.422509+0000","last_undegraded":"2023-11-18T19:24:51.422509+0000","last_fullsized":"2023-11-18T19:24:51.422509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1755","last_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_deep_scrub":"29'1755","last_deep_scrub_stamp":"2023-11-18T19:24:51.422369+0000","last_clean_scrub_stamp":"2023-11-18T19:24:51.422369+0000","objects_scrubbed":772,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:34:08.088915+0000","scrub_duration":0.69839206799999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":846,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'1665","reported_seq":1729,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:47.392072+0000","last_change":"2023-11-18T19:24:47.392170+0000","last_active":"2023-11-18T19:24:47.392072+0000","last_peered":"2023-11-18T19:24:47.392072+0000","last_clean":"2023-11-18T19:24:47.392072+0000","last_became_active":"2023-11-18T19:06:37.574837+0000","last_became_peered":"2023-11-18T19:06:37.574837+0000","last_unstale":"2023-11-18T19:24:47.392072+0000","last_undegraded":"2023-11-18T19:24:47.392072+0000","last_fullsized":"2023-11-18T19:24:47.392072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1665","last_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_deep_scrub":"29'1665","last_deep_scrub_stamp":"2023-11-18T19:24:47.391954+0000","last_clean_scrub_stamp":"2023-11-18T19:24:47.391954+0000","objects_scrubbed":747,"log_size":1665,"log_dups_size":0,"ondisk_log_size":1665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:28.856279+0000","scrub_duration":1.3015815769999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'1697","reported_seq":1762,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:37.060679+0000","last_change":"2023-11-18T19:24:37.060679+0000","last_active":"2023-11-18T19:24:37.060679+0000","last_peered":"2023-11-18T19:24:37.060679+0000","last_clean":"2023-11-18T19:24:37.060679+0000","last_became_active":"2023-11-18T19:06:37.578417+0000","last_became_peered":"2023-11-18T19:06:37.578417+0000","last_unstale":"2023-11-18T19:24:37.060679+0000","last_undegraded":"2023-11-18T19:24:37.060679+0000","last_fullsized":"2023-11-18T19:24:37.060679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1697","last_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_deep_scrub":"29'1697","last_deep_scrub_stamp":"2023-11-18T19:24:37.060556+0000","last_clean_scrub_stamp":"2023-11-18T19:24:37.060556+0000","objects_scrubbed":776,"log_size":1697,"log_dups_size":0,"ondisk_log_size":1697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:32.193085+0000","scrub_duration":0.65753342699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'1757","reported_seq":1823,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:02.472378+0000","last_change":"2023-11-18T19:25:02.472417+0000","last_active":"2023-11-18T19:25:02.472378+0000","last_peered":"2023-11-18T19:25:02.472378+0000","last_clean":"2023-11-18T19:25:02.472378+0000","last_became_active":"2023-11-18T19:06:37.566497+0000","last_became_peered":"2023-11-18T19:06:37.566497+0000","last_unstale":"2023-11-18T19:25:02.472378+0000","last_undegraded":"2023-11-18T19:25:02.472378+0000","last_fullsized":"2023-11-18T19:25:02.472378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1757","last_scrub_stamp":"2023-11-18T19:25:02.472285+0000","last_deep_scrub":"29'1757","last_deep_scrub_stamp":"2023-11-18T19:25:02.472285+0000","last_clean_scrub_stamp":"2023-11-18T19:25:02.472285+0000","objects_scrubbed":776,"log_size":1757,"log_dups_size":0,"ondisk_log_size":1757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:48:00.760826+0000","scrub_duration":1.028693885,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":776,"num_object_clones":0,"num_object_copies":1552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'1717","reported_seq":1781,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:00.102506+0000","last_change":"2023-11-18T19:25:00.102551+0000","last_active":"2023-11-18T19:25:00.102506+0000","last_peered":"2023-11-18T19:25:00.102506+0000","last_clean":"2023-11-18T19:25:00.102506+0000","last_became_active":"2023-11-18T19:06:37.574206+0000","last_became_peered":"2023-11-18T19:06:37.574206+0000","last_unstale":"2023-11-18T19:25:00.102506+0000","last_undegraded":"2023-11-18T19:25:00.102506+0000","last_fullsized":"2023-11-18T19:25:00.102506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1717","last_scrub_stamp":"2023-11-18T19:25:00.102415+0000","last_deep_scrub":"29'1717","last_deep_scrub_stamp":"2023-11-18T19:25:00.102415+0000","last_clean_scrub_stamp":"2023-11-18T19:25:00.102415+0000","objects_scrubbed":756,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:00:35.093032+0000","scrub_duration":0.69076674599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":802,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'1737","reported_seq":1801,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.490923+0000","last_change":"2023-11-18T19:24:39.490959+0000","last_active":"2023-11-18T19:24:39.490923+0000","last_peered":"2023-11-18T19:24:39.490923+0000","last_clean":"2023-11-18T19:24:39.490923+0000","last_became_active":"2023-11-18T19:06:37.585806+0000","last_became_peered":"2023-11-18T19:06:37.585806+0000","last_unstale":"2023-11-18T19:24:39.490923+0000","last_undegraded":"2023-11-18T19:24:39.490923+0000","last_fullsized":"2023-11-18T19:24:39.490923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1737","last_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_deep_scrub":"29'1737","last_deep_scrub_stamp":"2023-11-18T19:24:39.490839+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.490839+0000","objects_scrubbed":775,"log_size":1737,"log_dups_size":0,"ondisk_log_size":1737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:03.420048+0000","scrub_duration":0.91801021400000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":775,"num_object_clones":0,"num_object_copies":1550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'1673","reported_seq":1734,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:05.481509+0000","last_change":"2023-11-18T19:25:05.481556+0000","last_active":"2023-11-18T19:25:05.481509+0000","last_peered":"2023-11-18T19:25:05.481509+0000","last_clean":"2023-11-18T19:25:05.481509+0000","last_became_active":"2023-11-18T19:06:37.577675+0000","last_became_peered":"2023-11-18T19:06:37.577675+0000","last_unstale":"2023-11-18T19:25:05.481509+0000","last_undegraded":"2023-11-18T19:25:05.481509+0000","last_fullsized":"2023-11-18T19:25:05.481509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1673","last_scrub_stamp":"2023-11-18T19:25:05.481414+0000","last_deep_scrub":"29'1673","last_deep_scrub_stamp":"2023-11-18T19:25:05.481414+0000","last_clean_scrub_stamp":"2023-11-18T19:25:05.481414+0000","objects_scrubbed":716,"log_size":1673,"log_dups_size":0,"ondisk_log_size":1673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:17:39.914118+0000","scrub_duration":0.96291879400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":716,"num_object_clones":0,"num_object_copies":1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'1670","reported_seq":1734,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.792839+0000","last_change":"2023-11-18T19:24:36.792888+0000","last_active":"2023-11-18T19:24:36.792839+0000","last_peered":"2023-11-18T19:24:36.792839+0000","last_clean":"2023-11-18T19:24:36.792839+0000","last_became_active":"2023-11-18T19:06:37.572210+0000","last_became_peered":"2023-11-18T19:06:37.572210+0000","last_unstale":"2023-11-18T19:24:36.792839+0000","last_undegraded":"2023-11-18T19:24:36.792839+0000","last_fullsized":"2023-11-18T19:24:36.792839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:36.792770+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.792770+0000","objects_scrubbed":756,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:57:19.320316+0000","scrub_duration":0.74211921199999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":756,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'1695","reported_seq":1758,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.293584+0000","last_change":"2023-11-18T19:24:54.293629+0000","last_active":"2023-11-18T19:24:54.293584+0000","last_peered":"2023-11-18T19:24:54.293584+0000","last_clean":"2023-11-18T19:24:54.293584+0000","last_became_active":"2023-11-18T19:06:37.566119+0000","last_became_peered":"2023-11-18T19:06:37.566119+0000","last_unstale":"2023-11-18T19:24:54.293584+0000","last_undegraded":"2023-11-18T19:24:54.293584+0000","last_fullsized":"2023-11-18T19:24:54.293584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1695","last_scrub_stamp":"2023-11-18T19:24:54.293491+0000","last_deep_scrub":"29'1695","last_deep_scrub_stamp":"2023-11-18T19:24:54.293491+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.293491+0000","objects_scrubbed":762,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:27:51.707645+0000","scrub_duration":0.87214751400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":762,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1670","reported_seq":1733,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:39.259703+0000","last_change":"2023-11-18T19:24:39.259703+0000","last_active":"2023-11-18T19:24:39.259703+0000","last_peered":"2023-11-18T19:24:39.259703+0000","last_clean":"2023-11-18T19:24:39.259703+0000","last_became_active":"2023-11-18T19:06:37.570134+0000","last_became_peered":"2023-11-18T19:06:37.570134+0000","last_unstale":"2023-11-18T19:24:39.259703+0000","last_undegraded":"2023-11-18T19:24:39.259703+0000","last_fullsized":"2023-11-18T19:24:39.259703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1670","last_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_deep_scrub":"29'1670","last_deep_scrub_stamp":"2023-11-18T19:24:39.259562+0000","last_clean_scrub_stamp":"2023-11-18T19:24:39.259562+0000","objects_scrubbed":757,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:11:51.163210+0000","scrub_duration":0.86967187400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":757,"num_object_clones":0,"num_object_copies":1514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'1773","reported_seq":1838,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:58.604255+0000","last_change":"2023-11-18T19:24:58.604299+0000","last_active":"2023-11-18T19:24:58.604255+0000","last_peered":"2023-11-18T19:24:58.604255+0000","last_clean":"2023-11-18T19:24:58.604255+0000","last_became_active":"2023-11-18T19:06:37.568502+0000","last_became_peered":"2023-11-18T19:06:37.568502+0000","last_unstale":"2023-11-18T19:24:58.604255+0000","last_undegraded":"2023-11-18T19:24:58.604255+0000","last_fullsized":"2023-11-18T19:24:58.604255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1773","last_scrub_stamp":"2023-11-18T19:24:58.604157+0000","last_deep_scrub":"29'1773","last_deep_scrub_stamp":"2023-11-18T19:24:58.604157+0000","last_clean_scrub_stamp":"2023-11-18T19:24:58.604157+0000","objects_scrubbed":780,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:46:40.068483+0000","scrub_duration":0.69858347499999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":780,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'1686","reported_seq":1749,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:28.333003+0000","last_change":"2023-11-18T19:24:28.333003+0000","last_active":"2023-11-18T19:24:28.333003+0000","last_peered":"2023-11-18T19:24:28.333003+0000","last_clean":"2023-11-18T19:24:28.333003+0000","last_became_active":"2023-11-18T19:06:37.568050+0000","last_became_peered":"2023-11-18T19:06:37.568050+0000","last_unstale":"2023-11-18T19:24:28.333003+0000","last_undegraded":"2023-11-18T19:24:28.333003+0000","last_fullsized":"2023-11-18T19:24:28.333003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1686","last_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_deep_scrub":"29'1686","last_deep_scrub_stamp":"2023-11-18T19:24:28.332899+0000","last_clean_scrub_stamp":"2023-11-18T19:24:28.332899+0000","objects_scrubbed":752,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:59:08.798032+0000","scrub_duration":0.58671065600000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":752,"num_object_clones":0,"num_object_copies":1504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'1778","reported_seq":1843,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:18.059366+0000","last_change":"2023-11-18T19:25:18.059415+0000","last_active":"2023-11-18T19:25:18.059366+0000","last_peered":"2023-11-18T19:25:18.059366+0000","last_clean":"2023-11-18T19:25:18.059366+0000","last_became_active":"2023-11-18T19:06:37.581760+0000","last_became_peered":"2023-11-18T19:06:37.581760+0000","last_unstale":"2023-11-18T19:25:18.059366+0000","last_undegraded":"2023-11-18T19:25:18.059366+0000","last_fullsized":"2023-11-18T19:25:18.059366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1778","last_scrub_stamp":"2023-11-18T19:25:18.059264+0000","last_deep_scrub":"29'1778","last_deep_scrub_stamp":"2023-11-18T19:25:18.059264+0000","last_clean_scrub_stamp":"2023-11-18T19:25:18.059264+0000","objects_scrubbed":779,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:41:41.845850+0000","scrub_duration":0.76468850499999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'1634","reported_seq":1696,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:52.440493+0000","last_change":"2023-11-18T19:24:52.440530+0000","last_active":"2023-11-18T19:24:52.440493+0000","last_peered":"2023-11-18T19:24:52.440493+0000","last_clean":"2023-11-18T19:24:52.440493+0000","last_became_active":"2023-11-18T19:06:37.579298+0000","last_became_peered":"2023-11-18T19:06:37.579298+0000","last_unstale":"2023-11-18T19:24:52.440493+0000","last_undegraded":"2023-11-18T19:24:52.440493+0000","last_fullsized":"2023-11-18T19:24:52.440493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1634","last_scrub_stamp":"2023-11-18T19:24:52.440420+0000","last_deep_scrub":"29'1634","last_deep_scrub_stamp":"2023-11-18T19:24:52.440420+0000","last_clean_scrub_stamp":"2023-11-18T19:24:52.440420+0000","objects_scrubbed":747,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T19:35:46.497947+0000","scrub_duration":0.66661862599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":747,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'1748","reported_seq":1814,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:33.744380+0000","last_change":"2023-11-18T19:24:33.744380+0000","last_active":"2023-11-18T19:24:33.744380+0000","last_peered":"2023-11-18T19:24:33.744380+0000","last_clean":"2023-11-18T19:24:33.744380+0000","last_became_active":"2023-11-18T19:06:37.579114+0000","last_became_peered":"2023-11-18T19:06:37.579114+0000","last_unstale":"2023-11-18T19:24:33.744380+0000","last_undegraded":"2023-11-18T19:24:33.744380+0000","last_fullsized":"2023-11-18T19:24:33.744380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1748","last_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_deep_scrub":"29'1748","last_deep_scrub_stamp":"2023-11-18T19:24:33.744286+0000","last_clean_scrub_stamp":"2023-11-18T19:24:33.744286+0000","objects_scrubbed":806,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:54:19.817171+0000","scrub_duration":0.70702235400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":806,"num_object_clones":0,"num_object_copies":1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'1632","reported_seq":1695,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.957946+0000","last_change":"2023-11-18T19:24:53.957946+0000","last_active":"2023-11-18T19:24:53.957946+0000","last_peered":"2023-11-18T19:24:53.957946+0000","last_clean":"2023-11-18T19:24:53.957946+0000","last_became_active":"2023-11-18T19:06:37.563673+0000","last_became_peered":"2023-11-18T19:06:37.563673+0000","last_unstale":"2023-11-18T19:24:53.957946+0000","last_undegraded":"2023-11-18T19:24:53.957946+0000","last_fullsized":"2023-11-18T19:24:53.957946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1632","last_scrub_stamp":"2023-11-18T19:24:53.957803+0000","last_deep_scrub":"29'1632","last_deep_scrub_stamp":"2023-11-18T19:24:53.957803+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.957803+0000","objects_scrubbed":727,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:47.399466+0000","scrub_duration":0.71560208599999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":727,"num_object_clones":0,"num_object_copies":1454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'1779","reported_seq":1843,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:59.184163+0000","last_change":"2023-11-18T19:24:59.184163+0000","last_active":"2023-11-18T19:24:59.184163+0000","last_peered":"2023-11-18T19:24:59.184163+0000","last_clean":"2023-11-18T19:24:59.184163+0000","last_became_active":"2023-11-18T19:06:37.574532+0000","last_became_peered":"2023-11-18T19:06:37.574532+0000","last_unstale":"2023-11-18T19:24:59.184163+0000","last_undegraded":"2023-11-18T19:24:59.184163+0000","last_fullsized":"2023-11-18T19:24:59.184163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1779","last_scrub_stamp":"2023-11-18T19:24:59.184039+0000","last_deep_scrub":"29'1779","last_deep_scrub_stamp":"2023-11-18T19:24:59.184039+0000","last_clean_scrub_stamp":"2023-11-18T19:24:59.184039+0000","objects_scrubbed":782,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:44:41.528746+0000","scrub_duration":0.67582518400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'1668","reported_seq":1731,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:57.545597+0000","last_change":"2023-11-18T19:24:57.545635+0000","last_active":"2023-11-18T19:24:57.545597+0000","last_peered":"2023-11-18T19:24:57.545597+0000","last_clean":"2023-11-18T19:24:57.545597+0000","last_became_active":"2023-11-18T19:06:37.574752+0000","last_became_peered":"2023-11-18T19:06:37.574752+0000","last_unstale":"2023-11-18T19:24:57.545597+0000","last_undegraded":"2023-11-18T19:24:57.545597+0000","last_fullsized":"2023-11-18T19:24:57.545597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1668","last_scrub_stamp":"2023-11-18T19:24:57.545516+0000","last_deep_scrub":"29'1668","last_deep_scrub_stamp":"2023-11-18T19:24:57.545516+0000","last_clean_scrub_stamp":"2023-11-18T19:24:57.545516+0000","objects_scrubbed":730,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T00:08:03.673346+0000","scrub_duration":1.09599454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":730,"num_object_clones":0,"num_object_copies":1460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'1655","reported_seq":1718,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.314040+0000","last_change":"2023-11-18T19:24:41.314085+0000","last_active":"2023-11-18T19:24:41.314040+0000","last_peered":"2023-11-18T19:24:41.314040+0000","last_clean":"2023-11-18T19:24:41.314040+0000","last_became_active":"2023-11-18T19:06:37.575987+0000","last_became_peered":"2023-11-18T19:06:37.575987+0000","last_unstale":"2023-11-18T19:24:41.314040+0000","last_undegraded":"2023-11-18T19:24:41.314040+0000","last_fullsized":"2023-11-18T19:24:41.314040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1655","last_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_deep_scrub":"29'1655","last_deep_scrub_stamp":"2023-11-18T19:24:41.313951+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.313951+0000","objects_scrubbed":761,"log_size":1655,"log_dups_size":0,"ondisk_log_size":1655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:40:17.258394+0000","scrub_duration":0.75370882100000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":761,"num_object_clones":0,"num_object_copies":1522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'1674","reported_seq":1735,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:55.192667+0000","last_change":"2023-11-18T19:24:55.192727+0000","last_active":"2023-11-18T19:24:55.192667+0000","last_peered":"2023-11-18T19:24:55.192667+0000","last_clean":"2023-11-18T19:24:55.192667+0000","last_became_active":"2023-11-18T19:06:37.567692+0000","last_became_peered":"2023-11-18T19:06:37.567692+0000","last_unstale":"2023-11-18T19:24:55.192667+0000","last_undegraded":"2023-11-18T19:24:55.192667+0000","last_fullsized":"2023-11-18T19:24:55.192667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1674","last_scrub_stamp":"2023-11-18T19:24:55.192587+0000","last_deep_scrub":"29'1674","last_deep_scrub_stamp":"2023-11-18T19:24:55.192587+0000","last_clean_scrub_stamp":"2023-11-18T19:24:55.192587+0000","objects_scrubbed":741,"log_size":1674,"log_dups_size":0,"ondisk_log_size":1674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:25:27.828033+0000","scrub_duration":0.638862241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":741,"num_object_clones":0,"num_object_copies":1482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'1710","reported_seq":1772,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.315963+0000","last_change":"2023-11-18T19:25:03.315984+0000","last_active":"2023-11-18T19:25:03.315963+0000","last_peered":"2023-11-18T19:25:03.315963+0000","last_clean":"2023-11-18T19:25:03.315963+0000","last_became_active":"2023-11-18T19:06:37.583696+0000","last_became_peered":"2023-11-18T19:06:37.583696+0000","last_unstale":"2023-11-18T19:25:03.315963+0000","last_undegraded":"2023-11-18T19:25:03.315963+0000","last_fullsized":"2023-11-18T19:25:03.315963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1710","last_scrub_stamp":"2023-11-18T19:25:03.315896+0000","last_deep_scrub":"29'1710","last_deep_scrub_stamp":"2023-11-18T19:25:03.315896+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.315896+0000","objects_scrubbed":750,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:45.396635+0000","scrub_duration":0.69759861199999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":750,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'1680","reported_seq":1741,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:04.425442+0000","last_change":"2023-11-18T19:25:04.425501+0000","last_active":"2023-11-18T19:25:04.425442+0000","last_peered":"2023-11-18T19:25:04.425442+0000","last_clean":"2023-11-18T19:25:04.425442+0000","last_became_active":"2023-11-18T19:06:37.568316+0000","last_became_peered":"2023-11-18T19:06:37.568316+0000","last_unstale":"2023-11-18T19:25:04.425442+0000","last_undegraded":"2023-11-18T19:25:04.425442+0000","last_fullsized":"2023-11-18T19:25:04.425442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1680","last_scrub_stamp":"2023-11-18T19:25:04.425376+0000","last_deep_scrub":"29'1680","last_deep_scrub_stamp":"2023-11-18T19:25:04.425376+0000","last_clean_scrub_stamp":"2023-11-18T19:25:04.425376+0000","objects_scrubbed":738,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T03:13:57.867038+0000","scrub_duration":0.76522294899999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":738,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'1755","reported_seq":1819,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:53.062243+0000","last_change":"2023-11-18T19:24:53.062289+0000","last_active":"2023-11-18T19:24:53.062243+0000","last_peered":"2023-11-18T19:24:53.062243+0000","last_clean":"2023-11-18T19:24:53.062243+0000","last_became_active":"2023-11-18T19:06:37.586598+0000","last_became_peered":"2023-11-18T19:06:37.586598+0000","last_unstale":"2023-11-18T19:24:53.062243+0000","last_undegraded":"2023-11-18T19:24:53.062243+0000","last_fullsized":"2023-11-18T19:24:53.062243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1755","last_scrub_stamp":"2023-11-18T19:24:53.062146+0000","last_deep_scrub":"29'1755","last_deep_scrub_stamp":"2023-11-18T19:24:53.062146+0000","last_clean_scrub_stamp":"2023-11-18T19:24:53.062146+0000","objects_scrubbed":779,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:16.991355+0000","scrub_duration":0.76329819099999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":779,"num_object_clones":0,"num_object_copies":1558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'1609","reported_seq":1670,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:41.191904+0000","last_change":"2023-11-18T19:24:41.191959+0000","last_active":"2023-11-18T19:24:41.191904+0000","last_peered":"2023-11-18T19:24:41.191904+0000","last_clean":"2023-11-18T19:24:41.191904+0000","last_became_active":"2023-11-18T19:06:37.572789+0000","last_became_peered":"2023-11-18T19:06:37.572789+0000","last_unstale":"2023-11-18T19:24:41.191904+0000","last_undegraded":"2023-11-18T19:24:41.191904+0000","last_fullsized":"2023-11-18T19:24:41.191904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1609","last_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_deep_scrub":"29'1609","last_deep_scrub_stamp":"2023-11-18T19:24:41.191821+0000","last_clean_scrub_stamp":"2023-11-18T19:24:41.191821+0000","objects_scrubbed":748,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T20:04:18.742555+0000","scrub_duration":0.72283178699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":748,"num_object_clones":0,"num_object_copies":1496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'1660","reported_seq":1722,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:34.717494+0000","last_change":"2023-11-18T19:24:34.717527+0000","last_active":"2023-11-18T19:24:34.717494+0000","last_peered":"2023-11-18T19:24:34.717494+0000","last_clean":"2023-11-18T19:24:34.717494+0000","last_became_active":"2023-11-18T19:06:37.567319+0000","last_became_peered":"2023-11-18T19:06:37.567319+0000","last_unstale":"2023-11-18T19:24:34.717494+0000","last_undegraded":"2023-11-18T19:24:34.717494+0000","last_fullsized":"2023-11-18T19:24:34.717494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1660","last_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_deep_scrub":"29'1660","last_deep_scrub_stamp":"2023-11-18T19:24:34.717426+0000","last_clean_scrub_stamp":"2023-11-18T19:24:34.717426+0000","objects_scrubbed":755,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T05:38:09.869959+0000","scrub_duration":1.054464544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":755,"num_object_clones":0,"num_object_copies":1510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'1550","reported_seq":1610,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:40.576796+0000","last_change":"2023-11-18T19:24:40.576837+0000","last_active":"2023-11-18T19:24:40.576796+0000","last_peered":"2023-11-18T19:24:40.576796+0000","last_clean":"2023-11-18T19:24:40.576796+0000","last_became_active":"2023-11-18T19:06:37.560798+0000","last_became_peered":"2023-11-18T19:06:37.560798+0000","last_unstale":"2023-11-18T19:24:40.576796+0000","last_undegraded":"2023-11-18T19:24:40.576796+0000","last_fullsized":"2023-11-18T19:24:40.576796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1550","last_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_deep_scrub":"29'1550","last_deep_scrub_stamp":"2023-11-18T19:24:40.576715+0000","last_clean_scrub_stamp":"2023-11-18T19:24:40.576715+0000","objects_scrubbed":702,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:36:35.709244+0000","scrub_duration":0.96416932899999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":702,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'1788","reported_seq":1851,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:54.428070+0000","last_change":"2023-11-18T19:24:54.428126+0000","last_active":"2023-11-18T19:24:54.428070+0000","last_peered":"2023-11-18T19:24:54.428070+0000","last_clean":"2023-11-18T19:24:54.428070+0000","last_became_active":"2023-11-18T19:06:37.568940+0000","last_became_peered":"2023-11-18T19:06:37.568940+0000","last_unstale":"2023-11-18T19:24:54.428070+0000","last_undegraded":"2023-11-18T19:24:54.428070+0000","last_fullsized":"2023-11-18T19:24:54.428070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1788","last_scrub_stamp":"2023-11-18T19:24:54.427981+0000","last_deep_scrub":"29'1788","last_deep_scrub_stamp":"2023-11-18T19:24:54.427981+0000","last_clean_scrub_stamp":"2023-11-18T19:24:54.427981+0000","objects_scrubbed":782,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T06:20:35.216202+0000","scrub_duration":0.90968989499999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":782,"num_object_clones":0,"num_object_copies":1564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'1642","reported_seq":1705,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:32.764155+0000","last_change":"2023-11-18T19:24:32.764235+0000","last_active":"2023-11-18T19:24:32.764155+0000","last_peered":"2023-11-18T19:24:32.764155+0000","last_clean":"2023-11-18T19:24:32.764155+0000","last_became_active":"2023-11-18T19:06:37.557657+0000","last_became_peered":"2023-11-18T19:06:37.557657+0000","last_unstale":"2023-11-18T19:24:32.764155+0000","last_undegraded":"2023-11-18T19:24:32.764155+0000","last_fullsized":"2023-11-18T19:24:32.764155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1642","last_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_deep_scrub":"29'1642","last_deep_scrub_stamp":"2023-11-18T19:24:32.764034+0000","last_clean_scrub_stamp":"2023-11-18T19:24:32.764034+0000","objects_scrubbed":744,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T23:09:02.008162+0000","scrub_duration":1.1096721409999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":744,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'1732","reported_seq":1797,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:24:36.250918+0000","last_change":"2023-11-18T19:24:36.250918+0000","last_active":"2023-11-18T19:24:36.250918+0000","last_peered":"2023-11-18T19:24:36.250918+0000","last_clean":"2023-11-18T19:24:36.250918+0000","last_became_active":"2023-11-18T19:06:37.572063+0000","last_became_peered":"2023-11-18T19:06:37.572063+0000","last_unstale":"2023-11-18T19:24:36.250918+0000","last_undegraded":"2023-11-18T19:24:36.250918+0000","last_fullsized":"2023-11-18T19:24:36.250918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1732","last_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_deep_scrub":"29'1732","last_deep_scrub_stamp":"2023-11-18T19:24:36.250801+0000","last_clean_scrub_stamp":"2023-11-18T19:24:36.250801+0000","objects_scrubbed":789,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T22:41:00.180010+0000","scrub_duration":0.83764093900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":789,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":789,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'1659","reported_seq":1721,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:03.184647+0000","last_change":"2023-11-18T19:25:03.184647+0000","last_active":"2023-11-18T19:25:03.184647+0000","last_peered":"2023-11-18T19:25:03.184647+0000","last_clean":"2023-11-18T19:25:03.184647+0000","last_became_active":"2023-11-18T19:06:37.578117+0000","last_became_peered":"2023-11-18T19:06:37.578117+0000","last_unstale":"2023-11-18T19:25:03.184647+0000","last_undegraded":"2023-11-18T19:25:03.184647+0000","last_fullsized":"2023-11-18T19:25:03.184647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1659","last_scrub_stamp":"2023-11-18T19:25:03.184485+0000","last_deep_scrub":"29'1659","last_deep_scrub_stamp":"2023-11-18T19:25:03.184485+0000","last_clean_scrub_stamp":"2023-11-18T19:25:03.184485+0000","objects_scrubbed":718,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-19T21:59:45.265223+0000","scrub_duration":0.698566562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":718,"num_object_clones":0,"num_object_copies":1436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'1612","reported_seq":1673,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-18T19:25:14.456504+0000","last_change":"2023-11-18T19:25:14.456504+0000","last_active":"2023-11-18T19:25:14.456504+0000","last_peered":"2023-11-18T19:25:14.456504+0000","last_clean":"2023-11-18T19:25:14.456504+0000","last_became_active":"2023-11-18T19:06:37.582952+0000","last_became_peered":"2023-11-18T19:06:37.582952+0000","last_unstale":"2023-11-18T19:25:14.456504+0000","last_undegraded":"2023-11-18T19:25:14.456504+0000","last_fullsized":"2023-11-18T19:25:14.456504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1612","last_scrub_stamp":"2023-11-18T19:25:14.456375+0000","last_deep_scrub":"29'1612","last_deep_scrub_stamp":"2023-11-18T19:25:14.456375+0000","last_clean_scrub_stamp":"2023-11-18T19:25:14.456375+0000","objects_scrubbed":694,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-20T01:13:21.472322+0000","scrub_duration":0.68011604699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":694,"num_object_clones":0,"num_object_copies":1388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1532356433,"num_objects":72339,"num_object_clones":0,"num_object_copies":289356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72339,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":196167,"num_write_kb":1689992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2809622528,"data_stored":3820519424,"data_compressed":666760082,"data_compressed_allocated":793534464,"data_compressed_original":1804431360,"omap_allocated":0,"internal_metadata":0},"log_size":145913,"ondisk_log_size":145913,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":48368,"num_object_clones":0,"num_object_copies":96736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51796,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108469,"ondisk_log_size":108469,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":252317078,"num_objects":3097,"num_object_clones":0,"num_object_copies":6194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3097,"num_whiteouts":0,"num_read":864,"num_read_kb":1816,"num_write":23621,"num_write_kb":732017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3029,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30352898,"num_omap_keys":52444,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133529600,"data_stored":504634156,"data_compressed":78941764,"data_compressed_allocated":97574912,"data_compressed_original":468738048,"omap_allocated":0,"internal_metadata":0},"log_size":20216,"ondisk_log_size":20216,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65026,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509673,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":647720,"kb_used_data":373600,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93724120,"statfs":{"total":96636764160,"available":95973498880,"internally_reserved":0,"allocated":382566400,"data_stored":576987954,"data_compressed":102256610,"data_compressed_allocated":122839040,"data_compressed_original":317444096,"omap_allocated":1594,"internal_metadata":280689094},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":4.3849999999999998,"15min":4.827},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.372},"max":{"1min":3.629,"5min":248.00800000000001,"15min":248.00800000000001},"last":1.052},{"interface":"front","average":{"1min":2.5150000000000001,"5min":4.8040000000000003,"15min":5.1310000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":36.765000000000001,"5min":175.095,"15min":384.19499999999999},"last":1.484}]},{"osd":1,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":2.012,"5min":2.6539999999999999,"15min":4.1429999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.47099999999999997},"max":{"1min":17.283000000000001,"5min":53.398000000000003,"15min":199.179},"last":1.522},{"interface":"front","average":{"1min":2.7090000000000001,"5min":4.891,"15min":5.3810000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":36.957999999999998,"5min":175.06800000000001,"15min":384.09699999999998},"last":0.97899999999999998}]},{"osd":2,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.7689999999999999,"15min":3.2519999999999998},"min":{"1min":0.46800000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3999999999999999,"5min":14.175000000000001,"15min":207.149},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.452,"5min":2.5569999999999999,"15min":5.5},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.47299999999999998},"max":{"1min":3.7149999999999999,"5min":50.716000000000001,"15min":300.42500000000001},"last":1.429}]},{"osd":3,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":2.766,"5min":4.9169999999999998,"15min":5.7839999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":36.813000000000002,"5min":175.02600000000001,"15min":384.04700000000003},"last":1.3340000000000001},{"interface":"front","average":{"1min":2.9100000000000001,"5min":2.649,"15min":3.5129999999999999},"min":{"1min":0.497,"5min":0.47699999999999998,"15min":0.44400000000000001},"max":{"1min":40.716000000000001,"5min":51.158999999999999,"15min":206.98099999999999},"last":1.1970000000000001}]},{"osd":4,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":3.0259999999999998,"15min":5.0039999999999996},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.38100000000000001},"max":{"1min":4.4569999999999999,"5min":86.346999999999994,"15min":199.393},"last":1.2769999999999999},{"interface":"front","average":{"1min":2.8450000000000002,"5min":5.6020000000000003,"15min":6.649},"min":{"1min":0.56100000000000005,"5min":0.47799999999999998,"15min":0.34399999999999997},"max":{"1min":36.926000000000002,"5min":204.786,"15min":384.161},"last":1.5660000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":3.0339999999999998,"15min":4.4459999999999997},"min":{"1min":0.54100000000000004,"5min":0.41899999999999998,"15min":0.40799999999999997},"max":{"1min":5.5970000000000004,"5min":79.472999999999999,"15min":220.36500000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":3.9540000000000002,"5min":5.4160000000000004,"15min":5.7309999999999999},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.42699999999999999},"max":{"1min":48.290999999999997,"5min":160.107,"15min":212.68100000000001},"last":1.631}]},{"osd":7,"last update":"Sat Nov 18 19:25:02 2023","interfaces":[{"interface":"back","average":{"1min":3.0640000000000001,"5min":5.4130000000000003,"15min":9.0169999999999995},"min":{"1min":0.59999999999999998,"5min":0.52300000000000002,"15min":0.51900000000000002},"max":{"1min":36.984999999999999,"5min":205.01400000000001,"15min":410.60000000000002},"last":1.1399999999999999},{"interface":"front","average":{"1min":2.2709999999999999,"5min":2.6760000000000002,"15min":4.069},"min":{"1min":0.52500000000000002,"5min":0.49399999999999999,"15min":0.45400000000000001},"max":{"1min":19.361999999999998,"5min":28.329999999999998,"15min":207.85300000000001},"last":1.3080000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509674,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":612080,"kb_used_data":328232,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93759760,"statfs":{"total":96636764160,"available":96009994240,"internally_reserved":0,"allocated":336109568,"data_stored":505605510,"data_compressed":82941676,"data_compressed_allocated":99913728,"data_compressed_original":269606912,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":2.0310000000000001,"15min":4.3639999999999999},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.373},"max":{"1min":56.268000000000001,"5min":56.268000000000001,"15min":248.32400000000001},"last":1.9339999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.3640000000000001,"15min":2.7869999999999999},"min":{"1min":0.54400000000000004,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.4369999999999998,"5min":8.7650000000000006,"15min":93.090999999999994},"last":1.236}]},{"osd":1,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.677,"15min":5.3970000000000002},"min":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.47899999999999998},"max":{"1min":10.644,"5min":14.673999999999999,"15min":335.11799999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":3.948,"5min":2.3490000000000002,"15min":4.1020000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.432},"max":{"1min":56.345999999999997,"5min":56.345999999999997,"15min":278.17700000000002},"last":1.397}]},{"osd":2,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.0899999999999999,"15min":3.6110000000000002},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":26.256,"5min":36.954999999999998,"15min":144.68700000000001},"last":1.601},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.774,"15min":3.738},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.52800000000000002},"max":{"1min":10.755000000000001,"5min":14.731999999999999,"15min":247.267},"last":1.633}]},{"osd":3,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.714,"15min":4.8310000000000004},"min":{"1min":0.61599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":10.880000000000001,"5min":12.032,"15min":207.93799999999999},"last":1.696},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.869,"15min":4.5540000000000003},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.53300000000000003},"max":{"1min":10.718999999999999,"5min":14.769,"15min":265.82600000000002},"last":1.7709999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.911,"5min":2.391,"15min":4.75},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42199999999999999},"max":{"1min":55.738999999999997,"5min":55.738999999999997,"15min":303.19200000000001},"last":2.0680000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.71,"15min":4.6909999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2960000000000003,"5min":12.207000000000001,"15min":210.78899999999999},"last":1.845}]},{"osd":6,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":2.2709999999999999,"15min":6.6790000000000003},"min":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":10.686999999999999,"5min":41.378,"15min":308.47500000000002},"last":1.895},{"interface":"front","average":{"1min":4.0529999999999999,"5min":2.577,"15min":4.2599999999999998},"min":{"1min":0.49299999999999999,"5min":0.48399999999999999,"15min":0.34000000000000002},"max":{"1min":56.228999999999999,"5min":56.228999999999999,"15min":303.23599999999999},"last":2.1360000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":2.2610000000000001,"15min":5.2809999999999997},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.41199999999999998},"max":{"1min":13.352,"5min":19.742000000000001,"15min":252.18299999999999},"last":2.0179999999999998},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.0249999999999999,"15min":4.8789999999999996},"min":{"1min":0.56000000000000005,"5min":0.51300000000000001,"15min":0.437},"max":{"1min":19.734999999999999,"5min":19.734999999999999,"15min":309.029},"last":1.986}]}]},{"osd":4,"up_from":15,"seq":64424509674,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582188,"kb_used_data":321956,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":93789652,"statfs":{"total":96636764160,"available":96040603648,"internally_reserved":0,"allocated":329682944,"data_stored":506103922,"data_compressed":93249446,"data_compressed_allocated":112369664,"data_compressed_original":288989184,"omap_allocated":1592,"internal_metadata":266467784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":3.1030000000000002,"15min":2.657},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.32300000000000001},"max":{"1min":23.077999999999999,"5min":51.582999999999998,"15min":58.200000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":2.3109999999999999,"15min":2.3490000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.4510000000000001,"5min":56.402999999999999,"15min":56.402999999999999},"last":1.1870000000000001}]},{"osd":1,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.9470000000000001,"5min":2.302,"15min":2.3260000000000001},"min":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.38},"max":{"1min":25.114999999999998,"5min":27.18,"15min":36.024999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":2.23,"5min":3.3540000000000001,"15min":2.7949999999999999},"min":{"1min":0.72399999999999998,"5min":0.495,"15min":0.36399999999999999},"max":{"1min":22.565999999999999,"5min":51.542999999999999,"15min":53.353999999999999},"last":1.4690000000000001}]},{"osd":2,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":2.669,"15min":2.633},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.42299999999999999},"max":{"1min":16.777000000000001,"5min":56.494,"15min":56.494},"last":0.81100000000000005},{"interface":"front","average":{"1min":4.1509999999999998,"5min":2.9129999999999998,"15min":2.7810000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":52.454000000000001,"5min":52.454000000000001,"15min":52.454000000000001},"last":1.101}]},{"osd":3,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":3.0659999999999998,"15min":2.9329999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.40100000000000002},"max":{"1min":3.7599999999999998,"5min":51.643000000000001,"15min":58.039999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.214,"5min":2.5910000000000002,"15min":2.75},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.46500000000000002},"max":{"1min":2.734,"5min":56.530999999999999,"15min":56.530999999999999},"last":1.427}]},{"osd":5,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.9079999999999999,"5min":4.1920000000000002,"15min":3.8039999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33200000000000002},"max":{"1min":46.289999999999999,"5min":68.007000000000005,"15min":68.007000000000005},"last":1.236},{"interface":"front","average":{"1min":2.4990000000000001,"5min":4.2190000000000003,"15min":3.9049999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":34.197000000000003,"5min":72.611000000000004,"15min":72.611000000000004},"last":1.397}]},{"osd":6,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":3.5409999999999999,"5min":4.3159999999999998,"15min":4.0389999999999997},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":59.960999999999999,"5min":72.915999999999997,"15min":161.898},"last":1.2889999999999999},{"interface":"front","average":{"1min":3.9079999999999999,"5min":5.9870000000000001,"15min":4.859},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.40100000000000002},"max":{"1min":45.710000000000001,"5min":105.387,"15min":163.33600000000001},"last":1.4990000000000001}]},{"osd":7,"last update":"Sat Nov 18 19:25:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":4.0970000000000004,"15min":4.181},"min":{"1min":0.58899999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":22.099,"5min":66.341999999999999,"15min":66.341999999999999},"last":1.524},{"interface":"front","average":{"1min":1.915,"5min":3.484,"15min":4.1050000000000004},"min":{"1min":0.629,"5min":0.435,"15min":0.435},"max":{"1min":16.263000000000002,"5min":56.454000000000001,"15min":66.665000000000006},"last":1.5449999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509675,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":746352,"kb_used_data":422312,"kb_used_omap":1,"kb_used_meta":324030,"kb_avail":93625488,"statfs":{"total":96636764160,"available":95872499712,"internally_reserved":0,"allocated":432447488,"data_stored":638154104,"data_compressed":111010512,"data_compressed_allocated":131817472,"data_compressed_original":337711104,"omap_allocated":1593,"internal_metadata":331807175},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":1.163,"15min":1.27},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":17.715,"5min":17.715,"15min":44.363},"last":0.68799999999999994},{"interface":"front","average":{"1min":5.4930000000000003,"5min":2.3170000000000002,"15min":2.278},"min":{"1min":0.38800000000000001,"5min":0.28899999999999998,"15min":0.27600000000000002},"max":{"1min":75.558000000000007,"5min":75.558000000000007,"15min":75.558000000000007},"last":1.117}]},{"osd":1,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":9.0980000000000008,"5min":3.0009999999999999,"15min":3.718},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.26900000000000002},"max":{"1min":145.65000000000001,"5min":145.65000000000001,"15min":202.65000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":6.2130000000000001,"5min":2.4449999999999998,"15min":2.9020000000000001},"min":{"1min":0.44500000000000001,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":75.587000000000003,"5min":75.587000000000003,"15min":114.221},"last":0.97299999999999998}]},{"osd":2,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":2.8359999999999999,"5min":1.6699999999999999,"15min":1.706},"min":{"1min":0.504,"5min":0.38400000000000001,"15min":0.318},"max":{"1min":28.433,"5min":28.433,"15min":43.747999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":5.7069999999999999,"5min":2.4910000000000001,"15min":2.6869999999999998},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.35099999999999998},"max":{"1min":75.483999999999995,"5min":75.483999999999995,"15min":75.483999999999995},"last":1.5760000000000001}]},{"osd":4,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":3.0649999999999999,"15min":4.6760000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.48799999999999999},"max":{"1min":89.465000000000003,"5min":89.465000000000003,"15min":202.821},"last":1.224},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.8320000000000001,"15min":3.2909999999999999},"min":{"1min":0.84399999999999997,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":8.0380000000000003,"5min":23.635000000000002,"15min":234.68700000000001},"last":1.1819999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":4.5199999999999996,"5min":3.4620000000000002,"15min":4.5709999999999997},"min":{"1min":0.52400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":48.381,"5min":57.360999999999997,"15min":190.827},"last":1.304},{"interface":"front","average":{"1min":17.562000000000001,"5min":6.3959999999999999,"15min":5.8079999999999998},"min":{"1min":0.66300000000000003,"5min":0.58199999999999996,"15min":0.56399999999999995},"max":{"1min":275.89699999999999,"5min":275.89699999999999,"15min":275.89699999999999},"last":1.401}]},{"osd":6,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":4.218,"5min":3.5179999999999998,"15min":3.262},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.46800000000000003},"max":{"1min":39.098999999999997,"5min":89.710999999999999,"15min":89.710999999999999},"last":1.353},{"interface":"front","average":{"1min":6.9660000000000002,"5min":3.6960000000000002,"15min":4.3449999999999998},"min":{"1min":0.75,"5min":0.5,"15min":0.40000000000000002},"max":{"1min":89.509,"5min":89.509,"15min":202.78299999999999},"last":1.5189999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:25:03 2023","interfaces":[{"interface":"back","average":{"1min":6.1050000000000004,"5min":3.3799999999999999,"15min":4.5279999999999996},"min":{"1min":0.92100000000000004,"5min":0.745,"15min":0.61199999999999999},"max":{"1min":75.525000000000006,"5min":75.525000000000006,"15min":82.248000000000005},"last":1.4670000000000001},{"interface":"front","average":{"1min":7.9080000000000004,"5min":4.9080000000000004,"15min":6.5270000000000001},"min":{"1min":0.82499999999999996,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":81.777000000000001,"5min":113.44,"15min":233.44800000000001},"last":1.6240000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509675,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":608612,"kb_used_data":342812,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93763228,"statfs":{"total":96636764160,"available":96013545472,"internally_reserved":0,"allocated":351039488,"data_stored":491214290,"data_compressed":86308112,"data_compressed_allocated":101842944,"data_compressed_original":242208768,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.4630000000000001,"15min":2.0910000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":13.442,"5min":83.817999999999998,"15min":83.817999999999998},"last":0.98199999999999998},{"interface":"front","average":{"1min":4.0899999999999999,"5min":3.044,"15min":3.694},"min":{"1min":0.53500000000000003,"5min":0.36899999999999999,"15min":0.27000000000000002},"max":{"1min":37.145000000000003,"5min":83.266999999999996,"15min":248.16999999999999},"last":1.3959999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":1.9370000000000001,"15min":1.8999999999999999},"min":{"1min":0.59099999999999997,"5min":0.5,"15min":0.29899999999999999},"max":{"1min":8.2210000000000001,"5min":19.004999999999999,"15min":30.504999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":4.085,"5min":2.7229999999999999,"15min":3.5699999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":31.68,"5min":47.768999999999998,"15min":255.315},"last":1.21}]},{"osd":3,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.3250000000000002,"5min":2.5830000000000002,"15min":2.2229999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.315},"max":{"1min":35.741,"5min":35.741,"15min":84.840999999999994},"last":1.2290000000000001},{"interface":"front","average":{"1min":5.9039999999999999,"5min":3.0510000000000002,"15min":3.0939999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.36599999999999999},"max":{"1min":77.317999999999998,"5min":77.317999999999998,"15min":128.976},"last":1.669}]},{"osd":4,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.0609999999999999,"5min":3.4580000000000002,"15min":5.109},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":37.213999999999999,"5min":47.432000000000002,"15min":255.25700000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.6099999999999999,"15min":3.5790000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.48299999999999998},"max":{"1min":19.753,"5min":34.531999999999996,"15min":128.655},"last":1.4990000000000001}]},{"osd":5,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":8.9760000000000009,"5min":5.0700000000000003,"15min":5.2599999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.53300000000000003},"max":{"1min":82.197000000000003,"5min":138.905,"15min":153.417},"last":1.5589999999999999},{"interface":"front","average":{"1min":7.2789999999999999,"5min":4.5439999999999996,"15min":6.0229999999999997},"min":{"1min":0.89300000000000002,"5min":0.77100000000000002,"15min":0.53300000000000003},"max":{"1min":37.183999999999997,"5min":63.884,"15min":255.34899999999999},"last":1.046}]},{"osd":6,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4740000000000002,"5min":3.145,"15min":3.7229999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.55400000000000005},"max":{"1min":48.976999999999997,"5min":82.388999999999996,"15min":138.33099999999999},"last":1.9770000000000001},{"interface":"front","average":{"1min":7.8410000000000002,"5min":4.9880000000000004,"15min":5.4820000000000002},"min":{"1min":0.85299999999999998,"5min":0.85099999999999998,"15min":0.61199999999999999},"max":{"1min":90.509,"5min":127.44799999999999,"15min":187.29599999999999},"last":1.778}]},{"osd":7,"last update":"Sat Nov 18 19:25:04 2023","interfaces":[{"interface":"back","average":{"1min":6.2919999999999998,"5min":5.0869999999999997,"15min":6.673},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.60899999999999999},"max":{"1min":34.777000000000001,"5min":81.165999999999997,"15min":211.17500000000001},"last":1.472},{"interface":"front","average":{"1min":5.6689999999999996,"5min":4.0910000000000002,"15min":5.0110000000000001},"min":{"1min":0.80300000000000005,"5min":0.745,"15min":0.58199999999999996},"max":{"1min":49.033999999999999,"5min":72.992999999999995,"15min":173.53999999999999},"last":2.0590000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509676,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":727056,"kb_used_data":421000,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":93644784,"statfs":{"total":96636764160,"available":95892258816,"internally_reserved":0,"allocated":431104000,"data_stored":617784728,"data_compressed":106231679,"data_compressed_allocated":127287296,"data_compressed_original":314159104,"omap_allocated":1595,"internal_metadata":313391557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.5860000000000001,"15min":1.49},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.22500000000000001},"max":{"1min":1.613,"5min":21.655999999999999,"15min":51.420999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.71,"15min":1.744},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.255},"max":{"1min":1.8129999999999999,"5min":22.587,"15min":48.802999999999997},"last":1.0569999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.7789999999999999,"15min":2.5750000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.308},"max":{"1min":2.6539999999999999,"5min":24.036999999999999,"15min":131.321},"last":1.107},{"interface":"front","average":{"1min":1.111,"5min":1.9359999999999999,"15min":1.6559999999999999},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.30499999999999999},"max":{"1min":1.7649999999999999,"5min":26.029,"15min":26.029},"last":1.5369999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":2.2280000000000002,"15min":2.7050000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.26700000000000002},"max":{"1min":1.8899999999999999,"5min":43.832999999999998,"15min":197.43899999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.45,"5min":2.4140000000000001,"15min":2.5600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.32100000000000001},"max":{"1min":6.0140000000000002,"5min":54.316000000000003,"15min":156.316},"last":0.97999999999999998}]},{"osd":4,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9790000000000001,"5min":2.4199999999999999,"15min":3.4580000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.44800000000000001},"max":{"1min":32.771999999999998,"5min":48.799999999999997,"15min":159.84299999999999},"last":1.244},{"interface":"front","average":{"1min":2.024,"5min":2.5990000000000002,"15min":3.198},"min":{"1min":0.629,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":12.879,"5min":28.405999999999999,"15min":62.978999999999999},"last":1.7569999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":3.504,"15min":3.3660000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.3090000000000002,"5min":107.88500000000001,"15min":107.88500000000001},"last":1.466},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.3050000000000002,"15min":3.1309999999999998},"min":{"1min":0.65400000000000003,"5min":0.52700000000000002,"15min":0.432},"max":{"1min":2.2200000000000002,"5min":19.553999999999998,"15min":133.685},"last":1.419}]},{"osd":6,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":2.8450000000000002,"15min":3.613},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.3180000000000001,"5min":54.220999999999997,"15min":142.84100000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.589,"5min":2.0899999999999999,"15min":3.734},"min":{"1min":0.82899999999999996,"5min":0.69299999999999995,"15min":0.53100000000000003},"max":{"1min":5.4800000000000004,"5min":23.998999999999999,"15min":146.69900000000001},"last":1.5009999999999999}]},{"osd":7,"last update":"Sat Nov 18 19:25:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":2.4889999999999999,"15min":2.7320000000000002},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.56299999999999994},"max":{"1min":2.117,"5min":31.096,"15min":35.783999999999999},"last":2.1240000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":3.1589999999999998,"15min":3.3769999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.2519999999999998,"5min":34.281999999999996,"15min":57.134999999999998},"last":1.3169999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509677,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":499980,"kb_used_data":248132,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93871860,"statfs":{"total":96636764160,"available":96124784640,"internally_reserved":0,"allocated":254087168,"data_stored":412922730,"data_compressed":68731359,"data_compressed_allocated":83857408,"data_compressed_original":242884608,"omap_allocated":1594,"internal_metadata":257882566},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.946,"15min":1.8220000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.21099999999999999},"max":{"1min":7.2350000000000003,"5min":30.565000000000001,"15min":74.326999999999998},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.272,"5min":2.1659999999999999,"15min":1.6379999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25700000000000001},"max":{"1min":7.0759999999999996,"5min":33.957999999999998,"15min":43.518000000000001},"last":1.3919999999999999}]},{"osd":2,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":4.3739999999999997,"15min":2.375},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":12.465,"5min":181.27099999999999,"15min":181.27099999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.718,"5min":2.4740000000000002,"15min":1.8959999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.24099999999999999},"max":{"1min":8.3260000000000005,"5min":41.810000000000002,"15min":46.984999999999999},"last":1.5049999999999999}]},{"osd":3,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":2.3769999999999998,"15min":1.865},"min":{"1min":0.433,"5min":0.379,"15min":0.28399999999999997},"max":{"1min":9.2149999999999999,"5min":31.562000000000001,"15min":36.642000000000003},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":3.8780000000000001,"15min":2.5939999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.28799999999999998},"max":{"1min":6.1239999999999997,"5min":94.373000000000005,"15min":94.373000000000005},"last":1.0449999999999999}]},{"osd":4,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":3.194,"5min":4.3159999999999998,"15min":3.4660000000000002},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":24.327000000000002,"5min":135.547,"15min":135.547},"last":1.6100000000000001},{"interface":"front","average":{"1min":3.2210000000000001,"5min":4.0640000000000001,"15min":3.488},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.379},"max":{"1min":25.25,"5min":131.07599999999999,"15min":131.07599999999999},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":3.6099999999999999,"5min":3.3599999999999999,"15min":2.8500000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.38700000000000001},"max":{"1min":44.682000000000002,"5min":63.134999999999998,"15min":63.134999999999998},"last":1.167},{"interface":"front","average":{"1min":3.375,"5min":3.5819999999999999,"15min":2.9470000000000001},"min":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":41.917999999999999,"5min":63.185000000000002,"15min":63.185000000000002},"last":1.6839999999999999}]},{"osd":6,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":2.7909999999999999,"15min":3.6389999999999998},"min":{"1min":0.60499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":9.2720000000000002,"5min":105.974,"15min":203.92699999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":2.3410000000000002,"5min":4.0039999999999996,"15min":3.8919999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.42899999999999999},"max":{"1min":14.525,"5min":160.84700000000001,"15min":203.56899999999999},"last":1.327}]},{"osd":7,"last update":"Sat Nov 18 19:25:06 2023","interfaces":[{"interface":"back","average":{"1min":1.994,"5min":4.3250000000000002,"15min":3.113},"min":{"1min":0.66600000000000004,"5min":0.55100000000000005,"15min":0.45500000000000002},"max":{"1min":8.5739999999999998,"5min":91.418000000000006,"15min":91.418000000000006},"last":1.748},{"interface":"front","average":{"1min":4.4219999999999997,"5min":4.359,"15min":3.2389999999999999},"min":{"1min":0.68799999999999994,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":56.298000000000002,"5min":68.608000000000004,"15min":68.608000000000004},"last":1.2250000000000001}]}]},{"osd":7,"up_from":13,"seq":55834575082,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":706664,"kb_used_data":418656,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93665176,"statfs":{"total":96636764160,"available":95913140224,"internally_reserved":0,"allocated":428703744,"data_stored":578550662,"data_compressed":95037478,"data_compressed_allocated":111271936,"data_compressed_original":261312512,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":3.395,"15min":4.492},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":8.0329999999999995,"5min":69.191999999999993,"15min":221.768},"last":1.349},{"interface":"front","average":{"1min":3.0720000000000001,"5min":3.4830000000000001,"15min":3.4430000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":36.235999999999997,"5min":63.854999999999997,"15min":93.781000000000006},"last":1.4099999999999999}]},{"osd":1,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":3.512,"15min":4.3929999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.374},"max":{"1min":6.0030000000000001,"5min":69.061999999999998,"15min":221.715},"last":0.82699999999999996},{"interface":"front","average":{"1min":3.2509999999999999,"5min":3.605,"15min":3.5329999999999999},"min":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.46400000000000002},"max":{"1min":36.430999999999997,"5min":67.930999999999997,"15min":93.825000000000003},"last":1.556}]},{"osd":2,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":2.0339999999999998,"15min":4.4420000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":33.426000000000002,"5min":33.426000000000002,"15min":189.01400000000001},"last":1.105},{"interface":"front","average":{"1min":2.1739999999999999,"5min":3.6739999999999999,"15min":4.657},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":21.09,"5min":69.156999999999996,"15min":221.80600000000001},"last":1.6140000000000001}]},{"osd":3,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3,"5min":3.1019999999999999,"15min":4.6059999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":33.384,"5min":64.206000000000003,"15min":198.696},"last":0.98499999999999999},{"interface":"front","average":{"1min":2.4180000000000001,"5min":3.7480000000000002,"15min":5.3849999999999998},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.47399999999999998},"max":{"1min":20.509,"5min":69.585999999999999,"15min":221.846},"last":1.4730000000000001}]},{"osd":4,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3.2570000000000001,"5min":3.7829999999999999,"15min":5.1799999999999997},"min":{"1min":0.69799999999999995,"5min":0.434,"15min":0.434},"max":{"1min":36.402999999999999,"5min":63.634,"15min":245.36000000000001},"last":1.6599999999999999},{"interface":"front","average":{"1min":3.085,"5min":3.0510000000000002,"15min":4.8230000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":33.098999999999997,"5min":43.292000000000002,"15min":190.40799999999999},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":5.9470000000000001,"5min":5.1529999999999996,"15min":6.6909999999999998},"min":{"1min":0.47899999999999998,"5min":0.46300000000000002,"15min":0.42599999999999999},"max":{"1min":78.998999999999995,"5min":78.998999999999995,"15min":222.85499999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":3.4449999999999998,"5min":4.5010000000000003,"15min":6.3070000000000004},"min":{"1min":0.60999999999999999,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":36.344000000000001,"5min":83.078000000000003,"15min":215.16900000000001},"last":1.7330000000000001}]},{"osd":6,"last update":"Sat Nov 18 19:25:09 2023","interfaces":[{"interface":"back","average":{"1min":3.5489999999999999,"5min":4.1929999999999996,"15min":5.1210000000000004},"min":{"1min":0.66100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":36.374000000000002,"5min":68.109999999999999,"15min":94.079999999999998},"last":1.7889999999999999},{"interface":"front","average":{"1min":3.169,"5min":3.887,"15min":5.1269999999999998},"min":{"1min":0.505,"5min":0.496,"15min":0.40100000000000002},"max":{"1min":32.619999999999997,"5min":63.673000000000002,"15min":188.935},"last":1.3740000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32513,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080440,"data_compressed":14029799,"data_compressed_allocated":17076224,"data_compressed_original":84856832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16019456,"data_stored":58720326,"data_compressed":9168208,"data_compressed_allocated":11268096,"data_compressed_original":53972992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6418432,"data_stored":25166496,"data_compressed":3903195,"data_compressed_allocated":4784128,"data_compressed_original":23539712,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23023616,"data_stored":88080966,"data_compressed":13869465,"data_compressed_allocated":16965632,"data_compressed_original":82026496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":54527296,"data_compressed":8437806,"data_compressed_allocated":10407936,"data_compressed_original":49823744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22880256,"data_stored":80349236,"data_compressed":12523208,"data_compressed_allocated":15749120,"data_compressed_original":73228288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":79691776,"data_compressed":12654787,"data_compressed_allocated":15716352,"data_compressed_original":74809344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9154560,"data_stored":30017620,"data_compressed":4355296,"data_compressed_allocated":5607424,"data_compressed_original":26480640,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":233472000,"data_stored":324718592,"data_compressed":54701560,"data_compressed_allocated":66781184,"data_compressed_original":158027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":414711808,"data_stored":558350336,"data_compressed":97030958,"data_compressed_allocated":115974144,"data_compressed_original":259612672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":344313856,"data_stored":465924096,"data_compressed":82404917,"data_compressed_allocated":97058816,"data_compressed_original":218669056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409116672,"data_stored":549949440,"data_compressed":97141047,"data_compressed_allocated":114851840,"data_compressed_original":255684608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":314249216,"data_stored":451452928,"data_compressed":84811640,"data_compressed_allocated":101961728,"data_compressed_original":239165440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":312856576,"data_stored":424542208,"data_compressed":70385955,"data_compressed_allocated":84119552,"data_compressed_original":195805184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":361660416,"data_stored":497172480,"data_compressed":89601823,"data_compressed_allocated":107122688,"data_compressed_original":242634752,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":419241984,"data_stored":548409344,"data_compressed":90682182,"data_compressed_allocated":105664512,"data_compressed_original":234831872,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-18T19:25:55.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-18T19:25:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.080+0000 7f0871852640 1 Processor -- start 2023-11-18T19:25:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.080+0000 7f0871852640 1 -- start start 2023-11-18T19:25:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.081+0000 7f0871852640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f086c06eea0 0x7f086c0c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.081+0000 7f0871852640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 0x7f086c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.081+0000 7f0871852640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c155ba0 con 0x7f086c0c7ef0 2023-11-18T19:25:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.081+0000 7f0871852640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0c6a50 con 0x7f086c06eea0 2023-11-18T19:25:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.081+0000 7f0871852640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c155df0 con 0x7f086c0c4ff0 2023-11-18T19:25:56.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f086bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f086c06eea0 0x7f086c0c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f086bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f086c06eea0 0x7f086c0c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53380/0 (socket says 172.21.15.45:53380) 2023-11-18T19:25:56.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f086bfff640 1 -- 172.21.15.45:0/1969557462 learned_addr learned my addr 172.21.15.45:0/1969557462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f0871051640 1 --2- 172.21.15.45:0/1969557462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 0x7f086c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f086bfff640 1 -- 172.21.15.45:0/1969557462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 msgr2=0x7f086c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f086bfff640 1 --2- 172.21.15.45:0/1969557462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 0x7f086c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f086bfff640 1 -- 172.21.15.45:0/1969557462 >> v1:172.21.15.135:6789/0 conn(0x7f086c0c7ef0 legacy=0x7f086c0c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.082+0000 7f086bfff640 1 -- 172.21.15.45:0/1969557462 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c1560d0 con 0x7f086c06eea0 2023-11-18T19:25:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.084+0000 7f086bfff640 1 --2- 172.21.15.45:0/1969557462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c0c6510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f086002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befaa92e790a8407 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.084+0000 7f086b7fe640 1 -- 172.21.15.45:0/1969557462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086002c9e0 con 0x7f086c06eea0 2023-11-18T19:25:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.084+0000 7f086b7fe640 1 -- 172.21.15.45:0/1969557462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086002cb40 con 0x7f086c06eea0 2023-11-18T19:25:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.084+0000 7f086b7fe640 1 -- 172.21.15.45:0/1969557462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600343f0 con 0x7f086c06eea0 2023-11-18T19:25:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.084+0000 7f0871852640 1 -- 172.21.15.45:0/1969557462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 msgr2=0x7f086c0c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.084+0000 7f0871852640 1 --2- 172.21.15.45:0/1969557462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c0c6510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f086002be40 comp rx=0 tx=0).stop 2023-11-18T19:25:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.085+0000 7f0871852640 1 -- 172.21.15.45:0/1969557462 shutdown_connections 2023-11-18T19:25:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.085+0000 7f0871852640 1 --2- 172.21.15.45:0/1969557462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 0x7f086c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.085+0000 7f0871852640 1 --2- 172.21.15.45:0/1969557462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c0c6510 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.085+0000 7f0871852640 1 -- 172.21.15.45:0/1969557462 >> 172.21.15.45:0/1969557462 conn(0x7f086c0661f0 msgr2=0x7f086c0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.085+0000 7f0871852640 1 -- 172.21.15.45:0/1969557462 shutdown_connections 2023-11-18T19:25:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.085+0000 7f0871852640 1 -- 172.21.15.45:0/1969557462 wait complete. 2023-11-18T19:25:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.087+0000 7f0871852640 1 Processor -- start 2023-11-18T19:25:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.087+0000 7f0871852640 1 -- start start 2023-11-18T19:25:56.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0871852640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0871852640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 0x7f086c14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0871852640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c0c7ef0 0x7f086c0a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0871852640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c152250 con 0x7f086c06eea0 2023-11-18T19:25:56.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0871852640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1509b0 con 0x7f086c0c7ef0 2023-11-18T19:25:56.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0871852640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1534b0 con 0x7f086c0c4ff0 2023-11-18T19:25:56.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0870850640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0870850640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53388/0 (socket says 172.21.15.45:53388) 2023-11-18T19:25:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0870850640 1 -- 172.21.15.45:0/2935405412 learned_addr learned my addr 172.21.15.45:0/2935405412 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0871051640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c0c7ef0 0x7f086c0a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0870850640 1 -- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 msgr2=0x7f086c14f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0870850640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 0x7f086c14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.088+0000 7f0870850640 1 -- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c0c7ef0 msgr2=0x7f086c0a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f0870850640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c0c7ef0 0x7f086c0a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f0870850640 1 -- 172.21.15.45:0/2935405412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860009b30 con 0x7f086c06eea0 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f0871051640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c0c7ef0 0x7f086c0a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f0870850640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c153990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c460 tx=0x7f085c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c012830 con 0x7f086c06eea0 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c0129d0 con 0x7f086c06eea0 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c012d80 con 0x7f086c06eea0 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c152a60 con 0x7f086c06eea0 2023-11-18T19:25:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.089+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c152780 con 0x7f086c06eea0 2023-11-18T19:25:56.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.090+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c1536b0 con 0x7f086c06eea0 2023-11-18T19:25:56.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.091+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f085c01a3b0 con 0x7f086c06eea0 2023-11-18T19:25:56.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.092+0000 7f08697fa640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f085806ae40 0x7f085806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.093+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f085c089600 con 0x7f086c06eea0 2023-11-18T19:25:56.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.093+0000 7f086bfff640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f085806ae40 0x7f085806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.093+0000 7f086bfff640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f085806ae40 0x7f085806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0860035000 tx=0x7f086002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:56.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.097+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f086c1536b0 con 0x7f086c06eea0 2023-11-18T19:25:56.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.301+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f086c153ed0 con 0x7f086c06eea0 2023-11-18T19:25:56.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.308+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f085c054350 con 0x7f086c06eea0 2023-11-18T19:25:56.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.310+0000 7f08697fa640 1 -- 172.21.15.45:0/2935405412 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f085c054350 con 0x7f086c06eea0 2023-11-18T19:25:56.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f085806ae40 msgr2=0x7f085806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f085806ae40 0x7f085806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0860035000 tx=0x7f086002e000 comp rx=0 tx=0).stop 2023-11-18T19:25:56.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 msgr2=0x7f086c153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c153990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c460 tx=0x7f085c00c920 comp rx=0 tx=0).stop 2023-11-18T19:25:56.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 shutdown_connections 2023-11-18T19:25:56.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f086c0c7ef0 0x7f086c0a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f085806ae40 0x7f085806d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f086c0c4ff0 0x7f086c14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 --2- 172.21.15.45:0/2935405412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c06eea0 0x7f086c153990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.312+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 >> 172.21.15.45:0/2935405412 conn(0x7f086c0661f0 msgr2=0x7f086c0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:56.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.314+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 shutdown_connections 2023-11-18T19:25:56.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.314+0000 7f0871852640 1 -- 172.21.15.45:0/2935405412 wait complete. 2023-11-18T19:25:56.333 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-18T19:25:56.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:25:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.553+0000 7f5f2f59e640 1 Processor -- start 2023-11-18T19:25:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.554+0000 7f5f2f59e640 1 -- start start 2023-11-18T19:25:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.555+0000 7f5f2f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300c2fb0 0x7f5f300c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.555+0000 7f5f2f59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5f30155890 0x7f5f30155d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.555+0000 7f5f2f59e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f300a5540 con 0x7f5f300722c0 2023-11-18T19:25:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.555+0000 7f5f2f59e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f30156780 con 0x7f5f30155890 2023-11-18T19:25:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.556+0000 7f5f2f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3006b9a0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.556+0000 7f5f2e59c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300c2fb0 0x7f5f300c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.556+0000 7f5f2ed9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5f30155890 0x7f5f30155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.556+0000 7f5f2ed9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5f30155890 0x7f5f30155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:47396/0 (socket says 172.21.15.45:47396) 2023-11-18T19:25:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.556+0000 7f5f2ed9d640 1 -- 172.21.15.45:0/1900121580 learned_addr learned my addr 172.21.15.45:0/1900121580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.556+0000 7f5f2e59c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300c2fb0 0x7f5f300c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:49700/0 (socket says 172.21.15.45:49700) 2023-11-18T19:25:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.557+0000 7f5f2e59c640 1 -- 172.21.15.45:0/1900121580 >> v2:172.21.15.135:3300/0 conn(0x7f5f30155890 msgr2=0x7f5f30155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.557+0000 7f5f2e59c640 1 --2- 172.21.15.45:0/1900121580 >> v2:172.21.15.135:3300/0 conn(0x7f5f30155890 0x7f5f30155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.557+0000 7f5f2e59c640 1 -- 172.21.15.45:0/1900121580 >> v1:172.21.15.135:6789/0 conn(0x7f5f300722c0 legacy=0x7f5f300a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.557+0000 7f5f2e59c640 1 -- 172.21.15.45:0/1900121580 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3006bc80 con 0x7f5f300c2fb0 2023-11-18T19:25:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.558+0000 7f5f2e59c640 1 --2- 172.21.15.45:0/1900121580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300c2fb0 0x7f5f300c39f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097a0 tx=0x7f5f2002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad45927c30148ac4 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.559+0000 7f5f2dd9b640 1 -- 172.21.15.45:0/1900121580 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200316f0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.559+0000 7f5f2dd9b640 1 -- 172.21.15.45:0/1900121580 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5f20031850 con 0x7f5f300c2fb0 2023-11-18T19:25:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.559+0000 7f5f2dd9b640 1 -- 172.21.15.45:0/1900121580 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20031c00 con 0x7f5f300c2fb0 2023-11-18T19:25:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 -- 172.21.15.45:0/1900121580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300c2fb0 msgr2=0x7f5f300c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/1900121580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300c2fb0 0x7f5f300c39f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097a0 tx=0x7f5f2002b790 comp rx=0 tx=0).stop 2023-11-18T19:25:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 -- 172.21.15.45:0/1900121580 shutdown_connections 2023-11-18T19:25:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/1900121580 >> v2:172.21.15.135:3300/0 conn(0x7f5f30155890 0x7f5f30155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/1900121580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300c2fb0 0x7f5f300c39f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 -- 172.21.15.45:0/1900121580 >> 172.21.15.45:0/1900121580 conn(0x7f5f300c5af0 msgr2=0x7f5f300c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 -- 172.21.15.45:0/1900121580 shutdown_connections 2023-11-18T19:25:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.560+0000 7f5f2f59e640 1 -- 172.21.15.45:0/1900121580 wait complete. 2023-11-18T19:25:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.562+0000 7f5f2f59e640 1 Processor -- start 2023-11-18T19:25:56.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.562+0000 7f5f2f59e640 1 -- start start 2023-11-18T19:25:56.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300722c0 0x7f5f301483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f300c2fb0 0x7f5f30152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f30155890 0x7f5f301e8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a6840 con 0x7f5f300c2fb0 2023-11-18T19:25:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2f59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a5ed0 con 0x7f5f30155890 2023-11-18T19:25:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301533a0 con 0x7f5f300722c0 2023-11-18T19:25:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f300c2fb0 0x7f5f30152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f300c2fb0 0x7f5f30152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53394/0 (socket says 172.21.15.45:53394) 2023-11-18T19:25:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f27fff640 1 -- 172.21.15.45:0/2430959378 learned_addr learned my addr 172.21.15.45:0/2430959378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2e59c640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300722c0 0x7f5f301483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f2ed9d640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f30155890 0x7f5f301e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f27fff640 1 -- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300722c0 msgr2=0x7f5f301483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f27fff640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300722c0 0x7f5f301483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.564+0000 7f5f27fff640 1 -- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f30155890 msgr2=0x7f5f301e8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f27fff640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f30155890 0x7f5f301e8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f27fff640 1 -- 172.21.15.45:0/2430959378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20009400 con 0x7f5f300c2fb0 2023-11-18T19:25:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f27fff640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f300c2fb0 0x7f5f30152870 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800c400 tx=0x7f5f1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f26ffd640 1 -- 172.21.15.45:0/2430959378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180052d0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f26ffd640 1 -- 172.21.15.45:0/2430959378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5f18005450 con 0x7f5f300c2fb0 2023-11-18T19:25:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f300a6560 con 0x7f5f300c2fb0 2023-11-18T19:25:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f26ffd640 1 -- 172.21.15.45:0/2430959378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18007280 con 0x7f5f300c2fb0 2023-11-18T19:25:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.565+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f30148930 con 0x7f5f300c2fb0 2023-11-18T19:25:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.567+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f30067fc0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.568+0000 7f5f26ffd640 1 -- 172.21.15.45:0/2430959378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f180073e0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.569+0000 7f5f26ffd640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5f1006ae70 0x7f5f1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.569+0000 7f5f26ffd640 1 -- 172.21.15.45:0/2430959378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f5f18088ce0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.569+0000 7f5f2e59c640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5f1006ae70 0x7f5f1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.570+0000 7f5f2e59c640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5f1006ae70 0x7f5f1006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f20036000 tx=0x7f5f20008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:56.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.573+0000 7f5f26ffd640 1 -- 172.21.15.45:0/2430959378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f18053ad0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.803+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f30068410 con 0x7f5f300c2fb0 2023-11-18T19:25:56.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.804+0000 7f5f26ffd640 1 -- 172.21.15.45:0/2430959378 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f5f180570f0 con 0x7f5f300c2fb0 2023-11-18T19:25:56.805 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:25:56.806 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:07:00.598223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T19:25:56.806 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-11-18T19:25:56.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5f1006ae70 msgr2=0x7f5f1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5f1006ae70 0x7f5f1006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f20036000 tx=0x7f5f20008030 comp rx=0 tx=0).stop 2023-11-18T19:25:56.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f300c2fb0 msgr2=0x7f5f30152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f300c2fb0 0x7f5f30152870 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800c400 tx=0x7f5f1800c8c0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 shutdown_connections 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f30155890 0x7f5f301e8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f300c2fb0 0x7f5f30152870 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f5f1006ae70 0x7f5f1006d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 --2- 172.21.15.45:0/2430959378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f300722c0 0x7f5f301483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 >> 172.21.15.45:0/2430959378 conn(0x7f5f300c5af0 msgr2=0x7f5f300c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 shutdown_connections 2023-11-18T19:25:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:56.807+0000 7f5f2f59e640 1 -- 172.21.15.45:0/2430959378 wait complete. 2023-11-18T19:25:56.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-18T19:25:57.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.057+0000 7f4d8b30f640 1 Processor -- start 2023-11-18T19:25:57.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.057+0000 7f4d8b30f640 1 -- start start 2023-11-18T19:25:57.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.059+0000 7f4d8b30f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d8414c4e0 0x7f4d840a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.059+0000 7f4d8b30f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d840c4fc0 0x7f4d840c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.059+0000 7f4d8b30f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d840a5270 con 0x7f4d84152320 2023-11-18T19:25:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.059+0000 7f4d8b30f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d840a54a0 con 0x7f4d8414c4e0 2023-11-18T19:25:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.059+0000 7f4d8b30f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8406d5d0 con 0x7f4d840c4fc0 2023-11-18T19:25:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.059+0000 7f4d890ab640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d8414c4e0 0x7f4d840a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.060+0000 7f4d890ab640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d8414c4e0 0x7f4d840a4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53402/0 (socket says 172.21.15.45:53402) 2023-11-18T19:25:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.060+0000 7f4d890ab640 1 -- 172.21.15.45:0/519372364 learned_addr learned my addr 172.21.15.45:0/519372364 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:57.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.060+0000 7f4d888aa640 1 --2- 172.21.15.45:0/519372364 >> v2:172.21.15.135:3300/0 conn(0x7f4d840c4fc0 0x7f4d840c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.060+0000 7f4d890ab640 1 -- 172.21.15.45:0/519372364 >> v2:172.21.15.135:3300/0 conn(0x7f4d840c4fc0 msgr2=0x7f4d840c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:57.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.060+0000 7f4d890ab640 1 --2- 172.21.15.45:0/519372364 >> v2:172.21.15.135:3300/0 conn(0x7f4d840c4fc0 0x7f4d840c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.060+0000 7f4d890ab640 1 -- 172.21.15.45:0/519372364 >> v1:172.21.15.135:6789/0 conn(0x7f4d84152320 legacy=0x7f4d84152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:57.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.060+0000 7f4d890ab640 1 -- 172.21.15.45:0/519372364 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8406d8b0 con 0x7f4d8414c4e0 2023-11-18T19:25:57.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.062+0000 7f4d890ab640 1 --2- 172.21.15.45:0/519372364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d8414c4e0 0x7f4d840a4d30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d8406b200 tx=0x7f4d8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb2925ac283f1e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.062+0000 7f4d7bfff640 1 -- 172.21.15.45:0/519372364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80031870 con 0x7f4d8414c4e0 2023-11-18T19:25:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.062+0000 7f4d7bfff640 1 -- 172.21.15.45:0/519372364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d800319d0 con 0x7f4d8414c4e0 2023-11-18T19:25:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.062+0000 7f4d7bfff640 1 -- 172.21.15.45:0/519372364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80031d80 con 0x7f4d8414c4e0 2023-11-18T19:25:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 -- 172.21.15.45:0/519372364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d8414c4e0 msgr2=0x7f4d840a4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/519372364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d8414c4e0 0x7f4d840a4d30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d8406b200 tx=0x7f4d8002b910 comp rx=0 tx=0).stop 2023-11-18T19:25:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 -- 172.21.15.45:0/519372364 shutdown_connections 2023-11-18T19:25:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/519372364 >> v2:172.21.15.135:3300/0 conn(0x7f4d840c4fc0 0x7f4d840c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/519372364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d8414c4e0 0x7f4d840a4d30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 -- 172.21.15.45:0/519372364 >> 172.21.15.45:0/519372364 conn(0x7f4d8406a500 msgr2=0x7f4d8406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 -- 172.21.15.45:0/519372364 shutdown_connections 2023-11-18T19:25:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.063+0000 7f4d8b30f640 1 -- 172.21.15.45:0/519372364 wait complete. 2023-11-18T19:25:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.065+0000 7f4d8b30f640 1 Processor -- start 2023-11-18T19:25:57.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.065+0000 7f4d8b30f640 1 -- start start 2023-11-18T19:25:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d8b30f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d840c4fc0 0x7f4d840a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d8b30f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d8414c4e0 0x7f4d8413daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d8b30f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d84152320 0x7f4d8413e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d8b30f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84149580 con 0x7f4d84152320 2023-11-18T19:25:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d8b30f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84071a90 con 0x7f4d8414c4e0 2023-11-18T19:25:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d8b30f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84070e10 con 0x7f4d840c4fc0 2023-11-18T19:25:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d898ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d84152320 0x7f4d8413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d898ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d84152320 0x7f4d8413e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53408/0 (socket says 172.21.15.45:53408) 2023-11-18T19:25:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.066+0000 7f4d898ac640 1 -- 172.21.15.45:0/1897007295 learned_addr learned my addr 172.21.15.45:0/1897007295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d890ab640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d840c4fc0 0x7f4d840a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d888aa640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d8414c4e0 0x7f4d8413daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d898ac640 1 -- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d840c4fc0 msgr2=0x7f4d840a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d898ac640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d840c4fc0 0x7f4d840a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d898ac640 1 -- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d8414c4e0 msgr2=0x7f4d8413daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d898ac640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d8414c4e0 0x7f4d8413daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d898ac640 1 -- 172.21.15.45:0/1897007295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800094d0 con 0x7f4d84152320 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d888aa640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d8414c4e0 0x7f4d8413daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d898ac640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d84152320 0x7f4d8413e030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00b9a0 tx=0x7f4d7c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d79ffb640 1 -- 172.21.15.45:0/1897007295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00cba0 con 0x7f4d84152320 2023-11-18T19:25:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d79ffb640 1 -- 172.21.15.45:0/1897007295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d7c00cd00 con 0x7f4d84152320 2023-11-18T19:25:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.067+0000 7f4d79ffb640 1 -- 172.21.15.45:0/1897007295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0146a0 con 0x7f4d84152320 2023-11-18T19:25:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.068+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d840710f0 con 0x7f4d84152320 2023-11-18T19:25:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.068+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d840716b0 con 0x7f4d84152320 2023-11-18T19:25:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.069+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d840747c0 con 0x7f4d84152320 2023-11-18T19:25:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.070+0000 7f4d79ffb640 1 -- 172.21.15.45:0/1897007295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d7c01d3b0 con 0x7f4d84152320 2023-11-18T19:25:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.071+0000 7f4d79ffb640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4d6806ae40 0x7f4d6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.071+0000 7f4d79ffb640 1 -- 172.21.15.45:0/1897007295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f4d7c0896e0 con 0x7f4d84152320 2023-11-18T19:25:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.071+0000 7f4d890ab640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4d6806ae40 0x7f4d6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.072+0000 7f4d890ab640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4d6806ae40 0x7f4d6806d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4d80036000 tx=0x7f4d8003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.075+0000 7f4d79ffb640 1 -- 172.21.15.45:0/1897007295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d7c0544d0 con 0x7f4d84152320 2023-11-18T19:25:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.311+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d840c4da0 con 0x7f4d84152320 2023-11-18T19:25:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.314+0000 7f4d79ffb640 1 -- 172.21.15.45:0/1897007295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f4d7c057af0 con 0x7f4d84152320 2023-11-18T19:25:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:25:57.316 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3870678821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3870678821},{"type":"v1","addr":"172.21.15.135:6833","nonce":3870678821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1000466745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1000466745},{"type":"v1","addr":"172.21.15.45:6836","nonce":1000466745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/766736698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":766736698},{"type":"v1","addr":"172.21.15.45:6837","nonce":766736698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-18T19:06:37.510166+0000","modified":"2023-11-18T19:07:00.598223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6835/2364227676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2364227676},{"type":"v1","addr":"172.21.15.135:6835","nonce":2364227676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-18T19:25:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-11-18T19:25:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.316+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4d6806ae40 msgr2=0x7f4d6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.316+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4d6806ae40 0x7f4d6806d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4d80036000 tx=0x7f4d8003c040 comp rx=0 tx=0).stop 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.316+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d84152320 msgr2=0x7f4d8413e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.316+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d84152320 0x7f4d8413e030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00b9a0 tx=0x7f4d7c00be60 comp rx=0 tx=0).stop 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 shutdown_connections 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d84152320 0x7f4d8413e030 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d8414c4e0 0x7f4d8413daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f4d6806ae40 0x7f4d6806d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 --2- 172.21.15.45:0/1897007295 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d840c4fc0 0x7f4d840a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 >> 172.21.15.45:0/1897007295 conn(0x7f4d8406a500 msgr2=0x7f4d84141470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:57.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 shutdown_connections 2023-11-18T19:25:57.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.317+0000 7f4d8b30f640 1 -- 172.21.15.45:0/1897007295 wait complete. 2023-11-18T19:25:57.335 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-18T19:25:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.552+0000 7f0b899ff640 1 Processor -- start 2023-11-18T19:25:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.552+0000 7f0b899ff640 1 -- start start 2023-11-18T19:25:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.553+0000 7f0b899ff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b840c2fb0 0x7f0b840c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.553+0000 7f0b899ff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b84155890 0x7f0b84155d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.553+0000 7f0b899ff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b840a5540 con 0x7f0b840722c0 2023-11-18T19:25:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.553+0000 7f0b899ff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b84156780 con 0x7f0b840c2fb0 2023-11-18T19:25:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.553+0000 7f0b899ff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8406b9a0 con 0x7f0b84155890 2023-11-18T19:25:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.554+0000 7f0b7bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0b840722c0 0x7f0b840a4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47506/0 (socket says 172.21.15.45:47506) 2023-11-18T19:25:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.554+0000 7f0b7bfff640 1 -- 172.21.15.45:0/421508005 learned_addr learned my addr 172.21.15.45:0/421508005 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:25:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.554+0000 7f0b889fd640 1 --2- 172.21.15.45:0/421508005 >> v2:172.21.15.135:3300/0 conn(0x7f0b840c2fb0 0x7f0b840c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.554+0000 7f0b891fe640 1 --2- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b84155890 0x7f0b84155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.554+0000 7f0b7b7fe640 1 -- 172.21.15.45:0/421508005 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714710642 0 0) 0x7f0b840a5540 con 0x7f0b840722c0 2023-11-18T19:25:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.554+0000 7f0b7b7fe640 1 -- 172.21.15.45:0/421508005 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c003520 con 0x7f0b840722c0 2023-11-18T19:25:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.555+0000 7f0b889fd640 1 -- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b84155890 msgr2=0x7f0b84155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.555+0000 7f0b889fd640 1 --2- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b84155890 0x7f0b84155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.555+0000 7f0b889fd640 1 -- 172.21.15.45:0/421508005 >> v1:172.21.15.45:6789/0 conn(0x7f0b840722c0 legacy=0x7f0b840a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.555+0000 7f0b889fd640 1 -- 172.21.15.45:0/421508005 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8406bc80 con 0x7f0b840c2fb0 2023-11-18T19:25:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.555+0000 7f0b891fe640 1 --2- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b84155890 0x7f0b84155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-18T19:25:57.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.556+0000 7f0b889fd640 1 --2- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840c2fb0 0x7f0b840c39f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b800097a0 tx=0x7f0b8002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f2e62e8800654d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.556+0000 7f0b7b7fe640 1 -- 172.21.15.45:0/421508005 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8002f050 con 0x7f0b840c2fb0 2023-11-18T19:25:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.556+0000 7f0b7b7fe640 1 -- 172.21.15.45:0/421508005 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0b80031700 con 0x7f0b840c2fb0 2023-11-18T19:25:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.556+0000 7f0b7b7fe640 1 -- 172.21.15.45:0/421508005 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80031ab0 con 0x7f0b840c2fb0 2023-11-18T19:25:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 -- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840c2fb0 msgr2=0x7f0b840c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 --2- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840c2fb0 0x7f0b840c39f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b800097a0 tx=0x7f0b8002b7a0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 -- 172.21.15.45:0/421508005 shutdown_connections 2023-11-18T19:25:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 --2- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b84155890 0x7f0b84155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 --2- 172.21.15.45:0/421508005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840c2fb0 0x7f0b840c39f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 -- 172.21.15.45:0/421508005 >> 172.21.15.45:0/421508005 conn(0x7f0b840c5af0 msgr2=0x7f0b840c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 -- 172.21.15.45:0/421508005 shutdown_connections 2023-11-18T19:25:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.557+0000 7f0b899ff640 1 -- 172.21.15.45:0/421508005 wait complete. 2023-11-18T19:25:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.559+0000 7f0b899ff640 1 Processor -- start 2023-11-18T19:25:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.559+0000 7f0b899ff640 1 -- start start 2023-11-18T19:25:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b899ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840722c0 0x7f0b840bf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b899ff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b840c2fb0 0x7f0b840a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b899ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b84155890 0x7f0b840a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b899ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840a7b00 con 0x7f0b84155890 2023-11-18T19:25:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b899ff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841ea310 con 0x7f0b840722c0 2023-11-18T19:25:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b899ff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841ea5f0 con 0x7f0b840c2fb0 2023-11-18T19:25:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b891fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b84155890 0x7f0b840a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b891fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b84155890 0x7f0b840a75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53422/0 (socket says 172.21.15.45:53422) 2023-11-18T19:25:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.560+0000 7f0b891fe640 1 -- 172.21.15.45:0/2464847513 learned_addr learned my addr 172.21.15.45:0/2464847513 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b891fe640 1 -- 172.21.15.45:0/2464847513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b840c2fb0 msgr2=0x7f0b840a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b891fe640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b840c2fb0 0x7f0b840a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b891fe640 1 -- 172.21.15.45:0/2464847513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840722c0 msgr2=0x7f0b840bf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b889fd640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840722c0 0x7f0b840bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b891fe640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840722c0 0x7f0b840bf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b891fe640 1 -- 172.21.15.45:0/2464847513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c009a70 con 0x7f0b84155890 2023-11-18T19:25:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b891fe640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b84155890 0x7f0b840a75c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00efc0 tx=0x7f0b7c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b797fa640 1 -- 172.21.15.45:0/2464847513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c009d70 con 0x7f0b84155890 2023-11-18T19:25:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b797fa640 1 -- 172.21.15.45:0/2464847513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0b7c00f040 con 0x7f0b84155890 2023-11-18T19:25:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b797fa640 1 -- 172.21.15.45:0/2464847513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0039b0 con 0x7f0b84155890 2023-11-18T19:25:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b80009400 con 0x7f0b84155890 2023-11-18T19:25:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.561+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b841eabb0 con 0x7f0b84155890 2023-11-18T19:25:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.562+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b84067fc0 con 0x7f0b84155890 2023-11-18T19:25:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.563+0000 7f0b797fa640 1 -- 172.21.15.45:0/2464847513 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b7c0144a0 con 0x7f0b84155890 2023-11-18T19:25:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.564+0000 7f0b797fa640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0b7006ae40 0x7f0b7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.564+0000 7f0b797fa640 1 -- 172.21.15.45:0/2464847513 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0b7c08a6a0 con 0x7f0b84155890 2023-11-18T19:25:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.565+0000 7f0b889fd640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0b7006ae40 0x7f0b7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.565+0000 7f0b889fd640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0b7006ae40 0x7f0b7006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b80035000 tx=0x7f0b80008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.569+0000 7f0b797fa640 1 -- 172.21.15.45:0/2464847513 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b7c055360 con 0x7f0b84155890 2023-11-18T19:25:57.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.770+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b8406cb80 con 0x7f0b84155890 2023-11-18T19:25:57.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.772+0000 7f0b797fa640 1 -- 172.21.15.45:0/2464847513 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18481 (secure 0 0 0) 0x7f0b7c058980 con 0x7f0b84155890 2023-11-18T19:25:57.774 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-18T19:25:57.774 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"fsid":"b96c09c0-a884-4d0b-a1ec-074e421eff36","created":"2023-11-18T19:06:18.036904+0000","modified":"2023-11-18T19:07:25.049601+0000","last_up_change":"2023-11-18T19:06:29.435799+0000","last_in_change":"2023-11-18T19:06:21.431825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-18T19:06:31.246517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-18T19:06:35.454808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-18T19:06:36.526298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-18T19:06:39.617712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"be538529-c274-4020-906b-31cab7a6bc06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6801","nonce":2175017614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6803","nonce":2175017614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6807","nonce":2175017614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2175017614},{"type":"v1","addr":"172.21.15.45:6805","nonce":2175017614}]},"public_addr":"172.21.15.45:6801/2175017614","cluster_addr":"172.21.15.45:6803/2175017614","heartbeat_back_addr":"172.21.15.45:6807/2175017614","heartbeat_front_addr":"172.21.15.45:6805/2175017614","state":["exists","up"]},{"osd":1,"uuid":"41e25e10-facd-48e0-831b-554f5f4c7b5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6817","nonce":370738576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6819","nonce":370738576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6823","nonce":370738576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":370738576},{"type":"v1","addr":"172.21.15.45:6821","nonce":370738576}]},"public_addr":"172.21.15.45:6817/370738576","cluster_addr":"172.21.15.45:6819/370738576","heartbeat_back_addr":"172.21.15.45:6823/370738576","heartbeat_front_addr":"172.21.15.45:6821/370738576","state":["exists","up"]},{"osd":2,"uuid":"271297e6-5282-403f-aebb-b3a01192ea66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6825","nonce":3279045870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6827","nonce":3279045870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6831","nonce":3279045870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3279045870},{"type":"v1","addr":"172.21.15.45:6829","nonce":3279045870}]},"public_addr":"172.21.15.45:6825/3279045870","cluster_addr":"172.21.15.45:6827/3279045870","heartbeat_back_addr":"172.21.15.45:6831/3279045870","heartbeat_front_addr":"172.21.15.45:6829/3279045870","state":["exists","up"]},{"osd":3,"uuid":"7478f8b5-9e26-4735-884e-d40e38bb31bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6809","nonce":2848358823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6811","nonce":2848358823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6815","nonce":2848358823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2848358823},{"type":"v1","addr":"172.21.15.45:6813","nonce":2848358823}]},"public_addr":"172.21.15.45:6809/2848358823","cluster_addr":"172.21.15.45:6811/2848358823","heartbeat_back_addr":"172.21.15.45:6815/2848358823","heartbeat_front_addr":"172.21.15.45:6813/2848358823","state":["exists","up"]},{"osd":4,"uuid":"0d3c7eca-17a4-47f2-8570-ba8482bb260e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6801","nonce":2682063335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6803","nonce":2682063335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6807","nonce":2682063335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2682063335},{"type":"v1","addr":"172.21.15.135:6805","nonce":2682063335}]},"public_addr":"172.21.15.135:6801/2682063335","cluster_addr":"172.21.15.135:6803/2682063335","heartbeat_back_addr":"172.21.15.135:6807/2682063335","heartbeat_front_addr":"172.21.15.135:6805/2682063335","state":["exists","up"]},{"osd":5,"uuid":"1f2db0ef-b2ab-4fb4-a2a2-8fdf681fef63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6821","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6822","nonce":1627929657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6826","nonce":1627929657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6831","nonce":1627929657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1627929657},{"type":"v1","addr":"172.21.15.135:6829","nonce":1627929657}]},"public_addr":"172.21.15.135:6822/1627929657","cluster_addr":"172.21.15.135:6826/1627929657","heartbeat_back_addr":"172.21.15.135:6831/1627929657","heartbeat_front_addr":"172.21.15.135:6829/1627929657","state":["exists","up"]},{"osd":6,"uuid":"536ff7c7-f8b4-4ab0-ab68-7f018ea09954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6809","nonce":1077987781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6811","nonce":1077987781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6815","nonce":1077987781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1077987781},{"type":"v1","addr":"172.21.15.135:6813","nonce":1077987781}]},"public_addr":"172.21.15.135:6809/1077987781","cluster_addr":"172.21.15.135:6811/1077987781","heartbeat_back_addr":"172.21.15.135:6815/1077987781","heartbeat_front_addr":"172.21.15.135:6813/1077987781","state":["exists","up"]},{"osd":7,"uuid":"7dcdb31f-81bb-4d4e-b3d6-c78c8cf34d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6817","nonce":745158176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6819","nonce":745158176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6825","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6827","nonce":745158176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":745158176},{"type":"v1","addr":"172.21.15.135:6823","nonce":745158176}]},"public_addr":"172.21.15.135:6817/745158176","cluster_addr":"172.21.15.135:6819/745158176","heartbeat_back_addr":"172.21.15.135:6827/745158176","heartbeat_front_addr":"172.21.15.135:6823/745158176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.774150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.821032+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.551143+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.830469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.730380+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.716320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:26.735245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-18T19:06:25.789072+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-18T19:25:57.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0b7006ae40 msgr2=0x7f0b7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0b7006ae40 0x7f0b7006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b80035000 tx=0x7f0b80008030 comp rx=0 tx=0).stop 2023-11-18T19:25:57.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b84155890 msgr2=0x7f0b840a75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:57.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b84155890 0x7f0b840a75c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00efc0 tx=0x7f0b7c009f90 comp rx=0 tx=0).stop 2023-11-18T19:25:57.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 shutdown_connections 2023-11-18T19:25:57.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b84155890 0x7f0b840a75c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f0b7006ae40 0x7f0b7006d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b840c2fb0 0x7f0b840a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 --2- 172.21.15.45:0/2464847513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b840722c0 0x7f0b840bf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:57.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 >> 172.21.15.45:0/2464847513 conn(0x7f0b840c5af0 msgr2=0x7f0b8406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:57.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.775+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 shutdown_connections 2023-11-18T19:25:57.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:57.776+0000 7f0b899ff640 1 -- 172.21.15.45:0/2464847513 wait complete. 2023-11-18T19:25:57.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-18T19:25:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.015+0000 7f19eca6e640 1 Processor -- start 2023-11-18T19:25:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.016+0000 7f19eca6e640 1 -- start start 2023-11-18T19:25:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.017+0000 7f19eca6e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 0x7f19e80a9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.017+0000 7f19eca6e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e80c76d0 con 0x7f19e80a7320 2023-11-18T19:25:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.017+0000 7f19eca6e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e81558d0 con 0x7f19e80a9d60 2023-11-18T19:25:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.017+0000 7f19eca6e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80c79b0 con 0x7f19e81563b0 2023-11-18T19:25:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f19e80a7320 0x7f19e8152bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47522/0 (socket says 172.21.15.45:47522) 2023-11-18T19:25:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e77fe640 1 -- 172.21.15.45:0/3192176737 learned_addr learned my addr 172.21.15.45:0/3192176737 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:25:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e6ffd640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 0x7f19e80a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504839887 0 0) 0x7f19e80c76d0 con 0x7f19e80a7320 2023-11-18T19:25:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d4003520 con 0x7f19e80a7320 2023-11-18T19:25:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3487425092 0 0) 0x7f19d4003520 con 0x7f19e80a7320 2023-11-18T19:25:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 msgr2=0x7f19e80a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e67fc640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 0x7f19e80a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 >> v1:172.21.15.135:6789/0 conn(0x7f19e80a9d60 legacy=0x7f19e806f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.018+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8155bb0 con 0x7f19e80a7320 2023-11-18T19:25:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3508112197 0 0) 0x7f19d80019f0 con 0x7f19e80a7320 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 >> v1:172.21.15.45:6789/0 conn(0x7f19e80a7320 legacy=0x7f19e8152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 0x7f19d40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4003f70 0x7f19d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d4004d00 0x7f19d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80c79b0 con 0x7f19d4004d00 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d400bac0 con 0x7f19d4003f70 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d400bc80 con 0x7f19e81563b0 2023-11-18T19:25:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e7fff640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d4004d00 0x7f19d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e6ffd640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4003f70 0x7f19d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e77fe640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 0x7f19d40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e7fff640 1 -- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 msgr2=0x7f19d40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e7fff640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 0x7f19d40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e7fff640 1 -- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4003f70 msgr2=0x7f19d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e7fff640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4003f70 0x7f19d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e7fff640 1 -- 172.21.15.45:0/3192176737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4003520 con 0x7f19d4004d00 2023-11-18T19:25:58.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e6ffd640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4003f70 0x7f19d40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:58.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.019+0000 7f19e77fe640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81563b0 0x7f19d40039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-18T19:25:58.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19e7fff640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d4004d00 0x7f19d4005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f19e0001750 tx=0x7f19d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fb0b91d1807a2f server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:58.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00052d0 con 0x7f19d4004d00 2023-11-18T19:25:58.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f19e002e050 con 0x7f19d4004d00 2023-11-18T19:25:58.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19e67fc640 1 -- 172.21.15.45:0/3192176737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0003850 con 0x7f19d4004d00 2023-11-18T19:25:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19eca6e640 1 -- 172.21.15.45:0/3192176737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d4004d00 msgr2=0x7f19d4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19eca6e640 1 --2- 172.21.15.45:0/3192176737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d4004d00 0x7f19d4005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f19e0001750 tx=0x7f19d40057f0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19e7fff640 1 -- 172.21.15.45:0/3192176737 reap_dead start 2023-11-18T19:25:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19eca6e640 1 -- 172.21.15.45:0/3192176737 shutdown_connections 2023-11-18T19:25:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19eca6e640 1 -- 172.21.15.45:0/3192176737 >> 172.21.15.45:0/3192176737 conn(0x7f19e80c45e0 msgr2=0x7f19e80c49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.021+0000 7f19eca6e640 1 -- 172.21.15.45:0/3192176737 shutdown_connections 2023-11-18T19:25:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.022+0000 7f19eca6e640 1 -- 172.21.15.45:0/3192176737 wait complete. 2023-11-18T19:25:58.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.023+0000 7f19eca6e640 1 Processor -- start 2023-11-18T19:25:58.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.023+0000 7f19eca6e640 1 -- start start 2023-11-18T19:25:58.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.024+0000 7f19eca6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4004d00 0x7f19e81ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.024+0000 7f19eca6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e80aa810 0x7f19e806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.024+0000 7f19eca6e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81ea0c0 0x7f19e81ea570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.024+0000 7f19eca6e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81e99b0 con 0x7f19e80aa810 2023-11-18T19:25:58.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.024+0000 7f19eca6e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81e9c30 con 0x7f19d4004d00 2023-11-18T19:25:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.024+0000 7f19eca6e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81507e0 con 0x7f19e81ea0c0 2023-11-18T19:25:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e80aa810 0x7f19e806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e80aa810 0x7f19e806ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53442/0 (socket says 172.21.15.45:53442) 2023-11-18T19:25:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 -- 172.21.15.45:0/3907415795 learned_addr learned my addr 172.21.15.45:0/3907415795 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e77fe640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4004d00 0x7f19e81ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 -- 172.21.15.45:0/3907415795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81ea0c0 msgr2=0x7f19e81ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81ea0c0 0x7f19e81ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 -- 172.21.15.45:0/3907415795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4004d00 msgr2=0x7f19e81ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4004d00 0x7f19e81ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.025+0000 7f19e6ffd640 1 -- 172.21.15.45:0/3907415795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80a8b50 con 0x7f19e80aa810 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.026+0000 7f19e6ffd640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e80aa810 0x7f19e806ce70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f19d00108e0 tx=0x7f19d0010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.026+0000 7f19dffff640 1 -- 172.21.15.45:0/3907415795 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000eba0 con 0x7f19e80aa810 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.026+0000 7f19dffff640 1 -- 172.21.15.45:0/3907415795 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f19d000ed00 con 0x7f19e80aa810 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.026+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80a8df0 con 0x7f19e80aa810 2023-11-18T19:25:58.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.026+0000 7f19dffff640 1 -- 172.21.15.45:0/3907415795 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d001c600 con 0x7f19e80aa810 2023-11-18T19:25:58.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.026+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e806d3b0 con 0x7f19e80aa810 2023-11-18T19:25:58.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.027+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e81e9de0 con 0x7f19e80aa810 2023-11-18T19:25:58.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.028+0000 7f19dffff640 1 -- 172.21.15.45:0/3907415795 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19d001c760 con 0x7f19e80aa810 2023-11-18T19:25:58.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.029+0000 7f19dffff640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f19c806ae40 0x7f19c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.029+0000 7f19dffff640 1 -- 172.21.15.45:0/3907415795 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f19d0089ff0 con 0x7f19e80aa810 2023-11-18T19:25:58.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.029+0000 7f19e77fe640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f19c806ae40 0x7f19c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.030+0000 7f19e77fe640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f19c806ae40 0x7f19c806d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19d8001370 tx=0x7f19d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:58.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.033+0000 7f19dffff640 1 -- 172.21.15.45:0/3907415795 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19d00bce90 con 0x7f19e80aa810 2023-11-18T19:25:58.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.267+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f19e80a9310 con 0x7f19e80aa810 2023-11-18T19:25:58.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.272+0000 7f19dffff640 1 -- 172.21.15.45:0/3907415795 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f19e81e9de0 con 0x7f19e80aa810 2023-11-18T19:25:58.274 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-18T19:25:58.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f19c806ae40 msgr2=0x7f19c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f19c806ae40 0x7f19c806d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19d8001370 tx=0x7f19d8009040 comp rx=0 tx=0).stop 2023-11-18T19:25:58.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e80aa810 msgr2=0x7f19e806ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e80aa810 0x7f19e806ce70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f19d00108e0 tx=0x7f19d0010da0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 shutdown_connections 2023-11-18T19:25:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f19c806ae40 0x7f19c806d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19e81ea0c0 0x7f19e81ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e80aa810 0x7f19e806ce70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 --2- 172.21.15.45:0/3907415795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19d4004d00 0x7f19e81ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 >> 172.21.15.45:0/3907415795 conn(0x7f19e80c45e0 msgr2=0x7f19e80c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:58.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.275+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 shutdown_connections 2023-11-18T19:25:58.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.276+0000 7f19eca6e640 1 -- 172.21.15.45:0/3907415795 wait complete. 2023-11-18T19:25:58.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-18T19:25:58.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.521+0000 7f2f67fff640 1 Processor -- start 2023-11-18T19:25:58.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.522+0000 7f2f67fff640 1 -- start start 2023-11-18T19:25:58.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.523+0000 7f2f67fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2f6806fcd0 0x7f2f68156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.523+0000 7f2f67fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f680c4980 0x7f2f68156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.523+0000 7f2f67fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f680c6c90 con 0x7f2f680c7f60 2023-11-18T19:25:58.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.523+0000 7f2f67fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f680c69b0 con 0x7f2f680c4980 2023-11-18T19:25:58.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.523+0000 7f2f67fff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6806f1f0 con 0x7f2f6806fcd0 2023-11-18T19:25:58.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f66ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2f680c7f60 0x7f2f680c2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47528/0 (socket says 172.21.15.45:47528) 2023-11-18T19:25:58.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f66ffd640 1 -- 172.21.15.45:0/353049545 learned_addr learned my addr 172.21.15.45:0/353049545 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:25:58.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f677fe640 1 --2- 172.21.15.45:0/353049545 >> v2:172.21.15.45:3300/0 conn(0x7f2f680c4980 0x7f2f68156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f5ffff640 1 --2- 172.21.15.45:0/353049545 >> v2:172.21.15.135:3300/0 conn(0x7f2f6806fcd0 0x7f2f68156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f667fc640 1 -- 172.21.15.45:0/353049545 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673592628 0 0) 0x7f2f680c6c90 con 0x7f2f680c7f60 2023-11-18T19:25:58.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f667fc640 1 -- 172.21.15.45:0/353049545 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f54003520 con 0x7f2f680c7f60 2023-11-18T19:25:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f677fe640 1 -- 172.21.15.45:0/353049545 >> v2:172.21.15.135:3300/0 conn(0x7f2f6806fcd0 msgr2=0x7f2f68156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f677fe640 1 --2- 172.21.15.45:0/353049545 >> v2:172.21.15.135:3300/0 conn(0x7f2f6806fcd0 0x7f2f68156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f677fe640 1 -- 172.21.15.45:0/353049545 >> v1:172.21.15.45:6789/0 conn(0x7f2f680c7f60 legacy=0x7f2f680c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.524+0000 7f2f677fe640 1 -- 172.21.15.45:0/353049545 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6806f4d0 con 0x7f2f680c4980 2023-11-18T19:25:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.526+0000 7f2f677fe640 1 --2- 172.21.15.45:0/353049545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f68156580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f680ad830 tx=0x7f2f6002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e89d321bb05e6e server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.526+0000 7f2f667fc640 1 -- 172.21.15.45:0/353049545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6002cbf0 con 0x7f2f680c4980 2023-11-18T19:25:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.526+0000 7f2f667fc640 1 -- 172.21.15.45:0/353049545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2f6002cd50 con 0x7f2f680c4980 2023-11-18T19:25:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.526+0000 7f2f667fc640 1 -- 172.21.15.45:0/353049545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60034680 con 0x7f2f680c4980 2023-11-18T19:25:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.526+0000 7f2f67fff640 1 -- 172.21.15.45:0/353049545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 msgr2=0x7f2f68156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.526+0000 7f2f67fff640 1 --2- 172.21.15.45:0/353049545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f68156580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f680ad830 tx=0x7f2f6002be40 comp rx=0 tx=0).stop 2023-11-18T19:25:58.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.527+0000 7f2f67fff640 1 -- 172.21.15.45:0/353049545 shutdown_connections 2023-11-18T19:25:58.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.527+0000 7f2f67fff640 1 --2- 172.21.15.45:0/353049545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f68156580 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.527+0000 7f2f67fff640 1 --2- 172.21.15.45:0/353049545 >> v2:172.21.15.135:3300/0 conn(0x7f2f6806fcd0 0x7f2f68156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.527+0000 7f2f67fff640 1 -- 172.21.15.45:0/353049545 >> 172.21.15.45:0/353049545 conn(0x7f2f6806deb0 msgr2=0x7f2f6806e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:58.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.527+0000 7f2f67fff640 1 -- 172.21.15.45:0/353049545 shutdown_connections 2023-11-18T19:25:58.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.527+0000 7f2f67fff640 1 -- 172.21.15.45:0/353049545 wait complete. 2023-11-18T19:25:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.528+0000 7f2f67fff640 1 Processor -- start 2023-11-18T19:25:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.529+0000 7f2f67fff640 1 -- start start 2023-11-18T19:25:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f67fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f6806fcd0 0x7f2f6814f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f680a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f67fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f680c7f60 0x7f2f6814c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f67fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6814ff00 con 0x7f2f680c4980 2023-11-18T19:25:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f67fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6814ee20 con 0x7f2f6806fcd0 2023-11-18T19:25:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f67fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68150130 con 0x7f2f680c7f60 2023-11-18T19:25:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f5ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f680a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f5ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f680a76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53454/0 (socket says 172.21.15.45:53454) 2023-11-18T19:25:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f5ffff640 1 -- 172.21.15.45:0/1335864478 learned_addr learned my addr 172.21.15.45:0/1335864478 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.530+0000 7f2f66ffd640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f6806fcd0 0x7f2f6814f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f677fe640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f680c7f60 0x7f2f6814c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5ffff640 1 -- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f680c7f60 msgr2=0x7f2f6814c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5ffff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f680c7f60 0x7f2f6814c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5ffff640 1 -- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f6806fcd0 msgr2=0x7f2f6814f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5ffff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f6806fcd0 0x7f2f6814f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5ffff640 1 -- 172.21.15.45:0/1335864478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60009a70 con 0x7f2f680c4980 2023-11-18T19:25:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f66ffd640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f6806fcd0 0x7f2f6814f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:25:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5ffff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f680a76c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000d5f0 tx=0x7f2f5000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5f7fe640 1 -- 172.21.15.45:0/1335864478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500125f0 con 0x7f2f680c4980 2023-11-18T19:25:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5f7fe640 1 -- 172.21.15.45:0/1335864478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2f50012750 con 0x7f2f680c4980 2023-11-18T19:25:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f5f7fe640 1 -- 172.21.15.45:0/1335864478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50012b20 con 0x7f2f680c4980 2023-11-18T19:25:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.531+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6814e4f0 con 0x7f2f680c4980 2023-11-18T19:25:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.532+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6814eab0 con 0x7f2f680c4980 2023-11-18T19:25:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.533+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6814ec70 con 0x7f2f680c4980 2023-11-18T19:25:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.534+0000 7f2f5f7fe640 1 -- 172.21.15.45:0/1335864478 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f50012c80 con 0x7f2f680c4980 2023-11-18T19:25:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.534+0000 7f2f5f7fe640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2f4806ae40 0x7f2f4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:58.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.535+0000 7f2f5f7fe640 1 -- 172.21.15.45:0/1335864478 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2f50089ee0 con 0x7f2f680c4980 2023-11-18T19:25:58.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.535+0000 7f2f66ffd640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2f4806ae40 0x7f2f4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:58.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.535+0000 7f2f66ffd640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2f4806ae40 0x7f2f4806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007fd0 tx=0x7f2f58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:58.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.540+0000 7f2f5f7fe640 1 -- 172.21.15.45:0/1335864478 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f50054b50 con 0x7f2f680c4980 2023-11-18T19:25:58.543 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-11-18T19:25:58.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:58.780+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2f681e9850 con 0x7f2f680c4980 2023-11-18T19:25:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.427+0000 7f2f5f7fe640 1 -- 172.21.15.45:0/1335864478 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2f50058170 con 0x7f2f680c4980 2023-11-18T19:25:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.430+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2f4806ae40 msgr2=0x7f2f4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.430+0000 7f2f67fff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2f4806ae40 0x7f2f4806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007fd0 tx=0x7f2f58009040 comp rx=0 tx=0).stop 2023-11-18T19:25:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.430+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 msgr2=0x7f2f680a76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f680a76c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000d5f0 tx=0x7f2f5000dab0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 shutdown_connections 2023-11-18T19:25:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2f4806ae40 0x7f2f4806d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f680c7f60 0x7f2f6814c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f680c4980 0x7f2f680a76c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 --2- 172.21.15.45:0/1335864478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f6806fcd0 0x7f2f6814f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 >> 172.21.15.45:0/1335864478 conn(0x7f2f6806deb0 msgr2=0x7f2f68155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 shutdown_connections 2023-11-18T19:25:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.431+0000 7f2f67fff640 1 -- 172.21.15.45:0/1335864478 wait complete. 2023-11-18T19:25:59.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-18T19:25:59.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.688+0000 7f9164dc7640 1 Processor -- start 2023-11-18T19:25:59.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.688+0000 7f9164dc7640 1 -- start start 2023-11-18T19:25:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.690+0000 7f9164dc7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f91600bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:59.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.690+0000 7f9164dc7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91600c43c0 0x7f91600a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:59.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.690+0000 7f9164dc7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916006d950 con 0x7f91600bf1e0 2023-11-18T19:25:59.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.690+0000 7f9164dc7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600bfb00 con 0x7f91600c43c0 2023-11-18T19:25:59.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.690+0000 7f9164dc7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916006de80 con 0x7f91600c32b0 2023-11-18T19:25:59.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915ed9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91600c43c0 0x7f91600a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:59.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915ed9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91600c43c0 0x7f91600a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.45:47512/0 (socket says 172.21.15.45:47512) 2023-11-18T19:25:59.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915ed9d640 1 -- 172.21.15.45:0/1512881369 learned_addr learned my addr 172.21.15.45:0/1512881369 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:59.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915dd9b640 1 --2- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f91600bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915ed9d640 1 -- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 msgr2=0x7f91600bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:25:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915ed9d640 1 --2- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f91600bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915ed9d640 1 -- 172.21.15.45:0/1512881369 >> v1:172.21.15.135:6789/0 conn(0x7f91600bf1e0 legacy=0x7f9160155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915ed9d640 1 -- 172.21.15.45:0/1512881369 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600bfcf0 con 0x7f91600c43c0 2023-11-18T19:25:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.691+0000 7f915dd9b640 1 --2- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f91600bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-18T19:25:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.693+0000 7f915ed9d640 1 --2- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 0x7f91600a4d50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9158009e50 tx=0x7f915802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f338090dfc8ed5 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.693+0000 7f915d59a640 1 -- 172.21.15.45:0/1512881369 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915802ca80 con 0x7f91600c43c0 2023-11-18T19:25:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f915d59a640 1 -- 172.21.15.45:0/1512881369 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f915802cbe0 con 0x7f91600c43c0 2023-11-18T19:25:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f915d59a640 1 -- 172.21.15.45:0/1512881369 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580343f0 con 0x7f91600c43c0 2023-11-18T19:25:59.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 -- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 msgr2=0x7f91600a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:59.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 --2- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 0x7f91600a4d50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9158009e50 tx=0x7f915802bee0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 -- 172.21.15.45:0/1512881369 shutdown_connections 2023-11-18T19:25:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 --2- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f91600bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 --2- 172.21.15.45:0/1512881369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 0x7f91600a4d50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 -- 172.21.15.45:0/1512881369 >> 172.21.15.45:0/1512881369 conn(0x7f91600c5bd0 msgr2=0x7f91600c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:25:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 -- 172.21.15.45:0/1512881369 shutdown_connections 2023-11-18T19:25:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.694+0000 7f9164dc7640 1 -- 172.21.15.45:0/1512881369 wait complete. 2023-11-18T19:25:59.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.696+0000 7f9164dc7640 1 Processor -- start 2023-11-18T19:25:59.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.696+0000 7f9164dc7640 1 -- start start 2023-11-18T19:25:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f9164dc7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91600bf1e0 0x7f916009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f9164dc7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f916009f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f9164dc7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 0x7f9160153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f9164dc7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91601eb250 con 0x7f91600bf1e0 2023-11-18T19:25:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f9164dc7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91601eb740 con 0x7f91600c43c0 2023-11-18T19:25:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f9164dc7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600a6420 con 0x7f91600c32b0 2023-11-18T19:25:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f915e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91600bf1e0 0x7f916009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:59.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f915e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91600bf1e0 0x7f916009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53464/0 (socket says 172.21.15.45:53464) 2023-11-18T19:25:59.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.697+0000 7f915e59c640 1 -- 172.21.15.45:0/3624165229 learned_addr learned my addr 172.21.15.45:0/3624165229 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:25:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915dd9b640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f916009f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915ed9d640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 0x7f9160153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915e59c640 1 -- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 msgr2=0x7f916009f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915e59c640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f916009f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915e59c640 1 -- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 msgr2=0x7f9160153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:25:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915e59c640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 0x7f9160153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:25:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915e59c640 1 -- 172.21.15.45:0/3624165229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158009b30 con 0x7f91600bf1e0 2023-11-18T19:25:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f915e59c640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91600bf1e0 0x7f916009dcf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f915000c450 tx=0x7f915000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.698+0000 7f914effd640 1 -- 172.21.15.45:0/3624165229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500052d0 con 0x7f91600bf1e0 2023-11-18T19:25:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.699+0000 7f914effd640 1 -- 172.21.15.45:0/3624165229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9150005430 con 0x7f91600bf1e0 2023-11-18T19:25:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.699+0000 7f914effd640 1 -- 172.21.15.45:0/3624165229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150012890 con 0x7f91600bf1e0 2023-11-18T19:25:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.699+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916009edf0 con 0x7f91600bf1e0 2023-11-18T19:25:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.699+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91600a66c0 con 0x7f91600bf1e0 2023-11-18T19:25:59.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.700+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91600c5510 con 0x7f91600bf1e0 2023-11-18T19:25:59.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.701+0000 7f914effd640 1 -- 172.21.15.45:0/3624165229 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91500129f0 con 0x7f91600bf1e0 2023-11-18T19:25:59.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.702+0000 7f914effd640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f914006ae40 0x7f914006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:25:59.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.702+0000 7f914effd640 1 -- 172.21.15.45:0/3624165229 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9150089530 con 0x7f91600bf1e0 2023-11-18T19:25:59.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.702+0000 7f915dd9b640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f914006ae40 0x7f914006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:25:59.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.703+0000 7f915dd9b640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f914006ae40 0x7f914006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9160154840 tx=0x7f9154008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:25:59.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.706+0000 7f914effd640 1 -- 172.21.15.45:0/3624165229 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9150054230 con 0x7f91600bf1e0 2023-11-18T19:25:59.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:25:59.899+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f91600c4180 con 0x7f91600bf1e0 2023-11-18T19:26:00.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.439+0000 7f914effd640 1 -- 172.21.15.45:0/3624165229 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9150057850 con 0x7f91600bf1e0 2023-11-18T19:26:00.442 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-18T19:26:00.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.444+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f914006ae40 msgr2=0x7f914006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:00.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.444+0000 7f9164dc7640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f914006ae40 0x7f914006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9160154840 tx=0x7f9154008040 comp rx=0 tx=0).stop 2023-11-18T19:26:00.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.444+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91600bf1e0 msgr2=0x7f916009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:00.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.444+0000 7f9164dc7640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91600bf1e0 0x7f916009dcf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f915000c450 tx=0x7f915000c910 comp rx=0 tx=0).stop 2023-11-18T19:26:00.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.445+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 shutdown_connections 2023-11-18T19:26:00.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.445+0000 7f9164dc7640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91600c43c0 0x7f9160153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.445+0000 7f9164dc7640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f914006ae40 0x7f914006d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.445+0000 7f9164dc7640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91600c32b0 0x7f916009f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.445+0000 7f9164dc7640 1 --2- 172.21.15.45:0/3624165229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91600bf1e0 0x7f916009dcf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.445+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 >> 172.21.15.45:0/3624165229 conn(0x7f91600c5bd0 msgr2=0x7f91600c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:26:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.445+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 shutdown_connections 2023-11-18T19:26:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.446+0000 7f9164dc7640 1 -- 172.21.15.45:0/3624165229 wait complete. 2023-11-18T19:26:00.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-18T19:26:00.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.684+0000 7f2d58a44640 1 Processor -- start 2023-11-18T19:26:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.685+0000 7f2d58a44640 1 -- start start 2023-11-18T19:26:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.686+0000 7f2d58a44640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d540c55e0 0x7f2d54071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.686+0000 7f2d58a44640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c3ec0 0x7f2d540c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.686+0000 7f2d58a44640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d540c0750 con 0x7f2d541522e0 2023-11-18T19:26:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.686+0000 7f2d58a44640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d540c12f0 con 0x7f2d540c55e0 2023-11-18T19:26:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.686+0000 7f2d58a44640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d540c0a30 con 0x7f2d540c3ec0 2023-11-18T19:26:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.687+0000 7f2d52d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c3ec0 0x7f2d540c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.687+0000 7f2d51d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d540c55e0 0x7f2d54071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.687+0000 7f2d52d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c3ec0 0x7f2d540c2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.45:49786/0 (socket says 172.21.15.45:49786) 2023-11-18T19:26:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.687+0000 7f2d52d9d640 1 -- 172.21.15.45:0/1579267492 learned_addr learned my addr 172.21.15.45:0/1579267492 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:26:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.688+0000 7f2d52d9d640 1 -- 172.21.15.45:0/1579267492 >> v2:172.21.15.135:3300/0 conn(0x7f2d540c55e0 msgr2=0x7f2d54071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:26:00.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.688+0000 7f2d52d9d640 1 --2- 172.21.15.45:0/1579267492 >> v2:172.21.15.135:3300/0 conn(0x7f2d540c55e0 0x7f2d54071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.688+0000 7f2d52d9d640 1 -- 172.21.15.45:0/1579267492 >> v1:172.21.15.135:6789/0 conn(0x7f2d541522e0 legacy=0x7f2d5406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:00.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.688+0000 7f2d52d9d640 1 -- 172.21.15.45:0/1579267492 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d540c0f10 con 0x7f2d540c3ec0 2023-11-18T19:26:00.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.689+0000 7f2d52d9d640 1 --2- 172.21.15.45:0/1579267492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c3ec0 0x7f2d540c2510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009870 tx=0x7f2d4c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7b1d9071b9e84c server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:26:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.689+0000 7f2d5159a640 1 -- 172.21.15.45:0/1579267492 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c031640 con 0x7f2d540c3ec0 2023-11-18T19:26:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.689+0000 7f2d5159a640 1 -- 172.21.15.45:0/1579267492 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2d4c0317a0 con 0x7f2d540c3ec0 2023-11-18T19:26:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.689+0000 7f2d5159a640 1 -- 172.21.15.45:0/1579267492 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c031b50 con 0x7f2d540c3ec0 2023-11-18T19:26:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 -- 172.21.15.45:0/1579267492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c3ec0 msgr2=0x7f2d540c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 --2- 172.21.15.45:0/1579267492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c3ec0 0x7f2d540c2510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009870 tx=0x7f2d4c02b8f0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 -- 172.21.15.45:0/1579267492 shutdown_connections 2023-11-18T19:26:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 --2- 172.21.15.45:0/1579267492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c3ec0 0x7f2d540c2510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 --2- 172.21.15.45:0/1579267492 >> v2:172.21.15.135:3300/0 conn(0x7f2d540c55e0 0x7f2d54071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 -- 172.21.15.45:0/1579267492 >> 172.21.15.45:0/1579267492 conn(0x7f2d540c5bd0 msgr2=0x7f2d540c5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:26:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 -- 172.21.15.45:0/1579267492 shutdown_connections 2023-11-18T19:26:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.690+0000 7f2d58a44640 1 -- 172.21.15.45:0/1579267492 wait complete. 2023-11-18T19:26:00.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.693+0000 7f2d58a44640 1 Processor -- start 2023-11-18T19:26:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.693+0000 7f2d58a44640 1 -- start start 2023-11-18T19:26:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.694+0000 7f2d58a44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d540c3ec0 0x7f2d5415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.694+0000 7f2d58a44640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c55e0 0x7f2d540a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.694+0000 7f2d58a44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d541522e0 0x7f2d54142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.694+0000 7f2d58a44640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d541ea2b0 con 0x7f2d540c3ec0 2023-11-18T19:26:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.694+0000 7f2d58a44640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5415ef00 con 0x7f2d541522e0 2023-11-18T19:26:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.694+0000 7f2d58a44640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5415d7e0 con 0x7f2d540c55e0 2023-11-18T19:26:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d540c3ec0 0x7f2d5415e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:00.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d540c3ec0 0x7f2d5415e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53466/0 (socket says 172.21.15.45:53466) 2023-11-18T19:26:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 -- 172.21.15.45:0/3989994767 learned_addr learned my addr 172.21.15.45:0/3989994767 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:26:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d52d9d640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d541522e0 0x7f2d54142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d51d9b640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c55e0 0x7f2d540a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 -- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c55e0 msgr2=0x7f2d540a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c55e0 0x7f2d540a6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 -- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d541522e0 msgr2=0x7f2d54142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d541522e0 0x7f2d54142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.695+0000 7f2d5259c640 1 -- 172.21.15.45:0/3989994767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0094d0 con 0x7f2d540c3ec0 2023-11-18T19:26:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.696+0000 7f2d5259c640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d540c3ec0 0x7f2d5415e9c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c6f0 tx=0x7f2d4400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:26:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.696+0000 7f2d4affd640 1 -- 172.21.15.45:0/3989994767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44003990 con 0x7f2d540c3ec0 2023-11-18T19:26:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.696+0000 7f2d4affd640 1 -- 172.21.15.45:0/3989994767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2d44003b10 con 0x7f2d540c3ec0 2023-11-18T19:26:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.696+0000 7f2d4affd640 1 -- 172.21.15.45:0/3989994767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400a850 con 0x7f2d540c3ec0 2023-11-18T19:26:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.696+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5415e590 con 0x7f2d540c3ec0 2023-11-18T19:26:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.696+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5415dcf0 con 0x7f2d540c3ec0 2023-11-18T19:26:00.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.697+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d541ed820 con 0x7f2d540c3ec0 2023-11-18T19:26:00.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.698+0000 7f2d4affd640 1 -- 172.21.15.45:0/3989994767 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d4400a9b0 con 0x7f2d540c3ec0 2023-11-18T19:26:00.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.699+0000 7f2d4affd640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2d3406ae40 0x7f2d3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.700+0000 7f2d4affd640 1 -- 172.21.15.45:0/3989994767 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6195+0+0 (secure 0 0 0) 0x7f2d44089650 con 0x7f2d540c3ec0 2023-11-18T19:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.700+0000 7f2d51d9b640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2d3406ae40 0x7f2d3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.701+0000 7f2d51d9b640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2d3406ae40 0x7f2d3406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d540c6100 tx=0x7f2d3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.704+0000 7f2d4affd640 1 -- 172.21.15.45:0/3989994767 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d44054480 con 0x7f2d540c3ec0 2023-11-18T19:26:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:00.943+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d540747c0 con 0x7f2d540c3ec0 2023-11-18T19:26:01.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.443+0000 7f2d4affd640 1 -- 172.21.15.45:0/3989994767 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d44057aa0 con 0x7f2d540c3ec0 2023-11-18T19:26:01.445 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-18T19:26:01.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.448+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2d3406ae40 msgr2=0x7f2d3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:01.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.448+0000 7f2d58a44640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2d3406ae40 0x7f2d3406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d540c6100 tx=0x7f2d3c008040 comp rx=0 tx=0).stop 2023-11-18T19:26:01.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.448+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d540c3ec0 msgr2=0x7f2d5415e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:01.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.448+0000 7f2d58a44640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d540c3ec0 0x7f2d5415e9c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c6f0 tx=0x7f2d4400cbb0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.450+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 shutdown_connections 2023-11-18T19:26:01.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.450+0000 7f2d58a44640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d541522e0 0x7f2d54142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.450+0000 7f2d58a44640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f2d3406ae40 0x7f2d3406d300 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d540c6100 tx=0x7f2d3c008040 comp rx=0 tx=0).stop 2023-11-18T19:26:01.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.450+0000 7f2d58a44640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d540c55e0 0x7f2d540a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.450+0000 7f2d58a44640 1 --2- 172.21.15.45:0/3989994767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d540c3ec0 0x7f2d5415e9c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.450+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 >> 172.21.15.45:0/3989994767 conn(0x7f2d540c5bd0 msgr2=0x7f2d54071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:26:01.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.451+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 shutdown_connections 2023-11-18T19:26:01.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.452+0000 7f2d58a44640 1 -- 172.21.15.45:0/3989994767 wait complete. 2023-11-18T19:26:01.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-18T19:26:01.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.731+0000 7f4297483640 1 Processor -- start 2023-11-18T19:26:01.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.731+0000 7f4297483640 1 -- start start 2023-11-18T19:26:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4297483640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f429006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4297483640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f429006cbe0 0x7f42900c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4297483640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42900c4350 con 0x7f42900c1220 2023-11-18T19:26:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4297483640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429006d350 con 0x7f429006cbe0 2023-11-18T19:26:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4295a20640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f42900c1220 0x7f42900c21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47534/0 (socket says 172.21.15.45:47534) 2023-11-18T19:26:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4295a20640 1 -- 172.21.15.45:0/153066989 learned_addr learned my addr 172.21.15.45:0/153066989 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-18T19:26:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4294a1e640 1 --2- 172.21.15.45:0/153066989 >> v2:172.21.15.135:3300/0 conn(0x7f429006cbe0 0x7f42900c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:01.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.733+0000 7f4297483640 1 -- 172.21.15.45:0/153066989 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900c4c20 con 0x7f429006c2c0 2023-11-18T19:26:01.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.734+0000 7f429521f640 1 --2- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f429006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:01.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.734+0000 7f4283fff640 1 -- 172.21.15.45:0/153066989 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331790226 0 0) 0x7f42900c4350 con 0x7f42900c1220 2023-11-18T19:26:01.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.734+0000 7f4283fff640 1 -- 172.21.15.45:0/153066989 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f427c003520 con 0x7f42900c1220 2023-11-18T19:26:01.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.734+0000 7f4294a1e640 1 -- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 msgr2=0x7f429006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-18T19:26:01.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.734+0000 7f4294a1e640 1 --2- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f429006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.734+0000 7f4294a1e640 1 -- 172.21.15.45:0/153066989 >> v1:172.21.15.45:6789/0 conn(0x7f42900c1220 legacy=0x7f42900c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:01.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.734+0000 7f4294a1e640 1 -- 172.21.15.45:0/153066989 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42900a5730 con 0x7f429006cbe0 2023-11-18T19:26:01.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.739+0000 7f4294a1e640 1 --2- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429006cbe0 0x7f42900c1c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f428c0097a0 tx=0x7f428c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=675f6f6a379b24eb server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:26:01.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.739+0000 7f4283fff640 1 -- 172.21.15.45:0/153066989 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c030710 con 0x7f429006cbe0 2023-11-18T19:26:01.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.739+0000 7f4283fff640 1 -- 172.21.15.45:0/153066989 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f428c02e050 con 0x7f429006cbe0 2023-11-18T19:26:01.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.739+0000 7f4283fff640 1 -- 172.21.15.45:0/153066989 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c030ab0 con 0x7f429006cbe0 2023-11-18T19:26:01.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.740+0000 7f4297483640 1 -- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429006cbe0 msgr2=0x7f42900c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:01.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.740+0000 7f4297483640 1 --2- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429006cbe0 0x7f42900c1c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f428c0097a0 tx=0x7f428c02b710 comp rx=0 tx=0).stop 2023-11-18T19:26:01.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.740+0000 7f4297483640 1 -- 172.21.15.45:0/153066989 shutdown_connections 2023-11-18T19:26:01.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.740+0000 7f4297483640 1 --2- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429006cbe0 0x7f42900c1c90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.740+0000 7f4297483640 1 --2- 172.21.15.45:0/153066989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f429006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.740+0000 7f4297483640 1 -- 172.21.15.45:0/153066989 >> 172.21.15.45:0/153066989 conn(0x7f42900c5bd0 msgr2=0x7f42900c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:26:01.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.741+0000 7f4297483640 1 -- 172.21.15.45:0/153066989 shutdown_connections 2023-11-18T19:26:01.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.741+0000 7f4297483640 1 -- 172.21.15.45:0/153066989 wait complete. 2023-11-18T19:26:01.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.744+0000 7f4297483640 1 Processor -- start 2023-11-18T19:26:01.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.744+0000 7f4297483640 1 -- start start 2023-11-18T19:26:01.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.745+0000 7f4297483640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f42900aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:01.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.745+0000 7f4297483640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f429006cbe0 0x7f42901dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:01.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.745+0000 7f4297483640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42900c1220 0x7f42901df190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:01.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.745+0000 7f4297483640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900a6220 con 0x7f429006cbe0 2023-11-18T19:26:01.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.745+0000 7f4297483640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42901de710 con 0x7f42900c1220 2023-11-18T19:26:01.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.745+0000 7f4297483640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42901de430 con 0x7f429006c2c0 2023-11-18T19:26:01.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f429006cbe0 0x7f42901dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:01.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f429006cbe0 0x7f42901dd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53482/0 (socket says 172.21.15.45:53482) 2023-11-18T19:26:01.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 -- 172.21.15.45:0/15325900 learned_addr learned my addr 172.21.15.45:0/15325900 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-18T19:26:01.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f429521f640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f42900aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:01.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4295a20640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42900c1220 0x7f42901df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:01.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 -- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 msgr2=0x7f42900aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:01.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f42900aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 -- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42900c1220 msgr2=0x7f42901df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:01.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42900c1220 0x7f42901df190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:01.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.746+0000 7f4294a1e640 1 -- 172.21.15.45:0/15325900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009400 con 0x7f429006cbe0 2023-11-18T19:26:01.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.747+0000 7f4294a1e640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f429006cbe0 0x7f42901dd9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f428c035040 tx=0x7f428c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:26:01.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.748+0000 7f4281ffb640 1 -- 172.21.15.45:0/15325900 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c032890 con 0x7f429006cbe0 2023-11-18T19:26:01.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.748+0000 7f4281ffb640 1 -- 172.21.15.45:0/15325900 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f428c032a10 con 0x7f429006cbe0 2023-11-18T19:26:01.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.748+0000 7f4281ffb640 1 -- 172.21.15.45:0/15325900 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c032de0 con 0x7f429006cbe0 2023-11-18T19:26:01.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.748+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42901ee100 con 0x7f429006cbe0 2023-11-18T19:26:01.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.748+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42901ee6c0 con 0x7f429006cbe0 2023-11-18T19:26:01.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.750+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42900747c0 con 0x7f429006cbe0 2023-11-18T19:26:01.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.752+0000 7f4281ffb640 1 -- 172.21.15.45:0/15325900 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f428c039040 con 0x7f429006cbe0 2023-11-18T19:26:01.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.753+0000 7f4281ffb640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f427406ae90 0x7f427406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-18T19:26:01.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.753+0000 7f4281ffb640 1 -- 172.21.15.45:0/15325900 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5752+0+0 (secure 0 0 0) 0x7f428c0aab10 con 0x7f429006cbe0 2023-11-18T19:26:01.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.754+0000 7f429521f640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f427406ae90 0x7f427406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-18T19:26:01.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.763+0000 7f4281ffb640 1 -- 172.21.15.45:0/15325900 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f428c075c20 con 0x7f429006cbe0 2023-11-18T19:26:01.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:01.764+0000 7f429521f640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f427406ae90 0x7f427406d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f42901dee80 tx=0x7f428800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-18T19:26:02.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.100+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42900c3530 con 0x7f429006cbe0 2023-11-18T19:26:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.467+0000 7f4281ffb640 1 -- 172.21.15.45:0/15325900 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f428c04a0d0 con 0x7f429006cbe0 2023-11-18T19:26:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' removed 2023-11-18T19:26:02.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f427406ae90 msgr2=0x7f427406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:02.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f427406ae90 0x7f427406d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f42901dee80 tx=0x7f428800b040 comp rx=0 tx=0).stop 2023-11-18T19:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f429006cbe0 msgr2=0x7f42901dd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-18T19:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f429006cbe0 0x7f42901dd9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f428c035040 tx=0x7f428c0046c0 comp rx=0 tx=0).stop 2023-11-18T19:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 shutdown_connections 2023-11-18T19:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42900c1220 0x7f42901df190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f429006cbe0 0x7f42901dd9a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.45:6832/2457944943,v1:172.21.15.45:6833/2457944943] conn(0x7f427406ae90 0x7f427406d350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 --2- 172.21.15.45:0/15325900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f429006c2c0 0x7f42900aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-18T19:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.472+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 >> 172.21.15.45:0/15325900 conn(0x7f42900c5bd0 msgr2=0x7f4290071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-18T19:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.473+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 shutdown_connections 2023-11-18T19:26:02.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-18T19:26:02.474+0000 7f4297483640 1 -- 172.21.15.45:0/15325900 wait complete. 2023-11-18T19:26:02.509 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-18T19:26:02.509 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-18T19:26:02.510 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:02.535 INFO:tasks.ceph.mds.a:Stopped 2023-11-18T19:26:02.535 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-18T19:26:02.536 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:02.596 INFO:tasks.ceph.mds.c:Stopped 2023-11-18T19:26:02.596 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-18T19:26:02.597 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:02.615 INFO:tasks.ceph.mds.b:Stopped 2023-11-18T19:26:02.615 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-18T19:26:02.615 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:02.675 INFO:tasks.ceph.mds.d:Stopped 2023-11-18T19:26:02.676 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-18T19:26:02.676 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-18T19:26:02.676 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:05.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-18T19:26:08.778 INFO:tasks.ceph.osd.0:Stopped 2023-11-18T19:26:08.779 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-18T19:26:08.779 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:11.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-18T19:26:11.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-18T19:26:14.881 INFO:tasks.ceph.osd.1:Stopped 2023-11-18T19:26:14.882 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-18T19:26:14.882 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:14.983 INFO:tasks.ceph.osd.2:Stopped 2023-11-18T19:26:14.983 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-18T19:26:14.983 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:17.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-18T19:26:17.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-18T19:26:21.085 INFO:tasks.ceph.osd.3:Stopped 2023-11-18T19:26:21.086 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-18T19:26:21.086 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:23.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-18T19:26:23.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-18T19:26:24.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:24.556 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:27.190 INFO:tasks.ceph.osd.4:Stopped 2023-11-18T19:26:27.191 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-18T19:26:27.191 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:28.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-18T19:26:28.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-18T19:26:33.293 INFO:tasks.ceph.osd.5:Stopped 2023-11-18T19:26:33.293 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-18T19:26:33.293 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:34.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-18T19:26:34.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-18T19:26:39.395 INFO:tasks.ceph.osd.6:Stopped 2023-11-18T19:26:39.396 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-18T19:26:39.396 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:39.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2023-11-18T19:26:45.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-18T19:26:45.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-18T19:26:45.497 INFO:tasks.ceph.osd.7:Stopped 2023-11-18T19:26:45.497 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-18T19:26:45.498 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-18T19:26:45.498 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:45.568 INFO:tasks.ceph.mgr.y:Stopped 2023-11-18T19:26:45.569 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-18T19:26:45.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:50.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-11-18T19:26:50.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-18T19:26:51.670 INFO:tasks.ceph.mgr.x:Stopped 2023-11-18T19:26:51.674 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-18T19:26:51.674 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-18T19:26:51.674 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:51.707 INFO:tasks.ceph.mon.a:Stopped 2023-11-18T19:26:51.708 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-18T19:26:51.708 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:51.743 INFO:tasks.ceph.mon.b:Stopped 2023-11-18T19:26:51.743 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-18T19:26:51.744 INFO:teuthology.orchestra.run:waiting for 300 2023-11-18T19:26:51.814 INFO:tasks.ceph.mon.c:Stopped 2023-11-18T19:26:51.814 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-18T19:26:51.815 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-18T19:26:51.929 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:26:51.929 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-18T19:26:52.246 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:26:52.246 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-18T19:26:52.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:26:52.463 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-18T19:26:52.721 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:26:52.721 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-18T19:26:52.966 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:26:52.966 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-18T19:26:53.340 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:26:53.340 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-18T19:26:53.570 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:26:53.571 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-18T19:26:53.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:26:53.794 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-18T19:26:54.006 INFO:tasks.ceph:Archiving mon data... 2023-11-18T19:26:54.007 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/data/mon.a.tgz 2023-11-18T19:26:54.008 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-11-18T19:26:54.071 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.C0JkDMsm3r 2023-11-18T19:26:54.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.C0JkDMsm3r 2023-11-18T19:26:54.260 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.C0JkDMsm3r 2023-11-18T19:26:54.429 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.C0JkDMsm3r is 359KB 2023-11-18T19:26:54.543 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.C0JkDMsm3r 2023-11-18T19:26:54.605 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/data/mon.b.tgz 2023-11-18T19:26:54.605 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-11-18T19:26:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.PFSqb1M9RR 2023-11-18T19:26:54.667 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.PFSqb1M9RR 2023-11-18T19:26:54.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:54.704 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:54.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.PFSqb1M9RR 2023-11-18T19:26:55.045 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.PFSqb1M9RR is 378KB 2023-11-18T19:26:55.152 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.PFSqb1M9RR 2023-11-18T19:26:55.212 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/data/mon.c.tgz 2023-11-18T19:26:55.212 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-11-18T19:26:55.265 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.I8lEWHJaRC 2023-11-18T19:26:55.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.I8lEWHJaRC 2023-11-18T19:26:55.446 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.I8lEWHJaRC 2023-11-18T19:26:55.606 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.I8lEWHJaRC is 378KB 2023-11-18T19:26:55.714 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.I8lEWHJaRC 2023-11-18T19:26:55.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-11-18T19:26:55.774 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-18T19:26:55.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-18T19:26:55.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-18T19:26:55.885 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-18T19:26:55.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-18T19:26:55.892 DEBUG:teuthology.orchestra.run.smithi135:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-18T19:26:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-18T19:26:55.998 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-18T19:26:56.011 INFO:tasks.ceph:Archiving crash dumps... 2023-11-18T19:26:56.013 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/remote/smithi045/crash 2023-11-18T19:26:56.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-18T19:26:56.094 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/remote/smithi135/crash 2023-11-18T19:26:56.096 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-18T19:26:56.195 INFO:tasks.ceph:Shutting down logrotate 2023-11-18T19:26:56.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:56.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:56.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:56.452 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-18T19:26:56.553 INFO:tasks.ceph:Compressing logs... 2023-11-18T19:26:56.553 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-18T19:26:56.562 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-18T19:26:56.652 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-18T19:26:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87020.log 2023-11-18T19:26:56.655 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86860.log 2023-11-18T19:26:56.656 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86820.log 2023-11-18T19:26:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92077.log 2023-11-18T19:26:56.658 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86860.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-18T19:26:56.658 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86820.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-18T19:26:56.659 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302699.log 2023-11-18T19:26:56.660 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-18T19:26:56.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92387.log 2023-11-18T19:26:56.661 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92077.log.gz 2023-11-18T19:26:56.661 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86900.log 2023-11-18T19:26:56.662 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-18T19:26:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302963.log 2023-11-18T19:26:56.662 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.302699.log.gz 2023-11-18T19:26:56.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92387.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92387.log.gz 2023-11-18T19:26:56.663 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301943.log 2023-11-18T19:26:56.664 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86900.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-18T19:26:56.664 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86940.log 2023-11-18T19:26:56.665 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87060.log 2023-11-18T19:26:56.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302963.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-18T19:26:56.666 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.302963.log.gz 2023-11-18T19:26:56.666 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302447.log 2023-11-18T19:26:56.666 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.301943.log.gz 2023-11-18T19:26:56.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302489.log 2023-11-18T19:26:56.668 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91079.log 2023-11-18T19:26:56.668 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87060.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-18T19:26:56.668 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.91079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91079.log.gz 2023-11-18T19:26:56.668 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86980.log 2023-11-18T19:26:56.670 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-18T19:26:56.670 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86980.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-18T19:26:56.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300733.log 2023-11-18T19:26:56.670 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.302447.log.gz 2023-11-18T19:26:56.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302923.log 2023-11-18T19:26:56.671 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.302489.log.gz 2023-11-18T19:26:56.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302195.log 2023-11-18T19:26:56.671 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.300733.log.gz 2023-11-18T19:26:56.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302923.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.302923.log.gz 2023-11-18T19:26:56.672 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95384.log 2023-11-18T19:26:56.673 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-18T19:26:56.673 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86780.log 2023-11-18T19:26:56.673 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-18T19:26:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94805.log 2023-11-18T19:26:56.674 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.302195.log.gz 2023-11-18T19:26:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.95384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92035.log 2023-11-18T19:26:56.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300902.log 2023-11-18T19:26:56.676 INFO:teuthology.orchestra.run.smithi045.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.94805.log.gz 2023-11-18T19:26:56.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92035.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92035.log.gz 2023-11-18T19:26:56.678 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94721.log 2023-11-18T19:26:56.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300902.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.300902.log.gz 2023-11-18T19:26:56.679 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302531.log 2023-11-18T19:26:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90746.log 2023-11-18T19:26:56.681 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94721.log.gz 2023-11-18T19:26:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302531.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.302531.log.gz 2023-11-18T19:26:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302760.log 2023-11-18T19:26:56.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303131.log 2023-11-18T19:26:56.683 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90746.log.gz 2023-11-18T19:26:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302760.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.302760.log.gz 2023-11-18T19:26:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94637.log 2023-11-18T19:26:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90596.log 2023-11-18T19:26:56.686 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.303131.log.gz 2023-11-18T19:26:56.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94637.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94637.log.gz 2023-11-18T19:26:56.687 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302615.log 2023-11-18T19:26:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303005.log 2023-11-18T19:26:56.689 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90596.log.gz 2023-11-18T19:26:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302615.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.302615.log.gz 2023-11-18T19:26:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92885.log 2023-11-18T19:26:56.691 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92843.log 2023-11-18T19:26:56.692 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.303005.log.gz 2023-11-18T19:26:56.693 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92885.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92885.log.gz 2023-11-18T19:26:56.693 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92471.log 2023-11-18T19:26:56.694 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92843.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80573.log 2023-11-18T19:26:56.694 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92843.log.gz 2023-11-18T19:26:56.695 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92471.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92471.log.gz 2023-11-18T19:26:56.696 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301563.log 2023-11-18T19:26:56.697 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.80573.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80573.log.gz 2023-11-18T19:26:56.697 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92759.log 2023-11-18T19:26:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301563.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.301563.log.gz 2023-11-18T19:26:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91030.log 2023-11-18T19:26:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92759.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92759.log.gz 2023-11-18T19:26:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93546.log 2023-11-18T19:26:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91030.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91030.log.gz 2023-11-18T19:26:56.702 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90652.log 2023-11-18T19:26:56.704 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93546.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93546.log.gz 2023-11-18T19:26:56.704 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90355.log 2023-11-18T19:26:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90652.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90652.log.gz 2023-11-18T19:26:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301731.log 2023-11-18T19:26:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90355.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90355.log.gzgzip 2023-11-18T19:26:56.707 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.91810.log 2023-11-18T19:26:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301731.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.301731.log.gz 2023-11-18T19:26:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94511.log 2023-11-18T19:26:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93882.log 2023-11-18T19:26:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94511.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94511.log.gz 2023-11-18T19:26:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302863.log 2023-11-18T19:26:56.712 INFO:teuthology.orchestra.run.smithi045.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.91810.log.gz 2023-11-18T19:26:56.713 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86780.log: /var/log/ceph/ceph-mon.c.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86820.log.gz 2023-11-18T19:26:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93180.log 2023-11-18T19:26:56.713 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93882.log.gz 2023-11-18T19:26:56.714 INFO:teuthology.orchestra.run.smithi135.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86860.log.gz 2023-11-18T19:26:56.714 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90806.log 2023-11-18T19:26:56.714 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.302863.log.gz 2023-11-18T19:26:56.715 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86900.log.gz 2023-11-18T19:26:56.715 INFO:teuthology.orchestra.run.smithi135.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86940.log.gz 2023-11-18T19:26:56.716 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93180.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93180.log.gz 2023-11-18T19:26:56.716 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92513.log 2023-11-18T19:26:56.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94343.log 2023-11-18T19:26:56.717 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90806.log.gz 2023-11-18T19:26:56.717 INFO:teuthology.orchestra.run.smithi135.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86980.log.gz 2023-11-18T19:26:56.718 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92513.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92513.log.gz 2023-11-18T19:26:56.718 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94947.log 2023-11-18T19:26:56.719 INFO:teuthology.orchestra.run.smithi135.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87020.log.gz 2023-11-18T19:26:56.719 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90858.log 2023-11-18T19:26:56.719 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94343.log.gz 2023-11-18T19:26:56.720 INFO:teuthology.orchestra.run.smithi135.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87060.log.gz 2023-11-18T19:26:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93503.log 2023-11-18T19:26:56.721 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94947.log.gz 2023-11-18T19:26:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94217.log 2023-11-18T19:26:56.722 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90858.log.gz 2023-11-18T19:26:56.723 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93503.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93503.log.gz 2023-11-18T19:26:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90902.log 2023-11-18T19:26:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94217.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-18T19:26:56.725 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94217.log.gz 2023-11-18T19:26:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90902.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90902.log.gz 2023-11-18T19:26:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300691.log 2023-11-18T19:26:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302237.log 2023-11-18T19:26:56.728 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-18T19:26:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300691.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.300691.log.gz 2023-11-18T19:26:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91156.log 2023-11-18T19:26:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92429.log 2023-11-18T19:26:56.731 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.302237.log.gz 2023-11-18T19:26:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91156.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91156.log.gz 2023-11-18T19:26:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93828.log 2023-11-18T19:26:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303215.log 2023-11-18T19:26:56.733 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92429.log.gz 2023-11-18T19:26:56.735 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93828.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93828.log.gz 2023-11-18T19:26:56.735 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300946.log 2023-11-18T19:26:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303215.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.303215.log.gz 2023-11-18T19:26:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94133.log 2023-11-18T19:26:56.737 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300946.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.300946.log.gz 2023-11-18T19:26:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93490.log 2023-11-18T19:26:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94133.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94133.log.gz 2023-11-18T19:26:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93191.log 2023-11-18T19:26:56.741 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302573.log 2023-11-18T19:26:56.741 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93490.log.gz 2023-11-18T19:26:56.742 INFO:teuthology.orchestra.run.smithi135.stderr: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-18T19:26:56.742 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93191.log: gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.93921.log -- replaced with /var/log/ceph/ceph-client.admin.93191.log.gz 2023-11-18T19:26:56.742 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-18T19:26:56.743 INFO:teuthology.orchestra.run.smithi135.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86780.log.gz 2023-11-18T19:26:56.743 INFO:teuthology.orchestra.run.smithi135.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-18T19:26:56.744 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302573.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.302573.log.gz 2023-11-18T19:26:56.744 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93844.log 2023-11-18T19:26:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302027.log 2023-11-18T19:26:56.745 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93921.log.gz 2023-11-18T19:26:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93844.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93844.log.gz 2023-11-18T19:26:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301841.log 2023-11-18T19:26:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302027.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-18T19:26:56.747 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.302027.log.gz 2023-11-18T19:26:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301841.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.301841.log.gz 2023-11-18T19:26:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302153.log 2023-11-18T19:26:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303299.log 2023-11-18T19:26:56.752 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302153.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.302153.log.gz 2023-11-18T19:26:56.752 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302279.log 2023-11-18T19:26:56.753 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303299.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.303299.log.gz 2023-11-18T19:26:56.753 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92119.log 2023-11-18T19:26:56.754 INFO:teuthology.orchestra.run.smithi135.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-18T19:26:56.755 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94469.log 2023-11-18T19:26:56.755 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.302279.log.gz 2023-11-18T19:26:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92119.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92119.log.gz 2023-11-18T19:26:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92927.log 2023-11-18T19:26:56.758 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94469.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94469.log.gz 2023-11-18T19:26:56.758 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90532.log 2023-11-18T19:26:56.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93178.log 2023-11-18T19:26:56.760 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92927.log.gz 2023-11-18T19:26:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90532.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90532.log.gz 2023-11-18T19:26:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93905.log 2023-11-18T19:26:56.763 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93178.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93178.log.gz 2023-11-18T19:26:56.763 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303257.log 2023-11-18T19:26:56.764 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301773.log 2023-11-18T19:26:56.765 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93905.log.gz 2023-11-18T19:26:56.766 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303257.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.303257.log.gz 2023-11-18T19:26:56.766 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301031.log 2023-11-18T19:26:56.768 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303089.log 2023-11-18T19:26:56.768 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.301773.log.gz 2023-11-18T19:26:56.770 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301031.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.301031.log.gz 2023-11-18T19:26:56.770 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90944.log 2023-11-18T19:26:56.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94301.log 2023-11-18T19:26:56.772 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.303089.log.gz 2023-11-18T19:26:56.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90944.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90944.log.gzgzip 2023-11-18T19:26:56.773 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94953.log 2023-11-18T19:26:56.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94301.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94301.log.gz 2023-11-18T19:26:56.774 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91114.log 2023-11-18T19:26:56.775 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300607.log 2023-11-18T19:26:56.776 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94953.log.gz 2023-11-18T19:26:56.777 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91114.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91114.log.gz 2023-11-18T19:26:56.777 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93802.log 2023-11-18T19:26:56.779 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93543.log 2023-11-18T19:26:56.779 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.300607.log.gz 2023-11-18T19:26:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93802.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93802.log.gz 2023-11-18T19:26:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-18T19:26:56.782 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91072.log 2023-11-18T19:26:56.782 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93543.log.gz 2023-11-18T19:26:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302803.log 2023-11-18T19:26:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90451.log 2023-11-18T19:26:56.785 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91072.log.gz 2023-11-18T19:26:56.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94553.log 2023-11-18T19:26:56.787 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.302803.log.gz 2023-11-18T19:26:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93495.log 2023-11-18T19:26:56.789 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.90451.log.gz 2023-11-18T19:26:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94427.log 2023-11-18T19:26:56.790 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94553.log.gz 2023-11-18T19:26:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93544.log 2023-11-18T19:26:56.793 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93495.log.gz 2023-11-18T19:26:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94427.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94427.log.gz 2023-11-18T19:26:56.794 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92345.log 2023-11-18T19:26:56.794 INFO:teuthology.orchestra.run.smithi135.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-18T19:26:56.795 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90986.log 2023-11-18T19:26:56.795 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93544.log.gz 2023-11-18T19:26:56.796 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302111.log 2023-11-18T19:26:56.796 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92345.log.gz 2023-11-18T19:26:56.798 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94679.log 2023-11-18T19:26:56.798 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90986.log.gz 2023-11-18T19:26:56.800 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302657.log 2023-11-18T19:26:56.800 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.302111.log.gz 2023-11-18T19:26:56.801 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93011.log 2023-11-18T19:26:56.801 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94679.log.gz 2023-11-18T19:26:56.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93192.log 2023-11-18T19:26:56.802 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.302657.log.gz 2023-11-18T19:26:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93182.log 2023-11-18T19:26:56.804 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93011.log.gz 2023-11-18T19:26:56.805 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93192.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93192.log.gz 2023-11-18T19:26:56.806 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92245.log 2023-11-18T19:26:56.807 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86764.log 88.9% 2023-11-18T19:26:56.807 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93182.log.gz 2023-11-18T19:26:56.809 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93174.log 2023-11-18T19:26:56.809 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92245.log.gz 2023-11-18T19:26:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.86764.log: gzip -5 87.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.86764.log.gz -- 2023-11-18T19:26:56.810 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.301073.log 2023-11-18T19:26:56.812 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301115.log 2023-11-18T19:26:56.812 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.93174.log.gz 2023-11-18T19:26:56.814 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93842.log 2023-11-18T19:26:56.814 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.301073.log.gz 2023-11-18T19:26:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301115.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-18T19:26:56.815 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.301115.log.gz 2023-11-18T19:26:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91282.log 2023-11-18T19:26:56.816 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93842.log.gz 2023-11-18T19:26:56.818 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303173.log 2023-11-18T19:26:56.820 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301985.log 2023-11-18T19:26:56.820 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91282.log.gz 2023-11-18T19:26:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302321.log 2023-11-18T19:26:56.821 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.303173.log.gz 2023-11-18T19:26:56.823 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301647.log 2023-11-18T19:26:56.823 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.301985.log.gz 2023-11-18T19:26:56.824 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92717.log 2023-11-18T19:26:56.824 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.302321.log.gz 2023-11-18T19:26:56.825 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301647.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.301647.log.gz 2023-11-18T19:26:56.826 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303047.log 2023-11-18T19:26:56.827 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93887.log 2023-11-18T19:26:56.827 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92717.log.gz 2023-11-18T19:26:56.829 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.303047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91198.log 2023-11-18T19:26:56.829 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.303047.log.gz 2023-11-18T19:26:56.830 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93887.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93887.log.gz 2023-11-18T19:26:56.830 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94763.log 2023-11-18T19:26:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300989.log 2023-11-18T19:26:56.832 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91198.log.gz 2023-11-18T19:26:56.833 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302405.log 2023-11-18T19:26:56.834 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94763.log.gz 2023-11-18T19:26:56.835 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92591.log 2023-11-18T19:26:56.835 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.300989.log.gz 2023-11-18T19:26:56.836 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92801.log 2023-11-18T19:26:56.837 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.302405.log.gz 2023-11-18T19:26:56.838 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300649.log 2023-11-18T19:26:56.838 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92591.log.gz 2023-11-18T19:26:56.840 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300836.log 2023-11-18T19:26:56.840 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92801.log.gz 2023-11-18T19:26:56.841 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300649.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.300649.log.gz 2023-11-18T19:26:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94385.log 2023-11-18T19:26:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.300836.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.300836.log.gz 2023-11-18T19:26:56.843 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-18T19:26:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93547.log 2023-11-18T19:26:56.845 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94385.log.gz 2023-11-18T19:26:56.846 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91240.log 2023-11-18T19:26:56.848 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93547.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93547.log.gz 2023-11-18T19:26:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93190.log 2023-11-18T19:26:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91240.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91240.log.gz 2023-11-18T19:26:56.850 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301689.log 2023-11-18T19:26:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93190.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93190.log.gz 2023-11-18T19:26:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-18T19:26:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301689.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.301689.log.gz 2023-11-18T19:26:56.854 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92303.log 2023-11-18T19:26:56.857 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.92303.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92303.log.gz 2023-11-18T19:26:56.858 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86875.log 2023-11-18T19:26:56.859 INFO:teuthology.orchestra.run.smithi045.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-18T19:26:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-18T19:26:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.86875.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86875.log.gz 2023-11-18T19:26:56.862 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-18T19:26:56.865 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92161.log 2023-11-18T19:26:56.870 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94259.log 2023-11-18T19:26:56.871 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92161.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92161.log.gz 2023-11-18T19:26:56.872 INFO:teuthology.orchestra.run.smithi045.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-18T19:26:56.873 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91324.log 2023-11-18T19:26:56.874 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94259.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94259.log.gz 2023-11-18T19:26:56.876 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301901.log 2023-11-18T19:26:56.878 INFO:teuthology.orchestra.run.smithi045.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91324.log.gz 2023-11-18T19:26:56.879 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91390.log 2023-11-18T19:26:56.882 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.301901.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.301901.log.gz 2023-11-18T19:26:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.91390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92633.log 2023-11-18T19:26:56.885 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91390.log.gz 2023-11-18T19:26:56.888 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.92633.log: -- /var/log/ceph/ceph-client.admin.302069.log 2023-11-18T19:26:56.891 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302069.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92633.log.gz 2023-11-18T19:26:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301605.log 2023-11-18T19:26:56.894 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90704.log 2023-11-18T19:26:56.896 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0%/var/log/ceph/ceph-client.admin.301605.log: -- replaced with /var/log/ceph/ceph-client.admin.302069.log.gz 2023-11-18T19:26:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.90704.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.301605.log.gz 2023-11-18T19:26:56.898 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90704.log.gz 2023-11-18T19:26:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94595.log 2023-11-18T19:26:56.902 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93193.log 2023-11-18T19:26:56.904 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94595.log.gz 2023-11-18T19:26:56.906 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92969.log 2023-11-18T19:26:56.910 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93193.log: /var/log/ceph/ceph-client.admin.92969.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93473.log 2023-11-18T19:26:56.911 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93193.log.gz 2023-11-18T19:26:56.912 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92969.log.gz 2023-11-18T19:26:56.915 INFO:teuthology.orchestra.run.smithi045.stderr:gzip/var/log/ceph/ceph-client.admin.93473.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.86506.log 2023-11-18T19:26:56.918 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.86506.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93473.log.gz 2023-11-18T19:26:56.919 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92203.log 2023-11-18T19:26:56.920 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86506.log.gz 2023-11-18T19:26:56.922 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302363.log 2023-11-18T19:26:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.302363.log: /var/log/ceph/ceph-client.admin.92203.log: 88.8% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92203.log.gz -- replaced with /var/log/ceph/ceph-client.admin.302363.log.gz 2023-11-18T19:26:56.926 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-18T19:26:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92675.log 2023-11-18T19:26:56.928 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-18T19:26:56.931 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92675.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92675.log.gz 2023-11-18T19:26:56.932 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94175.log 2023-11-18T19:26:56.936 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94175.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94091.log 2023-11-18T19:26:56.939 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94175.log.gz 2023-11-18T19:26:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94091.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94091.log.gz 2023-11-18T19:26:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300775.log 2023-11-18T19:26:56.946 INFO:teuthology.orchestra.run.smithi045.stderr: 93.7%/var/log/ceph/ceph-client.admin.300775.log: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-18T19:26:56.947 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.300775.log.gz 2023-11-18T19:26:57.032 INFO:teuthology.orchestra.run.smithi045.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-18T19:26:57.482 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-18T19:26:57.665 INFO:teuthology.orchestra.run.smithi045.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-18T19:26:57.718 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-18T19:27:23.915 INFO:teuthology.orchestra.run.smithi045.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-18T19:27:36.723 INFO:teuthology.orchestra.run.smithi045.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-18T19:27:39.714 INFO:teuthology.orchestra.run.smithi045.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-18T19:27:41.649 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-18T19:27:44.547 INFO:teuthology.orchestra.run.smithi135.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-18T19:27:46.555 INFO:teuthology.orchestra.run.smithi045.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-18T19:27:54.391 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-18T19:27:54.464 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-18T19:28:14.144 INFO:teuthology.orchestra.run.smithi135.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-18T19:28:14.147 INFO:teuthology.orchestra.run.smithi135.stderr: 2023-11-18T19:28:14.147 INFO:teuthology.orchestra.run.smithi135.stderr:real 1m17.535s 2023-11-18T19:28:14.147 INFO:teuthology.orchestra.run.smithi135.stderr:user 3m56.061s 2023-11-18T19:28:14.147 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m19.097s 2023-11-18T19:28:43.468 INFO:teuthology.orchestra.run.smithi045.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.95384.log.gz 2023-11-18T19:28:43.473 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-18T19:28:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:real 1m46.861s 2023-11-18T19:28:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:user 4m9.403s 2023-11-18T19:28:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m18.146s 2023-11-18T19:28:43.474 INFO:tasks.ceph:Archiving logs... 2023-11-18T19:28:43.475 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/remote/smithi045/log 2023-11-18T19:28:43.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-18T19:29:19.992 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/remote/smithi135/log 2023-11-18T19:29:19.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-18T19:30:01.584 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-18T19:30:01.594 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-18T19:30:01.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-18T19:30:01.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-18T19:30:01.799 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-18T19:30:01.808 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-18T19:30:01.808 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T19:30:01.817 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-18T19:30:01.869 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2023-11-18T19:30:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2023-11-18T19:30:01.879 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T19:30:01.880 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-11-18T19:30:01.880 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 +1427us[+1427us] +/- 79ms 2023-11-18T19:30:01.880 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -789us[ -797us] +/- 71ms 2023-11-18T19:30:01.880 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -496us[ -505us] +/- 76ms 2023-11-18T19:30:01.880 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:30:01.907 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-18T19:30:01.908 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-11-18T19:30:01.908 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 +1473us[+1477us] +/- 79ms 2023-11-18T19:30:01.908 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -750us[ -746us] +/- 71ms 2023-11-18T19:30:01.908 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -485us[ -485us] +/- 76ms 2023-11-18T19:30:01.908 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-18T19:30:01.910 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-18T19:30:01.920 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-18T19:30:01.920 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-18T19:30:01.929 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-18T19:30:02.211 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-18T19:30:02.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T19:30:02.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T19:30:02.625 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-18T19:30:02.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T19:30:02.717 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-18T19:30:02.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-18T19:30:02.735 INFO:teuthology.task.internal:Duration was 2194.112452 seconds 2023-11-18T19:30:02.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-18T19:30:02.746 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-18T19:30:02.746 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-18T19:30:02.755 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-18T19:30:02.930 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T19:30:02.932 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-18T19:30:03.326 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-18T19:30:03.326 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-11-18T19:30:03.327 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-18T19:30:03.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2023-11-18T19:30:03.397 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-18T19:30:03.471 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-18T19:30:03.472 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-18T19:30:03.481 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-18T19:30:03.584 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-18T19:30:03.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-18T19:30:03.590 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-18T19:30:03.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-18T19:30:03.792 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-18T19:30:03.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-18T19:30:03.893 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-18T19:30:03.992 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-18T19:30:04.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-18T19:30:04.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-18T19:30:04.123 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-11-18T19:30:04.136 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2023-11-18T19:30:04.188 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-18T19:30:04.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T19:30:04.241 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-18T19:30:04.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-18T19:30:04.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-18T19:30:04.309 INFO:teuthology.task.internal:Transferring archived files... 2023-11-18T19:30:04.310 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/remote/smithi045 2023-11-18T19:30:04.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-18T19:30:04.420 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631/remote/smithi135 2023-11-18T19:30:04.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-18T19:30:04.530 INFO:teuthology.task.internal:Removing archive directory... 2023-11-18T19:30:04.530 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-18T19:30:04.540 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-18T19:30:04.594 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-18T19:30:04.605 INFO:teuthology.task.internal:Not uploading archives. 2023-11-18T19:30:04.605 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-18T19:30:04.614 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-18T19:30:04.614 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-18T19:30:04.623 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-18T19:30:04.677 INFO:teuthology.orchestra.run.smithi045.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 18 19:30 /home/ubuntu/cephtest 2023-11-18T19:30:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: 524795 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 18 19:30 /home/ubuntu/cephtest 2023-11-18T19:30:04.684 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-18T19:30:04.694 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-18T19:30:04.712 INFO:teuthology.nuke:Checking targets against current locks 2023-11-18T19:30:04.738 DEBUG:teuthology.nuke:shortname: smithi045 2023-11-18T19:30:04.739 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T19:30:04.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 18:44:35.579756', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxi6IfQxZmhIEmrciFlkJVcoI5Kuihsb/cws3xBpSC7NRmfCuG4ikrHEfr35KkPEihQCfq77SiOu0/Mz8NfKpc='} 2023-11-18T19:30:04.765 DEBUG:teuthology.nuke:shortname: smithi135 2023-11-18T19:30:04.765 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-18T19:30:04.790 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:51:50-fs-main-distro-default-smithi/7461631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-18 18:44:35.581138', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2Ybx6HbM45x/yzfJPFo+xiWmdEeDbtUwg16eOlEqGX6FCgudCR/BGrHBGbFi5r1vqgKjXLYxFwP4gjPnBVyFg='} 2023-11-18T19:30:04.819 INFO:teuthology.orchestra.console.smithi045:Power off 2023-11-18T19:30:04.819 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-18T19:30:04.856 INFO:teuthology.orchestra.console.smithi135:Power off 2023-11-18T19:30:04.856 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-18T19:30:04.866 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-11-18T19:30:04.866 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T19:30:04.881 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-11-18T19:30:04.881 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T19:30:04.892 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-11-18T19:30:04.904 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-11-18T19:30:08.894 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T19:30:08.905 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T19:30:09.004 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-11-18T19:30:09.013 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-11-18T19:30:13.008 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T19:30:13.016 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-18T19:30:13.118 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-11-18T19:30:13.124 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-11-18T19:30:13.219 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-11-18T19:30:13.225 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-11-18T19:30:13.332 INFO:teuthology.run:Summary data: client.0-kernel-sha1: ab677fe869e84af753f648236d6083528a81a405 client.1-kernel-sha1: ab677fe869e84af753f648236d6083528a81a405 description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} duration: 2194.1124522686005 failure_reason: 'Command failed (workunit test kernel_untar_build.sh) on smithi135 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bd5c846ee48f44c3bbbdab4332a318e8 status: fail success: false 2023-11-18T19:30:13.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-18T19:30:13.413 INFO:teuthology.run:FAIL